- dovecot - dovecot.org

Dsync and network issues
by Danilo G. Baio 18 Feb '19

18 Feb '19

Hi. Our scenario: dovecot-2.3.4.1 Two FreeBSD servers, A (master) and B (slave). replication_max_conns = 10 doveadm_port = 60025 All mails are received on server A and replicated to server B. Sometimes we get these messages on server B: Feb 18 08:27:35 dsync-server(XX@XX): Error: client_connection_tcp_free: close((&conn->fd)) @ client-connection-tcp.c:632 failed (fd=15): Connection reset by peer Feb 18 08:28:00 dsync-server(XZ@XZ): Error: client_connection_tcp_free: close((&conn->fd)) @ client-connection-tcp.c:632 failed (fd=15): Connection reset by peer Feb 18 08:33:14 dsync-server(XY@XY): Error: client_connection_tcp_free: close((&conn->fd)) @ client-connection-tcp.c:632 failed (fd=15): Connection reset by peer Feb 18 08:44:07 dsync-server(XW@XW): Error: client_connection_tcp_free: close((&conn->fd)) @ client-connection-tcp.c:632 failed (fd=15): Connection reset by peer It happens sometimes (usually early morning) when users are syncing their mailboxes. Is there a way to debug this and find what is happening? Thanks for your time. -- Danilo G. Baio

1 0

imap-hibernate returned failure: Failed to parse client input: Invalid peer_dev_minor value
by Alex 18 Feb '19

18 Feb '19

Hello! I tried to use imap-hibernate. But errors in maillog: Oct 19 05:14:24 server dovecot: imap(email(a)example.com)<67125><Lu7ndYt4n8aASO/q>: Error: kevent(-1) for notify remove failed: Bad file descriptor Oct 19 05:14:24 server dovecot: imap(email(a)example.com)<67125><Lu7ndYt4n8aASO/q>: Error: close(-1) for notify remove failed: Bad file descriptor Oct 19 05:14:24 server dovecot: imap-hibernate: Error: Failed to parse client input: Invalid peer_dev_minor value: 18446744073709486335 Oct 19 05:14:24 server dovecot: imap(email(a)example.com)<67125><Lu7ndYt4n8aASO/q>: Error: /var/run/dovecot/imap-hibernate returned failure: Failed to parse client input: Invalid peer_dev_minor value: 18446744073709486335 Oct 19 05:14:24 server dovecot: imap: Error: dovecot-2.3.3, FreeBSD 10.4 dovenull 38990 0,0 0,0 43748 16308 - S 3:54 0:00,08 imap-login: (imap-login) dovenull 38998 0,0 0,1 47844 19536 - S 3:54 0:00,18 imap-login: [34.193.82.152 TLS proxy] (imap-login) dovenull 38999 0,0 0,1 47844 17180 - S 3:54 0:00,19 imap-login: (imap-login) dovenull 39000 0,0 0,0 35556 9584 - S 3:54 0:00,03 dovecot/imap-login dovenull 39001 0,0 0,0 43748 16320 - S 3:54 0:00,12 imap-login: (imap-login) dovenull 39002 0,0 0,0 43748 16320 - S 3:54 0:00,13 imap-login: (imap-login) dovenull 39003 0,0 0,0 43748 16328 - S 3:54 0:00,16 imap-login: (imap-login) dovenull 39004 0,0 0,1 47844 17948 - S 3:54 0:00,17 imap-login: [12.34.56.78 TLS proxy] (imap-login) vmail 39042 0,0 0,0 15936 3040 - I 3:54 0:00,01 imap-hibernate: [0 connections] (imap-hibernate) vmail 39076 0,0 0,0 78900 8984 - S 3:54 0:00,05 imap: [email(a)example.com 12.34.56.78 IDLE] (imap) vmail 44114 0,0 0,0 78900 8936 - I 4:06 0:00,05 imap: [email(a)example.com 34.193.82.152 IDLE] (imap) srw-rw---- 1 root dovecot 0 19 окт 03:54 imap-hibernate srw------- 1 root dovecot 0 19 окт 03:54 imap-master srw------- 1 root wheel 0 19 окт 03:54 imap-postlogin srw-rw-rw- 1 root wheel 0 19 окт 03:54 imap-urlauth srw------- 1 dovecot wheel 0 19 окт 03:54 imap-urlauth-worker imap_hibernate_timeout = 5 secs service imap-hibernate { extra_groups = $default_internal_group unix_listener imap-hibernate { group = dovecot } user = vmail } service imap { extra_groups = $default_internal_group unix_listener imap-master { group = $default_internal_group } } I tried to set user/group vmail, set mode = 0666, but the same errors. Can you help me with hibernate confiration ? Best regards, Alex

3 8

unsubscibe
by Henry Otten 18 Feb '19

18 Feb '19

unsubscribe

1 0

Re: Dove to error
by Aki Tuomi 18 Feb '19

18 Feb '19

mail_privileged_group=mail Aki > On 17 February 2019 at 19:03 Latin Bishop <soydepr(a)gmail.com> wrote: > > > When testing with thunder mail getting this error > > Feb 17 11:59:40 pepino dovecot: imap(pi): Error: open(/var/mail/pi) failed: Permission denied (euid=1000(pi) egid=1000(pi) missing +w perm: /var/mail, we're not in group 8(mail), dir owned by 0:8 mode=0775) > Feb 17 11:59:40 pepino dovecot: imap(pi): Error: Failed to autocreate mailbox INBOX: Internal error occurred. Refer to server log for more information. [2019-02-17 11:59:40] > Feb 17 11:59:50 pepino dovecot: imap(pi): Logged out in=155 out=874 > > > > On Feb 17, 2019, at 8:46 AM, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > > > > You probably mean -quiet flag which works > > > > Aki > > > >> On 17 February 2019 at 12:10 Latin Bishop <soydepr(a)gmail.com> wrote: > >> > >> > >> Thanks > >> > >> Was 143. I notice the -quite flag no longer works in openssl when testing connection > >> > >>> On Feb 17, 2019, at 3:33 AM, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > >>> > >>> > >>>> On 17 February 2019 at 05:50 Latin Bishop via dovecot < dovecot(a)dovecot.org> wrote: > >>>> > >>>> > >>>> > >>>> Getting this error after following > >>>> this tutorial > >>>> > >>>> Error in configuration file /etc/dovecot/dovecot.conf duplicate listener > >>>> > >>>> > >>>> https://samhobbs.co.uk/2013/12/raspberry-pi-email-server-part-2-dovecot > >>>> > >>> > >>> Usually doveconf -n tells you where the duplicate listener is so you can remove it. > >>> --- > >>> Aki Tuomi

3 7

Re: Dove to error
by Aki Tuomi 17 Feb '19

17 Feb '19

Wow, that is lot of useless config, see below for a fixed version to put into dovecot.conf =) Aki auth_mechanisms = plain login ## doing this lets people log in without SSL #disable_plaintext_auth = no listen = * mail_location = mbox:~/mail:INBOX=/var/mail/%u namespace { inbox = yes mailbox { special_use = \Drafts name = Drafts } mailbox { special_use = \Junk name = Junk } mailbox { special_use = \Sent name = Sent } mailbox { special_use = \Sent name = Sent Messages } mailbox { special_use = \Trash name = Trash } name = inbox } passdb { driver = pam } protocols = imap service auth { unix_listener { group = postfix mode = 0660 user = postfix path = /var/spool/postfix/private/auth } } ## this is useless config, as it's default #service imap-login { # inet_listener { # port = 143 # name = imap # } # inet_listener { # port = 993 # ssl = yes # name = imaps # } #} ssl_cert = </etc/dovecot/dovecot.pem ssl_key = # hidden, use -P to show it userdb { driver = passwd } ## end of config > On 17 February 2019 at 12:45 soydepr <soydepr(a)gmail.com> wrote: > > > # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.16 (fed8554) > # OS: Linux 4.14.79-v7+ armv7l Debian 9.6 > auth_mechanisms = plain login > disable_plaintext_auth = no > listen = * > mail_location = mbox:~/mail:INBOX=/var/mail/%u > namespace { > inbox = yes

2 1

Re: Dove to error
by Aki Tuomi 17 Feb '19

17 Feb '19

That really depends on your dovecot config, but try doveadm log find also you can list recent errors with doveadm log errors Aki > On 17 February 2019 at 20:03 Latin Bishop <soydepr(a)gmail.com> wrote: > > > Where I find dovecot log > > > > > On Feb 17, 2019, at 12:56 PM, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > > > > Yes, well, this is postfix log, which is not very useful when debugging dovecot problems... > > > > Aki > > > >> On 17 February 2019 at 19:50 Latin Bishop <soydepr(a)gmail.com> wrote: > >> > >> > >> Feb 17 12:48:00 pepino postfix/smtps/smtpd[3988]: connect from localhost[127.0.0.1] > >> Feb 17 12:48:01 pepino postfix/smtps/smtpd[3988]: warning: unknown smtpd restriction: "permit_ssl_authenticated" > >> Feb 17 12:48:01 pepino postfix/smtps/smtpd[3988]: NOQUEUE: reject: RCPT from localhost[127.0.0.1]: 451 4.3.5 Server configuration error; from=<pi(a)torombolo.ml> to=<pi(a)torombolo.ml> proto=ESMTP helo=<[127.0.0.1]> > >> Feb 17 12:48:07 pepino postfix/cleanup[3998]: 25EC480E6B: message-id=<20190217174807.25EC480E6B@pepino> > >> Feb 17 12:48:07 pepino postfix/smtps/smtpd[3988]: disconnect from localhost[127.0.0.1] ehlo=1 auth=1 mail=1 rcpt=0/1 quit=1 commands=4/5 > >> Feb 17 12:48:07 pepino postfix/qmgr[2604]: 25EC480E6B: from=<double-bounce@pepino>, size=970, nrcpt=1 (queue active) > >> Feb 17 12:48:07 pepino postfix/local[3999]: 25EC480E6B: to=<root(a)despiertapr.com>, orig_to=<postmaster>, relay=local, delay=0.06, delays=0.03/0/0/0.03, dsn=2.0.0, status=sent (delivered to maildir) > >> Feb 17 12:48:07 pepino postfix/qmgr[2604]: 25EC480E6B: removed > >> > >>> On Feb 17, 2019, at 12:40 PM, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > >>> > >>> Can you try adding 'pi' to group 'mail' too? Also, can you provide the actual errors from log? > >>> > >>> Aki > >>> > >>>> On 17 February 2019 at 19:37 Latin Bishop <soydepr(a)gmail.com> wrote: > >>>> > >>>> > >>>> Yes it is. Basically can’t send nor receive confit looks good > >>>> > >>>> > >>>> > >>>>> On Feb 17, 2019, at 12:34 PM, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > >>>>> > >>>>> Is user 'dovecot' member of group 'mail'? > >>>>> > >>>>> Aki > >>>>> > >>>>>> On 17 February 2019 at 19:28 Latin Bishop <soydepr(a)gmail.com> wrote: > >>>>>> > >>>>>> > >>>>>> Changed permissions but still have issues > >>>>>> > >>>>>> A error occurred while sending email the mail server responded 4.3.5 server configuration error > >>>>>> Please check the message recipient > >>>>>> > >>>>>> Sent from my iPad > >>>>>> > >>>>>>> On Feb 17, 2019, at 12:06 PM, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > >>>>>>> > >>>>>>> mail_privileged_group=mail > >>>>>>> > >>>>>>> Aki > >>>>>>> > >>>>>>>> On 17 February 2019 at 19:03 Latin Bishop <soydepr(a)gmail.com> wrote: > >>>>>>>> > >>>>>>>> > >>>>>>>> When testing with thunder mail getting this error > >>>>>>>> > >>>>>>>> Feb 17 11:59:40 pepino dovecot: imap(pi): Error: open(/var/mail/pi) failed: Permission denied (euid=1000(pi) egid=1000(pi) missing +w perm: /var/mail, we're not in group 8(mail), dir owned by 0:8 mode=0775) > >>>>>>>> Feb 17 11:59:40 pepino dovecot: imap(pi): Error: Failed to autocreate mailbox INBOX: Internal error occurred. Refer to server log for more information. [2019-02-17 11:59:40] > >>>>>>>> Feb 17 11:59:50 pepino dovecot: imap(pi): Logged out in=155 out=874 > >>>>>>>> > >>>>>>>> > >>>>>>>>> On Feb 17, 2019, at 8:46 AM, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > >>>>>>>>> > >>>>>>>>> You probably mean -quiet flag which works > >>>>>>>>> > >>>>>>>>> Aki > >>>>>>>>> > >>>>>>>>>> On 17 February 2019 at 12:10 Latin Bishop <soydepr(a)gmail.com> wrote: > >>>>>>>>>> > >>>>>>>>>> > >>>>>>>>>> Thanks > >>>>>>>>>> > >>>>>>>>>> Was 143. I notice the -quite flag no longer works in openssl when testing connection > >>>>>>>>>> > >>>>>>>>>>> On Feb 17, 2019, at 3:33 AM, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > >>>>>>>>>>> > >>>>>>>>>>> > >>>>>>>>>>>> On 17 February 2019 at 05:50 Latin Bishop via dovecot < dovecot(a)dovecot.org> wrote: > >>>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>>> Getting this error after following > >>>>>>>>>>>> this tutorial > >>>>>>>>>>>> > >>>>>>>>>>>> Error in configuration file /etc/dovecot/dovecot.conf duplicate listener > >>>>>>>>>>>> > >>>>>>>>>>>> > >>>>>>>>>>>> https://samhobbs.co.uk/2013/12/raspberry-pi-email-server-part-2-dovecot > >>>>>>>>>>>> > >>>>>>>>>>> > >>>>>>>>>>> Usually doveconf -n tells you where the duplicate listener is so you can remove it. > >>>>>>>>>>> --- > >>>>>>>>>>> Aki Tuomi

2 2

Re: [grosjo/fts-xapian] `doveadm fts rescan` removes all indices (#15)
by Joan Moreau 17 Feb '19

17 Feb '19

In such case, as long as the API is not upgraded, should doveadm index -A -q \* be considered a replacement of doveadm fts rescan On 2019-02-14 16:24, Timo Sirainen via dovecot wrote: > Hi, > > The rescan() function is a bit badly designed. Currently what you could do what fts-lucene does and: > - Get list of UIDs for all mails in each folder > - If Xapian has UID that doesn't exist -> delete it from Xapian > - If UID is missing from Xapian -> expunge the rest of the UIDs in that folder, so the next indexing will cause them to be indexed > > The expunging of rest of the mails is rather ugly, yes.. A better API would be if backend simply had a way to iterate all mails in the index, preferrably sorted by folder. Then a more generic code could go through them and expunge the necessary mails and index the missing mails. Although not all FTS backends support indexing in the middle. Anyway, we don't really have time to implement this new API soon. > > I'm not sure if this is a big problem though. I don't think most people running FTS have ever run rescan. > > On 8 Feb 2019, at 9.54, Joan Moreau via dovecot <dovecot(a)dovecot.org> wrote: > > Hi, > > THis is a core problem in Dovecot in my understanding. > > In my opinion, the rescan in dovecot should send to the FTS plugin the list of "supposedly" indexed emails (UID), and the plugin shall purge the redundant UID (i..e UID present in the index but not in the list sent by dovecot) and send back the list of UID not in its indexes to dovecot, so Dovect can send one by one the missing emails > > WHat do you think ? > > -------- Original Message -------- > > SUBJECT: > [grosjo/fts-xapian] `doveadm fts rescan` removes all indices (#15) > > DATE: > 2019-02-08 08:28 > > FROM: > Leonard Lausen <notifications(a)github.com> > > TO: > grosjo/fts-xapian <fts-xapian(a)noreply.github.com> > > CC: > Subscribed <subscribed(a)noreply.github.com> > > REPLY-TO: > grosjo/fts-xapian <reply+0022e607fd2eb3ff93959543198455bc7db5bdd58aa0286b92cf000000011874f1ae92a169ce185221c2(a)reply.github.com> > > doveadm fts rescan -A deletes all indices, ie. all folders and files in the xapian-indexes are deleted. However, according to man doveadm fts, the rescan command should only > > Scan what mails exist in the full text search index and compare those to what > actually exist in mailboxes. This removes mails from the index that have already > been expunged and makes sure that the next doveadm index will index all the > missing mails (if any). > > Deleting all indices does not seem to be the intended action, especially as constructing the index anew may take very long on large mailboxes. > > -- > You are receiving this because you are subscribed to this thread. > Reply to this email directly, view it on GitHub [1], or mute the thread [2]. Links: ------ [1] https://github.com/grosjo/fts-xapian/issues/15 [2] https://github.com/notifications/unsubscribe-auth/ACLmB9OB-7GaKIvhNc8sCgi7K…

2 2

Re: Dove to error
by Aki Tuomi 17 Feb '19

17 Feb '19

You probably mean -quiet flag which works Aki > On 17 February 2019 at 12:10 Latin Bishop <soydepr(a)gmail.com> wrote: > > > Thanks > > Was 143. I notice the -quite flag no longer works in openssl when testing connection > > > On Feb 17, 2019, at 3:33 AM, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: > > > > > >> On 17 February 2019 at 05:50 Latin Bishop via dovecot < dovecot(a)dovecot.org> wrote: > >> > >> > >> > >> Getting this error after following > >> this tutorial > >> > >> Error in configuration file /etc/dovecot/dovecot.conf duplicate listener > >> > >> > >> https://samhobbs.co.uk/2013/12/raspberry-pi-email-server-part-2-dovecot > >> > > > > Usually doveconf -n tells you where the duplicate listener is so you can remove it. > > --- > > Aki Tuomi

1 0

Re: Dove to error
by Tuomi, Aki 17 Feb '19

17 Feb '19

Can you post doveconf -n output?Aki -------- Original message --------From: soydepr <soydepr(a)gmail.com> Date: 17/02/2019 12:20 (GMT+02:00) To: Aki Tuomi <aki.tuomi(a)open-xchange.com> Subject: Re: Dove to error now getting this error eb 17 05:03:19 pepino systemd[1]: Starting Dovecot IMAP/POP3 email server...Feb 17 05:03:19 pepino dovecot[8814]: Error: systemd listens on port 143, but it's not configured in Dovecot. Closing.Feb 17 05:03:19 pepino dovecot[8814]: Error: systemd listens on port 993, but it's not configured in Dovecot. Closing.here is my entiresservice imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes }On Sun, Feb 17, 2019 at 5:10 AM Latin Bishop <soydepr(a)gmail.com> wrote:Thanks Was 143. I notice the -quite flag no longer works in openssl when testing connection On Feb 17, 2019, at 3:33 AM, Aki Tuomi <aki.tuomi(a)open-xchange.com> wrote: On 17 February 2019 at 05:50 Latin Bishop via dovecot < dovecot(a)dovecot.org> wrote: Getting this error after following this tutorial Error in configuration file /etc/dovecot/dovecot.conf duplicate listener https://samhobbs.co.uk/2013/12/raspberry-pi-email-server-part-2-dovecot Usually doveconf -n tells you where the duplicate listener is so you can remove it. --- Aki Tuomi

1 0

Dove to error
by Latin Bishop 17 Feb '19

17 Feb '19

Getting this error after following this tutorial Error in configuration file /etc/dovecot/dovecot.conf duplicate listener https://samhobbs.co.uk/2013/12/raspberry-pi-email-server-part-2-dovecot

2 1

Fwd: [grosjo/fts-xapian] `doveadm fts rescan` removes all indices (#15)
by Joan Moreau 14 Feb '19

14 Feb '19

Hi, THis is a core problem in Dovecot in my understanding. In my opinion, the rescan in dovecot should send to the FTS plugin the list of "supposedly" indexed emails (UID), and the plugin shall purge the redundant UID (i..e UID present in the index but not in the list sent by dovecot) and send back the list of UID not in its indexes to dovecot, so Dovect can send one by one the missing emails WHat do you think ? -------- Original Message -------- SUBJECT: [grosjo/fts-xapian] `doveadm fts rescan` removes all indices (#15) DATE: 2019-02-08 08:28 FROM: Leonard Lausen <notifications(a)github.com> TO: grosjo/fts-xapian <fts-xapian(a)noreply.github.com> CC: Subscribed <subscribed(a)noreply.github.com> REPLY-TO: grosjo/fts-xapian <reply+0022e607fd2eb3ff93959543198455bc7db5bdd58aa0286b92cf000000011874f1ae92a169ce185221c2(a)reply.github.com> doveadm fts rescan -A deletes all indices, ie. all folders and files in the xapian-indexes are deleted. However, according to man doveadm fts, the rescan command should only > Scan what mails exist in the full text search index and compare those to what > actually exist in mailboxes. This removes mails from the index that have already > been expunged and makes sure that the next doveadm index will index all the > missing mails (if any). Deleting all indices does not seem to be the intended action, especially as constructing the index anew may take very long on large mailboxes. -- You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub [1], or mute the thread [2]. Links: ------ [1] https://github.com/grosjo/fts-xapian/issues/15 [2] https://github.com/notifications/unsubscribe-auth/ACLmB9OB-7GaKIvhNc8sCgi7K…

2 2

Quota count and clone questions
by Robert Moskowitz 14 Feb '19

14 Feb '19

all this almost reads like I can drop maintaining the quota2 table? From https://wiki.dovecot.org/Quota/Count mailbox_list_index = yes # Avoid spending excessive time waiting for the quota calculation to finish when # mails' vsizes aren't already cached. If this many mails are opened, finish the # quota calculation on background in indexer-worker process. Mail deliveries will # be assumed to succeed, and explicit quota lookups will return internal error. mail_vsize_bg_after_count = 100 seems to belong in 10-mail.conf. That is where those var are shown. But: plugin { # 10MB quota limit quota = count:User quota quota_rule = *:storage=10M # This is required - it uses "virtual sizes" rather than "physical sizes" for quota counting: quota_vsizes = yes } I am having problems with. Right now for quota I have: plugin { quota = dict:user::proxy::sqlquota trash = /etc/dovecot/dovecot-trash.conf.ext } How do I reconcile these two? Then for clone: https://wiki.dovecot.org/Plugins/QuotaClone how does: mail_plugins = $mail_plugins quota quota_clone plugin { quota_clone_dict = redis:host=127.0.0.1:port=6379 } get replaced with something for mysql? dovecot-sql.conf.ext: driver = mysql connect = host=/var/lib/mysql/mysql.sock dbname=postfix user=postfix password=$Postfix_Database_Password default_pass_scheme = $cryptsha-CRYPT # following should all be on one line. password_query = SELECT username as user, password, concat('/home/vmail/', maildir) as userdb_home, concat('maildir:/home/vmail/', maildir) as userdb_mail, 101 as userdb_uid, 12 as userdb_gid FROM mailbox WHERE username = '%u' AND active = '1' # following should all be on one line user_query = SELECT concat('/home/vmail/', maildir) as home, concat('maildir:/home/vmail/', maildir) as mail, 101 AS uid, 12 AS gid, CONCAT('*:messages=30000:bytes=', quota) as quota_rule FROM mailbox WHERE username = '%u' AND active = '1' and dovecot-dict-sql.conf.ext: connect = host=/var/lib/mysql/mysql.sock dbname=postfix user=postfix password=$Postfix_Database_Password map { pattern = priv/quota/storage table = quota2 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota2 username_field = username value_field = messages } thanks

1 1

unsubcribe
by Henry Otten 14 Feb '19

14 Feb '19

1 0

Archive maildir
by Gandalf Corvotempesta 14 Feb '19

14 Feb '19

Hi to all We have a maildir with about 180GB of emails. We have to archive them to a structure like: .Archive.YYY./MM.folder Are you aware of a script doing this ? I've found a perl script that doesn't spit in year and month and a very, very, very, very, very old python script that: 1) doesn't manage base64 encoded subject properly 2) doesn't work with python 3.x (that is able to manage base64 encoded subject properly Any idea ?

6 9

Maintaining table quota2
by Robert Moskowitz 14 Feb '19

14 Feb '19

Does dovecot compute that values for quota2 with each email it updates for the user? Or only an incremental change? I ask because I am looking at migrating all the user mail from the old server to the new and building a new sql database. All I see is: dovecot-dict-sql.conf.ext: connect = host=/var/lib/mysql/mysql.sock dbname=postfix user=postfix password=$Postfix_Database_Password map { pattern = priv/quota/storage table = quota2 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota2 username_field = username value_field = messages } what is actually done with this table? thanks

3 11

problem witht working director
by Maciej Milaszewski IQ PL 13 Feb '19

13 Feb '19

Hi I have dovecot director with 2-3 ring and 4 dovecot My ring is : 10.0.100.2 9090 right never synced 8 37305225 39763861 0 723 2019-02-13 16:02:04 2019-02-13 16:02:04 10.0.100.3 9090 left never synced 8 57409664 8707830 0 737 2019-02-13 16:02:04 2019-02-13 16:02:04 10.0.100.4 9090 self never ring synced 1 - - - - - - 10.0.100.4 - This is my default server where clients connect - default direcor 2.2.36 10.0.100.3 - second direcot 2.2.36 10.0.100.2 - second director with older ver 2.2.18 Today I found the error in my default mailserver Feb 13 13:21:23 kernel: [24253349.641695] qmail-remote: page allocation failure: order:2, mode:0x204020 and problem with logging via imap and pop3 I try "doveadm director status" i get time out I try restart dovecot and get: Feb 13 13:21:03 thebe3 dovecot: master: Fatal: Dovecot is already running? Socket already exists: /var/run/dovecot/login/director before failure i found: "imap-login: Error: write(proxy-notify) failed: Resource temporarily unavailable" but my setting they seem correct https://paste.debian.net/1067596/ I moved IP (via keepalive) all to other director (secound servcer) And when I try "doveadm director status" i get time out https://paste.debian.net/1067601/ I do not understand why I had a problem with second server and restart dovecot in server2 restart solved the problem ?

1 0

smtp_address_cmp does not ignore case of localpart
by Andreas Jobs 13 Feb '19

13 Feb '19

Hi, in src/lib-smtp/smtp-address.c line 759 the localpart is compared with null_strcmp, which does not ignore the case. While this is the correct behavior (according to the RFC) it causes problems in real life. In my case the vacation notices are not sent, if someone writes to First.Last(a)ruhr-uni-bochum.de because :addresses contains (only) first.last(a)ruhr-uni-bochum.de. Regards, Andreas -- ! AJ3630-RIPE @ RUB8-RIPE Network Operation Center ! ! Dezernat 5.I Ruhr-Universitaet Bochum ! ! The amount of energy necessary to refute bullshit is ! ! an order of magnitude bigger than to produce it. -- Alberto Brandolini !

2 3

Can't sync mailbox XXX: Mailbox isn't selectable
by Tamas Hegedus 12 Feb '19

12 Feb '19

Hi, I have users with file system folders, which contain mbox files and dovecot indexes, in the ~/mail directory. If I run dsync, I have an error message and the sync can not be completed: Can't sync mailbox FOLDER_NAME: Mailbox isn't selectable I could not find any solution via google or any hint what to do in this situation. Thanks for your help and suggestion, Tamas -- Tamas Hegedus, PhD Senior Research Fellow MTA-SE Molecular Biophysics Research Group Hungarian Academy of Sciences | phone: (36) 1-459 1500/60233 Semmelweis University | fax: (36) 1-266 6656 Tuzolto utca 37-47 | mailto:tamas@hegelab.org Budapest, 1094, Hungary | http://www.hegelab.org --- This email has been checked for viruses by AVG. https://www.avg.com

2 1

doveadm import with subfolder oddity
by Mark Moseley 12 Feb '19

12 Feb '19

This has got to be something weird in my config. And the standard disclaimer of '"happy to post doveconf -n, but wanted to see if this is normal first" :) Background: Ubuntu Xenial, running 2.2.36. Mailbox type is mdbox and I've got a period separator in my inbox namespace: namespace { hidden = no inbox = yes list = yes location = mailbox Spam { auto = no autoexpunge = 1 weeks special_use = \Junk } mailbox Trash { auto = no special_use = \Trash } prefix = INBOX. separator = . subscriptions = yes type = private } If I do a import for a regular folder under INBOX, it works just fine: doveadm import -u testbox2(a)testing.local -U testbox1(a)testing.local mdbox:~/mdbox INBOX all mailbox Sent ... returns happily, message count gets incremented If I try to do the same with a subfolder (and a subfolder that most definitely exists on both source and destination side), I get an error: doveadm import -u testbox2(a)testing.local -U testbox1(a)testing.local mdbox:~/mdbox INBOX all mailbox Sub.Sub1 doveadm(testbox2(a)testing.local): Error: remote(10.1.17.98:4000): Mailbox Sub.Sub1: Mailbox sync failed: Mailbox doesn't exist: Sub.Sub1 If I use / instead of . in my query, it works: doveadm import -u testbox2(a)testing.local -U testbox1(a)testing.local mdbox:~/mdbox INBOX all mailbox Sub/Sub1 ... returns happily and message count gets incremented. Since we're using '.' as our separator, that was a bit unexpected :) Ironically, if I'm doing a IMAPc 'import', it works just fine with a query of 'all mailbox Sub.Sub1'. It's only when importing from a local src and local dest (i.e. source_location == mdbox:~/mdbox) that it fails. With source_location set to 'imapc:', it works. I imagine that's due to using straight IMAP on the source side. Likely a misconfig on my part? Expected behavior? I can see in the strace that the error is triggered when doveadm is looking at the source mailbox. It looks for mdbox/mailboxes/Sub.Sub1/dbox-Mails first, then falls back to mdbox/mailboxes/Sub/Sub1/dbox-Mails (which it finds). Then a little bit later in the strace, it again looks for mdbox/mailboxes/Sub.Sub1/dbox-Mails (which it doesn't find) but doesn't try mdbox/mailboxes/Sub/Sub1/dbox-Mails this time, and then spits out 'Mailbox Sub.Sub1: Mailbox sync failed: Mailbox doesn't exist: Sub.Sub1'. With a query of 'all mailbox Sub/Sub1', the stat() is for mdbox/mailboxes/Sub/Sub1/dbox-Mails which it finds and uses happily. Having to substitute the '.'s for '/'s in the 'mailbox' part of the query isn't an awful workaround, but it very much feels like I'm doing something wrong. This is a production setup, so everything else is otherwise working fine. But I've only just begun working with 'doveadm import', so I might be turning up some issues with my config. Thanks! Sorry I'm so verbose :)

1 1

Doveadm service as non-root user
by Mark Moseley 12 Feb '19

12 Feb '19

Running: Ubuntu xenial, dovecot 2.2.36 I've been working on moving our user base from maildir to mdbox and trying to come up with solutions for things like moving emails around. In the past, with maildir, our support guys could just mv the files around and done. For mdbox, I've been working on getting things set up to use doveadm. One weirdness I've seen is that in imports (i.e. doveadm import), mail gets copied correctly but the resulting files are left with root ownership (I don't have 'service doveadm' 'user' set, so I guess it defaults to root). It's typically new m.* files as well as the dovecot.list.index and dovecot.list.index.log files. Looking at strace, no chown is done on them, nor was there setuid. The import had no trouble finding the correct user in the db, so I know that it knows the correct UID (I can see it just fine in debug logs too). And it will happily import to existing m.* files with no permissions issues (but considering it's running as root, I wouldn't expect it to). I've seen this using 'import' via IMAPc as well as with both src and dest on the same server. I can see this behavior in both scenarios. We have a single shared UID for mail, so especially in that "src/dest on same server" case, it's not a matter of UID-mismatch. It's a director setup, so all doveadm commands are coming through the director. If I run the import directly on the backend (which obviously would be a bad idea in real life), the ownership of new m.* files seems to be correct (I can see it setuid'ing to the correct UID from userdb in strace). If I run the import on the director, I can get a new root-owned file every time it rolls over to the next m.* file. Two questions: * Is that a bug? Is this expected behavior? Seems like the expected thing would be to use the UID from userdb and either do a setuid (just like running 'doveadm import' locally did) or chown'ing any new files to the correct UID. I always always assume misconfiguration (vs bug, since it's almost never a bug) but I'm baffled on this one. * I see that it's possible to set a user for service doveadm and the wiki even suggests that it's a good idea in a single UID setup. If there are no mailboxes with any other UIDs, *will setting 'service doveadm' to the same UID possibly break anything*? I can't think of why it would, but I want to be duly diligent. Plus I'm a little leery about closing the door to ever having additional UIDs for mailboxes. Happy to provide 'doveconf -n' but wanted to check first, before spending 15 minutes gently obfuscating it :)

2 3

expunge not removing attachments?
by Ralf Hildebrandt 12 Feb '19

12 Feb '19

I have a large mail backup folder backup(a)backup.invalid; I'm cleaning up daily like this: infimum=`date -d "-4 day" +"%Y-%m-%d"` doveadm expunge -u backup(a)backup.invalid mailbox INBOX SAVEDBEFORE $infimum doveadm purge -u backup(a)backup.invalid yet I see this: # find attachments/ -type f -ctime +5 | wc -l 7522 # find attachments/ -type f | wc -l 127579 # find attachments/ -type f -mtime +5 | wc -l 14361 # find attachments/ -type f | wc -l 127793 About 5.9% of the files in attachments and below are older than 5 days. Why? Is that normal? using dovecot 2:2.3.1-1 from the official repos. -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | https://www.charite.de

2 3

APPEND Error in dovecot.log
by Alessandro Battaglini 12 Feb '19

12 Feb '19

Hi dovecot --version => 2.2.22 (fe789d2) Scenario: Sometimes imap client send email correctly but there's is any message stored in sent mail folder in that scenario I have found an error in my dovecot.log : 2019-02-11 09:04:52 imap(-----@------------): Info: Disconnected in APPEND (1 msgs, 125 secs, 2818048/4426899 bytes) in=3365352 out=1522206 Question: what about this? Is there, in dovecot configuration, a parameter that insist to any kind of APPEND like value.? I have not find that. Have you any idea to solve this? Thanks

1 0

assertion failed: (srcleft <= CHARSET_MAX_PENDING_BUF_SIZE)
by Giacomo 11 Feb '19

11 Feb '19

I'm running the following: # 2.3.4 (0ecbaf23d): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 11.2-RELEASE-p4 amd64 # FS: ZFS auth_mechanisms = plain login auth_username_format = %Ln listen = * mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { driver = pam } protocols = imap lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } user = dovecot } service imap-login { inet_listener imap { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service stats { unix_listener stats-reader { group = mode = 0600 user = } unix_listener stats-writer { group = $default_internal_group mode = 0666 user = } user = $default_internal_user } ssl_cert = </root/cert.pem ssl_key = # hidden, use -P to show it userdb { driver = passwd } dmesg shows: pid 74441 (imap), uid 1002: exited on signal 6 pid 74784 (imap), uid 1002: exited on signal 6 pid 21471 (imap), uid 1002: exited on signal 6 pid 21470 (imap), uid 1002: exited on signal 6 pid 21464 (imap), uid 1002: exited on signal 6 pid 21731 (imap), uid 1002: exited on signal 6 Sometimes the dovecot process serving an user crashes. He runs mostly airmail on macOS and samsung mail on Android. Happens only to that particular user. The log shows the following: (maillog) Dec 16 14:52:35 mail dovecot: imap-login: Login: user=<USER>, method=PLAIN, rip=79.12.201.157, lip=192.168.1.28, mpid=74779, TLS, session=<wMQI+iN9VtRPDMmd> Dec 16 14:52:39 mail dovecot: imap(USER)<74441><nLa+7SN9+fhPDMmd>: Panic: file charset-iconv.c: line 83 (charset_to_utf8_try): assertion failed: (srcleft <= CHARSET_MAX_PENDING_BUF_SIZE) Dec 16 14:52:39 mail dovecot: imap(USER)<74441><nLa+7SN9+fhPDMmd>: Fatal: master: service(imap): child 74441 killed with signal 6 (core not dumped - https://dovecot.org/bugreport.html#coredumps - set service imap { drop_priv_before_exec=yes }) I'm here if more info is needed. Thanks for taking a look.

4 7

Bounces?
by ＠lbutlr 11 Feb '19

11 Feb '19

I just got this On 9 Feb 2019, at 00:00, dovecot-request(a)dovecot.org wrote: > Your membership in the mailing list dovecot has been disabled due to > excessive bounces The last bounce received from you was dated > 02-Feb-2019. You will not get any more messages from this list until > you re-enable your membership. You will receive 1 more reminders like > this before your membership in the list is deleted. > > To re-enable your membership, you can simply respond to this message > (leaving the Subject: line intact), or visit the confirmation page at > > https://dovecot.org/mailman/confirm/dovecot/41881d… When clicking the link I get "Bad confirmation sting" and something about maybe the link expired. I see no connection attempts from dovecot.org over the last few days other than this message. -- If at first you don't succeed, destroy all evidence that you tried.

8 18

Use sieve to move all mail automatically based on List-Id
by Matthias Fechner 09 Feb '19

09 Feb '19

Dear all, I currently use the following rule to automatically sort email into folders based on mailing lists: # split out the various list forms # Mailman & other lists using list-id if exists "list-id" { if header :regex "list-id" "<([a-z_0-9-]+)[.@]" { set :lower "listname" "${1}"; fileinto :create "${listname}"; } else { if header :regex "list-id" "^\\s*<?([a-z_0-9-]+)[.@]" { set :lower "listname" "${1}"; fileinto :create "${listname}"; } else { keep; } } stop; } This works really nice. The only problem I have here is that it does use the ID, but not the name and this can lead to strange folder names. If an email has e.g. the following header: List-Id: mfechner/ci-test <142.ci-test.mfechner.gitlab.fechner.net> it moves the email to the folder 142 as the regex matches inside the <> string till the none-letter/none-number/_/- is matching. I do not understand the expresion [.@] so it is nearly impossible for my to extend that query. What I would like to do is using the ID as folder name as fallback. So in this case I would like that the email is moved to folder `mfechner/ci-test`. I'm not sure if sieve can handle the `/` correctly. Thanks a lot for any tip. Gruß Matthias -- "Programming today is a race between software engineers striving to build bigger and better idiot-proof programs, and the universe trying to produce bigger and better idiots. So far, the universe is winning." -- Rich Cook

1 0