- dovecot - dovecot.org

Rebuild uuidlist?
by Gandalf Corvotempesta 14 Dec '24

14 Dec '24

Guys i did a mess. A bad script made by me, changed (a lot) of filenames in the maildir, in example almost all email filenames were changed. I think I have to rebuild the UID <> filename mapping because dovecot is still trying to read the old file that doesn't exists anymore (it has a new name) Any suggestions? I think this would lead to a full-download of all messages client side, right ?

1 0

Mail gone when recreating a folder in a second IMAP session
by Ewald Dieterich 13 Dec '24

13 Dec '24

I'm running Dovecot 2.3.21 with the mdbox mailbox format. I lose mails (with an asterisk, see below) when I'm doing the following in 2 IMAP sessions: Session 1: Create a folder, save a mail and select it: . create folder . append folder {1} . select folder * 1 EXISTS * OK [UIDVALIDITY 1734013510] UIDs valid Session 2: Delete the folder, create it again, save a mail in it, check the number of messages and the uidvalidity:. . delete folder . create folder . append folder {1} . status folder (messages uidvalidity) * STATUS folder (MESSAGES 1 UIDVALIDITY 1734013511) Everything is as expected until here, the uidvalidity was increased by 1, which makes sense. Session 1: Just do a noop . noop * BYE IMAP session state is inconsistent, please relogin. Dovecot notices that something is wrong and closes the connection. This error is logged: Error: Mailbox folder: Corrupted transaction log file /var/spool/dovecot/user/mailboxes/folder/dbox-Mails/dovecot.index.log seq 2: indexid changed: 1734011270 -> 1734011403 (sync_offset=0) Session 2: Check the folder again: . status folder (messages uidvalidity) * STATUS folder (MESSAGES 0 UIDVALIDITY 1734013512) The mail is gone, uidvalidity was again increased by 1, so this is a new folder. I think the problem is that the folder's transaction log is deleted in session 1 in mail_transaction_log_file_open() when Dovecot notices discrepancies in what it expects: if (ret == 0) { /* corrupted */ if (index->readonly) { /* don't delete */ } else { i_unlink_if_exists(file->filepath); } *reason_r = "File is corrupted"; return 0; } This basically recreates the folder, so now it's empty. Here's the asterisk: I know that technically the mail isn't lost because it's still in the storage file and can be recovered. But it's still ugly. And when I copy a mail from another folder instead of appending it, I can't recover it for the folder because the information that the mail was copied is definitely lost. Can this be fixed in Dovecot?

3 4

sieve enotify mixes message body and subject
by Cajus Korn 12 Dec '24

12 Dec '24

Dear Community, I found that the following lines of a sieve filter require ["enotify"]; # rule:[enotify] if true { notify :importance "2" :message "New Message received." "mailto:xyz@somedomain.com"; } results in getting the following reply: [...] X-Sieve: Pigeonhole Sieve 0.5.21.1 (49005e73) Message-ID: <dovecot-sieve-1733953974-73072-0(a)ironman.cajus.name> Date: Wed, 11 Dec 2024 22:52:54 +0100 Subject: New Message received. From: Postmaster <postmaster(a)ironman.cajus.name> To: xyz(a)somedomain.com Auto-Submitted: auto-notified; owner-email="contacta(a)ironman.cajus.name" Precedence: bulk X-Priority: 3 (Normal) Importance: Normal MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Notification of new message. Shouldn't the message "New Message received." be in the mail body and "Notification of new message." be in the subject? So body and subject got mixed up. Until now I do not know how to debug this further. Any ideas? kind regards Cajus

1 0

Do not working Vitual Flagged / All.
by yisuyong＠gmail.com 11 Dec '24

11 Dec '24

Hello, I also proceeded according to this thread (https://dovecot.org/list/dovecot/2022-January/123979.html) but it is not working. My settings are as follows: []# dovecot -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.16 (09c29328) \# OS: Linux 5.15.0-125-generic x86_64 Ubuntu 22.04.5 LTS # Hostname: localhost auth_debug = yes auth_debug_passwords = yes auth_default_realm = example.com auth_mechanisms = plain login auth_username_format = %u auth_verbose = yes dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } mail_debug = yes mail_home = /home/vmail/%d/%n mail_location = maildir:~/Maildir mail_plugins = quota virtual mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox 보낼편지함 { auto = subscribe } mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox virtual/All { auto = subscribe comment = All my messages special_use = \All } mailbox virtual/Flagged { auto = subscribe comment = All my flagged messages special_use = \Flagged } prefix = INBOX/ separator = / type = private } namespace virtual { hidden = yes list = no location = virtual:/etc/dovecot/virtual:INDEX=~/.virtual:CONTROL=~/.virtual:VOLATILEDIR=~/.virtual/ prefix = virtual/ separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quota quota_grace = 10%% quota_max_mail_size = 100M quota_rule = *:storage=1G quota_rule2 = INBOX/Trash:storage=+100M quota_status_overquota = 552 5.2.2 Mailbox is full quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning4 = -storage=100%% quota-warning -100 %u sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /var/mail/SpamToJunk.sieve } protocols = " imap lmtp sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } service stats { unix_listener stats-reader { group = www-data mode = 0660 user = www-data } unix_listener stats-writer { group = www-data mode = 0660 user = www-data } } ssl = required ssl_cert = </etc/letsencrypt/live/mail/fullchain.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_ssl = yes protocol lmtp { mail_plugins = quota virtual quota sieve virtual } protocol lda { mail_plugins = quota virtual sieve virtual } protocol imap { mail_plugins = quota virtual imap_quota virtual } local_name mail.edgenet.kr { ssl_cert = </etc/letsencrypt/live/mail/fullchain.pem ssl_key = # hidden, use -P to show it } []# cat /etc/dovecot/virtual/Flagged/dovecot-virtual * flagged []# cat /etc/dovecot/virtual/All/dovecot-virtual * all [/home/vmail/domain/user/Maildir]# ls -al 합계 84 drwx------ 13 vmail vmail 4096 12월 11 15:12 . drwx------ 5 vmail vmail 4096 12월 11 13:49 '.&vPSwvNO4ycDVaA-' drwx------ 3 vmail vmail 4096 12월 11 15:13 .. drwx------ 5 vmail vmail 4096 12월 11 13:49 .Archive drwx------ 5 vmail vmail 4096 12월 11 13:49 .Drafts drwx------ 5 vmail vmail 4096 12월 11 14:02 .Junk drwx------ 5 vmail vmail 4096 12월 11 13:49 .Sent drwx------ 5 vmail vmail 4096 12월 11 14:02 .Trash drwx------ 5 vmail vmail 4096 12월 11 13:49 .virtual.All drwx------ 5 vmail vmail 4096 12월 11 13:49 .virtual.Flagged drwx------ 2 vmail vmail 4096 12월 11 15:12 cur -rw------- 1 vmail vmail 110 12월 11 13:48 dovecot-uidlist -rw------- 1 vmail vmail 8 12월 11 14:02 dovecot-uidvalidity -r--r--r-- 1 vmail vmail 0 12월 11 13:48 dovecot-uidvalidity.675919c5 -rw------- 1 vmail vmail 3728 12월 11 14:26 dovecot.index.cache -rw------- 1 vmail vmail 1940 12월 11 15:12 dovecot.index.log -rw------- 1 vmail vmail 7404 12월 11 15:03 dovecot.list.index.log -rw------- 1 vmail vmail 288 12월 11 14:02 dovecot.mailbox.log -rw------- 1 vmail vmail 0 12월 11 13:48 maildirfolder drwx------ 2 vmail vmail 4096 12월 11 13:49 new -rw------- 1 vmail vmail 81 12월 11 13:49 subscriptions drwx------ 2 vmail vmail 4096 12월 11 13:48 tmp Can I get help to resolve the issue?

4 10

Sieve not working again
by christian 11 Dec '24

11 Dec '24

Hello, For the past few weeks, I have been facing an issue where user Sieve scripts no longer work. I have configured the filtering of spam emails marked by Rspamd in a before.sieve script, and that works fine. However, the user scripts created via ManageSieve through the Roundcube webmailer do not function anymore. I suspect that this issue started after a Debian 12.6 system upgrade. Could it be that something fundamentally changed, or is Dovecot not fully compatible with Debian 12? However, I find that hard to believe. Despite repeatedly reinstalling the Dovecot environment and verifying file permissions and configurations multiple times, I haven't been able to resolve the issue. I’ve been running Sieve for over 15 years on various servers and have never encountered such problems. Unfortunately, the sieve_user_log = /var/log/dovecot/sieve.log file is not being created. The directory specified in sieve_trace_dir = /var/log/dovecot/sieve is created, but it only logs actions from before.sieve, not from user Sieve scripts. Here are the relevant settings from 90-sieve.conf: plugin { sieve_extensions = +editheader sieve = file:/var/customers/sieve/%u/;active=/var/customers/sieve/%u/.dovecot.sieve sieve_dir = /var/customers/sieve/ sieve_default = /var/customers/sieve/default.sieve sieve_global = /var/customers/sieve/global.sieve sieve_before = /var/customers/sieve/before.sieve sieve_user_log = /var/log/dovecot/sieve.log sieve_trace_dir = /var/log/dovecot/sieve sieve_compile_binary = yes sieve_trace_level = matching sieve_trace_debug = yes sieve_debug = yes } Here’s a log entry from info_log_path = /var/log/dovecot/dovecot-lda.log: Dec 08 12:57:44 lda(info(a)domain.info)<2664475><r1+hOreJVWcbqCgAF7VarQ>: Info: sieve: msgid=<20241208115741.7792d7fe54743ef8(a)fgfunnelsmail.com>: fileinto action: stored mail into mailbox 'INBOX' Here’s a log entry from debug.log: Dec 08 13:12:55 lda(info(a)domain.info)<2680802><SNQDB0eNVWfi5ygAF7VarQ>: Debug: sieve: Using the following location for user's Sieve script: /var/customers/sieve/info(a)domain.info/.dovecot.sieve However, the script is not being applied. Contents of /var/customers/sieve/info(a)domain.info: /var/customers/sieve/info(a)domain.info # ls -lah total 24K drwxr-x--- 3 vmail vmail 4.0K Dec 8 13:07 . drwxr-x--- 51 vmail vmail 4.0K Dec 7 19:40 .. lrwxrwxrwx 1 vmail vmail 12 Dec 7 15:23 .dovecot.sieve -> filter.sieve -rwxr-x--- 1 vmail vmail 212 Dec 7 19:40 .dovecot.svbin -rw-r----- 1 vmail vmail 95 Dec 8 13:07 filter.sieve -rwxr-x--- 1 vmail vmail 212 Dec 7 19:40 filter.svbin drwxr-x--- 2 vmail vmail 4.0K Dec 8 13:07 tmp Contents of filter.sieve: require ["copy"]; # rule: [Redirect] if true { redirect :copy "christian(a)domain.info"; } The sieve_user_log = /var/log/dovecot/sieve.log file remains empty. Write permissions are correct, and there are no indications of errors in the dovecot.log or debug.log. Thanks for infos and your help Christian

2 12

lmtp(inge@xxx.com)<3161746><wLRLNlOvVmeSPjAAqrKISg>: sieve: msgid=<CACxh+MLsBhS7PY48A0KEm6Zpq0NB2a17TfE4=sid-ktSGbc5sg@mail.gmail.com>: fileinto action: failed to store into mailbox 'Spam': Mailbox doesn't exist: Spam
by leo1subscr＠zudiewiener.com 11 Dec '24

11 Dec '24

I'm trying to follow the instructions on "Replacing antispam plugin with IMAPSieve" https://doc.dovecot.org/2.3/configuration_manual/howto/antispam_with_sieve/ and have encountered the following error Dec 09 08:50:27 Error: lmtp(inge(a)xxx.com)<3161746><wLRLNlOvVmeSPjAAqrKISg>: sieve: msgid=<CACxh+MLsBhS7PY48A0KEm6Zpq0NB2a17TfE4=sid-ktSGbc5sg(a)mail.gmail.com>: fileinto action: failed to store into mailbox 'Spam': Mailbox doesn't exist: Spam This is a dump of the configuration ++++++++++++++++++++++++++ # 2.3.21 (47349e2482): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.21 (f6cd4b8e) # OS: Linux 6.8.0-49-generic x86_64 Ubuntu 24.04.1 LTS ext4 # Hostname: xxx.xxx.com auth_mechanisms = plain login dsync_features = empty-header-workaround imapc_features = rfc822.size fetch-headers imapc_host = imap2.xxx.com imapc_list_prefix = INBOX imapc_port = 993 imapc_user = %u log_path = /var/log/dovecot.log login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_debug = yes mail_gid = vmail mail_location = maildir:/home/vmail/mailboxes/%d/%n mail_prefetch_count = 20 mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { imapsieve_mailbox1_before = file:/home/vmail/sieve/global/learn-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/home/vmail/sieve/global/learn-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * sieve = file:/home/vmail/sieve/%d/%n/scripts;active=/home/vmail/sieve/%d/%n/active-script.sieve sieve_before = /home/vmail/sieve/global/spam-global.sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } user = vmail } service managesieve-login { inet_listener sieve { port = 4190 } } service managesieve { process_limit = 1024 } ssl = required ssl_cert = </etc/letsencrypt/live/xxx.com/fullchain.pem ssl_client_ca_dir = /etc/ssl ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { driver = passwd } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " sieve" postmaster_address = adm(a)xxx.com } protocol imap { imap_idle_notify_interval = 29 mins mail_max_userip_connections = 20 mail_plugins = " quota imap_quota imap_sieve notify replication" } ++++++++++++++++++++++++++ Thanks Leo

2 1

Trying to track down the source of a corrupted cache error
by Grant Keller 10 Dec '24

10 Dec '24

Recently we have been seeing a steady increase (nothing too crazy, just more than usual) in "Deleting corrupted cache record" log errors. What struck me as weird was that it would be for the same message over and over, indicating that the deleted record was making it back into the cache. Digging into one, I realized that the first error was actually this: Dec 4 19:08:59 b.imapd.sonic.net dovecot[2696]: imap(xxx): session=wnZqMH0oHOViI3NN Error: Mailbox INBOX: Maildir filename has wrong W value, renamed the file from /var/spool/mail/17/62/xxx/cur/1733363505.M428026P1491073.b.imapd.sonic.net,S=8966052,W=12155730:2, to /var/spool/mail/17/62/xxx/cur/1733363505.M428026P1491073.b.imapd.sonic.net,S=8966052:2, Dec 4 19:08:59 b.imapd.sonic.net dovecot[2696]: imap(xxx): session=wnZqMH0oHOViI3NN Error: Mailbox INBOX: Deleting corrupted cache record uid=6430670: UID 6430670: Broken virtual size in mailbox INBOX: read(/var/spool/mail/17/62/xxx/cur/1733363505.M428026P1491073.b.imapd.sonic.net,S=8966052,W=12155730:2,): FETCH BODY[]<11796480.393216> got too little data: 359249 vs 359250 Also worth noting that the emails themselves do have a highly unusual number of carriage returns. What causes this and is there a way to fix it besides deleting the offending message?

1 0

Info on 'sieve_pipe_bin_dir' needed
by leo1subscr＠zudiewiener.com 06 Dec '24

06 Dec '24

I'm trying to follow the instruction https://doc.dovecot.org/2.3/configuration_manual/howto/antispam_with_sieve/ to setup IMAPSieve I cannot find any info on what sieve_pipe_bin_dir should point to. Any references I have found to this point to the old wiki. My current spam learning sieve scripts are in file:/home/vmail/sieve/global/ Should sieve_pipe_bin_dir point to this? Thanks, Leo

2 1

Dovecot IMAP Mail latency
by tamilarasan_ext＠iomd.info 05 Dec '24

05 Dec '24

We are working on importing emails from Gmail to Dovecot. During the process, all emails are written to a new directory within the mail folder. For fetching the emails, we are using the IMAP protocol with the imap_tools Python library. After importing, we run the IMAP fetch at 5-second intervals. However, the newly imported emails do not appear immediately. They only become available after 30 to 40 seconds. How can we resolve this issue? What steps can we take to debug and identify the source of the delay?

2 1

Migrating GMail to Dovecot using imapc
by Jan Naumann 30 Nov '24

30 Nov '24

Dear Dovecot community, I try to migrate a GMail mailbox to Dovecot using `doveadm backup -R imapc:`. Since it seems that GMail disabled the login without XOAUTH2, I cannot figure out how to authenticate dovecot to GMail. Could you point me in the right direction? Thank you in advance! Best regards, Jan Here the commands and config I am using: # dovecot --version 2.3.19.1 (9b53102964) # doveadm -D -c gmail.conf backup -R -u user-gmail imapc: # cat gmail.conf !include /etc/dovecot/dovecot.conf imapc_host=imap.gmail.com imapc_port=993 imapc_ssl=imaps imapc_features=rfc822.size fetch-headers gmail-migration mail_prefetch_count=20 imapc_sasl_mechanisms=XOAUTH2 OAUTHBEARER PLAIN rawlog_dir = /tmp/rawlog imapc_rawlog_dir = /tmp/rawlog imapc_user=user(a)googlemail.com imapc_password=pw # cat /tmp/rawlog/20241118-114553.246444.1.in 1731926753.488821 * OK Gimap ready for requests from <ip> <base64> 1731926753.503819 * CAPABILITY IMAP4rev1 UNSELECT IDLE NAMESPACE QUOTA ID XLIST CHILDREN X-GM-EXT-1 XYZZY SASL-IR AUTH=XOAUTH2 AUTH=PLAIN AUTH=PLAIN-CLIENTTOKEN AUTH=OAUTHBEARER 1731926753.503819 1 OK Thats all she wrote! <base64> 1731926753.806967 + <base64> # cat /tmp/rawlog/20241118-114553.246444.1.out 1731926753.488935 1 CAPABILITY 1731926753.504048 2 AUTHENTICATE XOAUTH2 <base64>

14 51