October 2020 - dovecot

Users unable to login
by jesus san miguel 21 Oct '20

21 Oct '20

I have certain power users who can't login through POP3 or IMAP from their computer while being receiving mail on their cell phones (pop3), despite pop3_lock_session = no Am I hitting some other limit? I don't see any error in dovecot.log but a generic failed login: Oct 21 10:31:44 imap-login: Info: Disconnected (auth failed, 1 attempts in 2 secs): user=<someuser(a)somedomain.com>, method=DIGEST-MD5, rip=::1, lip=::1, secured, session=<XSVQLSqy2IYAAAAAAAAAAAAAAAAAAAAB> Running version is 2.3.11.3

4 8

Restrictions on default.sieve
by ＠lbutlr 21 Oct '20

21 Oct '20

Are there actions that default.sieve cannot take? I tried adding redirect :copy "backup+foo(a)local.example.com" and… nothing. No errors I can find, but also no mail being redirected. I also tried # there must be 'from' in the received headers if header :contains "received" "from" { redirect :copy "backup+foo(a)local.example.com" } And if header :index 1 :contains "received" "from" { redirect :copy "backup+foo(a)local.example.com" } But still, no mail in .foo for the backup user (yes, dovecot is setup to autofile +address into mailboxes, and that works). -- You couldn't say, 'I had orders.' You couldn't say, 'It's not fair.' No one was listening. There were no Words. You owned yourself. ... Not Thou Shalt Not. Say I Will Not. --Feet of Clay

2 3

A user's last access time
by Victor Sudakov 21 Oct '20

21 Oct '20

Dear Colleagues, Is there a file or directory within a user's Maildir, whose date of modification or access indicates the last time the user accessed his/her E-mail via IMAP or POP3? I'd like to figure out the time a user last logged in into his/her mail account, not the last time a mail was delivered to the INBOX. This information is probably available in the log, but a file which is touched each time a user accesses his/her mail, is more convenient. -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/

7 13

Corrupted dbox file + assertion failure
by tim＠linux-daus.de 21 Oct '20

21 Oct '20

Hi all, a dsync failed due a corrupted mdbox file. Force-resync throws the same error. (Dovecot 2.3.9.2) Is there any change to fix/repair the file? dsync-local(LOCALPART(a)DOMAIN.TLD)<MBF5EUC8j1/FfQAAkqONGQ>: Warning: fscking index file /var/mail/12/DOMAIN.TLD/242/LOCALPART/mdbox/storage/dovecot.map.index dsync-local(LOCALPART(a)DOMAIN.TLD)<MBF5EUC8j1/FfQAAkqONGQ>: Warning: mdbox /var/mail/12/DOMAIN.TLD/242/LOCALPART/mdbox/storage: rebuilding indexes dsync-local(LOCALPART(a)DOMAIN.TLD)<MBF5EUC8j1/FfQAAkqONGQ>: Error: Corrupted dbox file /var/mail/12/DOMAIN.TLD/242/LOCALPART/mdbox/storage/m.6 (around offset=5191109): msg header has bad magic value dsync-local(LOCALPART(a)DOMAIN.TLD)<MBF5EUC8j1/FfQAAkqONGQ>: Panic: file dbox-file-fix.c: line 219 (dbox_file_find_next_magic): assertion failed: (ret == -1) dsync-local(LOCALPART(a)DOMAIN.TLD)<MBF5EUC8j1/FfQAAkqONGQ>: Error: Raw backtrace: #0 t_askpass[0x7fbf4218b5f0] -> #1 backtrace_append[0x7fbf4218b860] -> #2 backtrace_get[0x7fbf4218b9c0] -> #3 i_syslog_error_handler[0x7fbf42196840] -> #4 default_fatal_handler[0x7fbf42196910] -> #5 i_fatal[0x7fbf420ec3b7] -> #6 dbox_attachment_file_get_stream[0x7fbf424c1010] -> #7 dbox_file_fix[0x7fbf424c1540] -> #8 mdbox_get_setting_parser_info[0x7fbf424b9290] -> #9 mdbox_storage_rebuild_in_context[0x7fbf424b99a0] -> #10 mdbox_sync_begin[0x7fbf424bbd00] -> #11 mdbox_sync[0x7fbf424bc730] -> #12 mdbox_storage_sync_init[0x7fbf424bc7f0] -> #13 mailbox_sync_init[0x7fbf4249ee80] -> #14 mailbox_sync[0x7fbf4249ef70] -> #15 dsync_brain_master_send_mailbox[0x55d6521dcaa0] -> #16 dsync_brain_run[0x55d6521daae0] -> #17 dsync_brain_run[0x55d6521db360] -> #18 dsync_ibc_has_pending_data[0x55d6521f0840] -> #19 io_loop_call_io[0x7fbf421b0490] -> #20 io_loop_handler_run_internal[0x7fbf421b1e20] -> #21 io_loop_handler_run[0x7fbf421b05c0] -> #22 io_loop_run[0x7fbf421b0810] -> #23 who_line_filter_match[0x55d6521bfa00] -> #24 doveadm_dsync_main[0x55d6521c2280] -> #25 doveadm_mail_single_user[0x55d6521c3090] -> #26 doveadm_mail_try_run[0x55d6521c3900] -> #27 main[0x55d6521b2030] -> #28 __libc_start_main[0x7fbf417c61f0] -> #29 _start[0x55d6521b2670] -> #30 [no start/end information] Regards, Tim

2 1

doveadm http api hign performance?
by hfh＠cndns.com 21 Oct '20

21 Oct '20

Does doveadm http api have high execution efficiency? I have a program that directly calls doveadm http api. Will there be an efficiency problem if a large number of users call it? hfh(a)cndns.com

1 0

How to move/reorganise existing e-mails to yearly subfolders
by R. Diez 21 Oct '20

21 Oct '20

Hi all: I am new to e-mail servers and I am evaluating Dovecot. Not really the best combination. 8-) I am trying to find a balance between legal data retention requirements and online mailbox size. I do not want huge online mailboxes, as doing offline, rotating data backups could then take forever (among other reasons). I would rather avoid online (cloud) backups (data protection etc.). If I set a mailbox size limit, users will have to delete old mails by themselves. Or I could somehow script the deletion of attachments from old e-mails, as attachments are usually the main cause of huge mailboxes. Incidentally, can anyone point me to an easy way to achieve this? Preferably over with IMAP, otherwise with Dovecot tools. With regards to legal data retention (which I am no expert about either), I thought I could use some Postfix BCC feature I heard about in order to copy all incoming and outgoing e-mails to a single "data retention" mailbox. Or maybe several of them. I could then archive e-mails from that mailbox on a yearly basis. I would like to automatically organise e-mails inside that mailbox into subfolders like this: 2019/alice 2019/bob 2020/alice 2020/bob That is: [year]/[username] With such a folder structure, it is easier to see what is going on. Is there a tool that can reorganise existing e-mails into such a folder structure? I found some tools on the Internet to backup and export mails from IMAP to IMAP or maildir destinations. But I could not find a tool that just reorganises (moves) e-mails in such a manner inside an existing mailbox, maybe with a user-defined pattern for the destination folders. I guess moving e-mails around on the same mailbox would be much faster than exporting and reimporting them in some clever way. I could always write a Perl script, but that takes time. Such a tool may already exist. Or perhaps somebody could mention a similar, good-written script I can use as a starting point. I am sure there are many small gotchas to avoid. At the moment, I am only confident with Perl and Java. Maybe JavaScript. It would be best to reorganise the e-mails over IMAP. This way, I am independent of the e-mail server. But a Dovecot-specific solution would also be helpful. I could use such a reorganisation tool not just for archiving or data retention purposes, but to reorganise other mailboxes too, like my personal mailbox. I would rather have a script. Clicking around in Thunderbird does not scale. I have seen that you can use a "sieve" in Dovecot to achieve this. But I guess that would only apply to new e-mails. And that would probably apply just to incoming mails, and not to outgoing ones. If I migrate from the existing e-mail servers, the e-mails will probably be mass-imported without going through any "sieve", right? Besides, I already have a few huge mailboxes with many years of e-mails, stored in a different e-mail server, and it would be nice to be able to reorganise them as they are. That way, I could archive the existing older e-mails before migrating to Dovecot, which would reduce the disk size and the export/import time for the migration. Many thanks in advance, rdiez

4 5

modify dovecot user/pass_queries to deliver to local aliases via dovecot submission, with postfixadmin/sqlite3 tables?
by PGNet Dev 21 Oct '20

21 Oct '20

I run dovecot + postfix with postfixadmin/sqlite3 I'm set up for all/only virtual users. All outbound mail submits via dovecot submission port. My current dovecot pass/user db queries are password_query = \ SELECT \ username as user, \ password, \ '/data/vmail/%d/%n/Maildir' as userdb_home, \ 5000 as userdb_uid, \ 5000 as userdb_gid \ FROM mailbox WHERE username = '%u' AND active = '1' user_query = \ SELECT \ '/data/vmail/%d/%n/Maildir' as home, \ 5000 AS uid, \ 5000 AS gid, \ ('dirsize:storage=' || quota) AS quota \ FROM mailbox WHERE username = '%u' AND active = '1' It works perfectly for real addresses. I've setup an alias address, e.g. REAL: realuser(a)example.com ALIAS: aliasuser(a)example.com INBOUND email to the ALIAS address -- from the 'net, delivered from postfix via LMTP to dovecot backend -- works fine. BUT any/all mail from local users TO the ALIAS addr fail at userDB lookup 2020-10-20 12:26:54 lmtp(aliasuser(a)example.com)<rI49JP45j19D8QAA+IOfAw>: Debug: auth-master: userdb lookup(aliasuser(a)example.com): auth USER input: 2020-10-20 12:26:54 lmtp(aliasuser(a)example.com)<rI49JP45j19D8QAA+IOfAw>: Debug: auth-master: userdb lookup(aliasuser(a)example.com): Userdb lookup failed What mods are required to the password_query &/or user_query in order to FIX the local->aliasuser mail lookup and delivery ... and ideally not break the rest of delivery?

1 1

lib22_push_notification_lua_plugin.so: undefined symbol: dlua_dovecot_register
by Mrinal Sharma 20 Oct '20

20 Oct '20

I am trying to use Lua Notification plugin for Event push But saw this error. Can anyone help me on this issue. Error In the logs when I receive an Email is given below. ========================================== Oct 15 21:55:41 master: Info: Dovecot v2.3.11.3 (502c39af9) starting up for imap, lmtp Oct 15 21:56:51 lmtp(36): Fatal: Couldn't load required plugin /usr/lib/dovecot/modules/lib22_push_notification_lua_plugin.so: dlopen() failed: /usr/lib/dovecot/modules/lib22_push_notification_lua_plugin.so: undefined symbol: dlua_dovecot_register ====================================================================== # dovecot -n # 2.3.11.3 (502c39af9): /etc/dovecot/dovecot.conf # OS: Linux 4.19.128-microsoft-standard x86_64 Debian 10.6 9p # Hostname: 238afcc76ba9 auth_debug = yes auth_mechanisms = plain oauthbearer xoauth2 auth_verbose = yes disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it log_path = /dev/stdout mail_debug = yes mail_location = maildir:/data/imap_store/%n mail_plugins = " quota" namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Greeting { auto = create } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = no special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-oauth2.plain.conf.ext driver = oauth2 mechanisms = plain login } plugin { push_lua_url = http://localhost:5678/mailnotify push_notification_driver = lua:file=/notify.lua quota = maildir:User quota quota_rule = *:storage=5MB quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO } protocols = imap lmtp service doveadm { inet_listener http { port = 80 } } service health-check { executable = script -p health-check.sh inet_listener health-check { port = 5001 } } service lmtp { inet_listener lmtp { address = * port = 24 } process_min_avail = 5 } ssl = no userdb { driver = passwd } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " quota quota notify push_notification push_notification_lua" postmaster_address = postmaster@domainname } protocol lda { mail_plugins = " quota notify push_notification" } protocol imap { imap_metadata = yes mail_plugins = " quota imap_quota quota" }

2 4

Problem with LDAP-query (Active Directory) on filter by memberOf
by Luca Bertoncello 20 Oct '20

20 Oct '20

Hi list! We have a Dovecot 2.3.4 (from Debian 10 repository) that should connect to our AD to authenticate the users. It works, but now we would like to restrict using IMAP to all users in the Group "Funktion - E-Mail-Konto". So I changed the query from: (&(sAMAccountName=%n)(objectClass=user)(homeMDB=*)) to (&(sAMAccountName=%n)(objectClass=user)(homeMDB=*)(memberOf=CN=Funktion - E-Mail-Konto,OU=Funktionen,OU=People,DC=ad,DC=company,DC=org)) The baseDN is DC=ad,DC=company,DC=org With ldapsearch I can get all users and their attributes, but Dovecot fail with this error: Oct 20 15:57:10 mailgw02 dovecot: auth: Error: ldap(testuser,80.187.107.28,<eLf0mhqyLwlQu2sc>): ldap_search(base=dc=ad,dc=company,dc=org filter=(&(samAccountName=testuser)(objectClass=user)(homeMDB=*)(memberOf=CN=Funktion - E-Mail-Konto,OU=Funktionen,OU=People,DC=ad,DC=company,DC=org))) failed: Operations error I didn't found any explanation for this error... Can someone help me? The user used for the connection is the same in Dovecot and ldapsearch. Thanks a lot Luca Bertoncello (lucabert(a)lucabert.de)

1 0

Dovecot docker auto-responder - delegate to external SMTP
by Thomas Pronold 19 Oct '20

19 Oct '20

Hi all, I have dockerized my dovecot setup. Everything works fine besides auto-responder using sieve. Issue is that the my dovecot docker image does NOT come with a SMTP which could be used for outgoing mail. My SMTP setup (postfix) is in another image/container. I want to keep it that way, so that dovecot and postfix have separate images. So basically I have 2 containers running in the same internal network: a) dovecot IP 192.168.10.11 b) postfix IP 192.168.10.22 How do I have to configure dovecot so that it delegates all outgoing (autoresponder) mails to the SMTP on IP 192.168.10.22. The postfix image is configured in a way that certain IPs are allowed to send mails without authentication. So on postfix side I am set. Currently I did a quickfix: I added postfix to dovecot image and configured postfix to use the relayhost 192.168.10.22 for mailing. This works, still I would prefer having the dovecot image not containing an postfix SMTP. Thanks Tom

4 3