- dovecot - dovecot.org

Doveadm backup doesn't interpret placeholders
by James Pharaoh 23 Jan '17

23 Jan '17

Hi, Dovecot version: 2.2.27 I'm using replication between two servers for high availability, but I also want to backup all users. I have a setting for the replication to work like this: plugin { mail_replica = tcp:other-dovecot } This is fine, but then I also want to do a backup to a different directory for all users, since I am having trouble with an apparent bug running dovecot on btrfs. For this reason, I am storing my emails on ext4, but want to sync them to the BTRFS filesystem I use for my server before doing a snapshot. My mails are stored in /var/mail/mailboxes, and the backup is in /var/mail/mailboxes-backup, the former being the ext4 mount and the latter being part of the btrfs filesystem which belongs to the container where all this runs. The problem is that dovecot seems to only have a single concept of the mail backup location, which is either a remote, as above, or a filesystem location. The logical answer seems to be to provide the backup location when performing the local copy for a snapshot, so I run: doveadm backup -A mdbox:/var/mail/mailboxes-backup/%d/accounts/%u However, this is not picking up the %d and %u placeholders and replacing them with the values, as it would if configured with the option above. The only workaround I can find is to run doveadm backup individually for every user, with the full expanded path for each one. Am I missing something, or would it make sense for doveadm backup to simply recognise and respect these placeholders when passed on the command line? I've tried all sorts of other things, including -o mail_replica, and putting stuff in the userdb, but I can't find any other way to do this. Thanks in advance, James

2 3

Mailbox alias plugin and INBOX. folders
by James White 23 Jan '17

23 Jan '17

Hi, I'm trying to workaround the lack of IMAP folder mapping settings on Windows 10 Mobile in regards to controlling the Sent, Trash etc folder my device uses. Currently, my device creates its own "Sent Items" folder "Deleted Items" folder along with others, this is pain when using clients like Thunderbird which places such them in the correct places, because it can be configured this way. While this is a Microsoft issue, its looking very unlikely they will add IMAP mapping control, as its been like this since Windows Phone 7. So I was looking for performing a workaround at the server level. I came across the Dovecot Mailbox alias plugin, which sounds like a decent workaround, to at least allow sent email messages from my Windows 10 mobile device to show up in the right place, I'm aware of the potential for double cache etc, but I have enough storage for it. http://wiki2.dovecot.org/Plugins/MailboxAlias What I'm having difficulty with, is expressing the mailbox_alias to an existing INBOX. folder. My email server uses the INBOX prefix setup, so my configured folders are: INBOX\INBOX.Sent INBOX\INBOX.Drafts INBOX\INBOX.Trash INBOX\INBOX.Spam Most examples seem to indicate doing at the root folder level i.e. Sent Items -> Sent not Sent Items -> INBOX\INBOX.Sent. Is it possible to use the alias plugin in this way? If so how would I express this using mailbox_alias_old, I tried INBOX/Sent, but this seems to send all items to a blackhole, as they can no longer be found in any folder. It does appear to work at the root folder level, but as my setup is using the older INBOX prefix, I don't want to do that. Any hints/tips would be appreciated! Thanks, James

2 2

Segfault on LIST Command
by Thorsten Hater 23 Jan '17

23 Jan '17

Dear all, I experience SegFaults in the imap binary on a LIST "" "" command, as sent by Claws mail. Using LIST "" "INBOX" or similar is fine. Here is an example telnet session $ telnet 127.0.0.1 143 Trying 127.0.0.1... Connected to 127.0.0.1. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. 01 LOGIN **** **** 01 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SPECIAL-USE QUOTA] Logged in 02 LIST "" "" Connection closed by foreign host. In the log file dovecot[8375]: imap(***): Fatal: master: service(imap): child 15803 killed with signal 11 (core dumps disabled) Please find the config below. Best regards, Thorsten $ doveconf -n # 2.2.26.0 (23d1de6): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (1dc4c73) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.6 auth_debug = yes auth_debug_passwords = yes auth_socket_path = /var/run/dovecot/auth-userdb auth_verbose = yes base_dir = /var/run/dovecot/ default_internal_user = pop first_valid_uid = 48 import_environment = TZ DEBUG=1 last_valid_uid = 48 login_trusted_networks = **** mail_debug = yes mail_gid = pop mail_plugins = " mail_log notify zlib quota" mail_uid = pop managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes list = children location = mailbox Drafts { auto = no special_use = \Drafts } mailbox Sent { auto = no special_use = \Sent } mailbox Trash { auto = no autoexpunge = 30 days special_use = \Trash } mailbox drafts { auto = no special_use = \Drafts } mailbox sent { auto = no special_use = \Sent } mailbox spamverdacht { auto = no autoexpunge = 30 days special_use = \Junk } mailbox trash { auto = no autoexpunge = 30 days special_use = \Trash } mailbox virenverdacht { auto = no autoexpunge = 30 days special_use = \Junk } prefix = INBOX. separator = . subscriptions = yes type = private } passdb { args = nopassword=y driver = static } plugin { last_login_dict = file:~/lastlogin mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = maildir:User quota quota_warning = storage=80%% 80 %u %{userdb:quota_bytes} quota_warning2 = storage=90%% 90 %u %{userdb:quota_bytes} quota_warning3 = storage=95%% 95 %u %{userdb:quota_bytes} sieve = ldap:/etc/dovecot/pigeonhole-ldap.conf sieve_dir = ~/sieve sieve_plugins = sieve_storage_ldap zlib_save = gz zlib_save_level = 6 } service imap { executable = imap postlogin } service pop3 { executable = pop3 postlogin } service postlogin { executable = script-login -d rawlog } service quota-warning { executable = script /bin/quota-warning.sh } ssl = no userdb { args = /etc/dovecot/userdb-ldap.conf driver = ldap result_failure = return-fail result_internalfail = return-fail result_success = continue-ok } userdb { default_fields = quota_bytes=42M driver = bdb_quota override_fields = quota_rule=*:bytes=%{userdb:quota_bytes} result_failure = return-fail result_internalfail = return-fail result_success = continue-ok } verbose_proctitle = yes protocol lda { auth_socket_path = /var/run/dovecot/auth-userdb mail_plugin_dir = /lib/dovecot/modules mail_plugins = " mail_log notify zlib quota sieve" } protocol imap { mail_plugins = " mail_log notify zlib quota imap_xauth last_login imap_quota" } protocol pop3 { mail_plugins = " mail_log notify zlib quota last_login" }

2 2

mail-trends+Dovecot
by Odhiambo Washington 22 Jan '17

22 Jan '17

Hi, Out of curiosity, has anyone managed to use mail-trends[0] to analyse their e-mails. I thought about trying it out, but got stuck midstream. The mail-trends scripts work very well with gmail, but because they say it is supposed to work with _any_ IMAP server, I thought I could get it running with Dovecot too. I know this is NOT a mail-trends support group though, but I believe there is something minor that I am missing, which Dovecot admins could figure out. My idea was to see what comes out of my e-mails stored either in Maildir or mdbox. In my test env, I have mail_location = maildir:/var/spool/virtual/%d/%n/Maildir:INDEX=MEMORY I am testing with a virtual account, whose e-mails are in Maildir/ - some 30,000 mails. The gotcha is that I cannot figure out exactly what to specify in mail.py (for mail-trends [0]) for this situation. There is another modified version of mail-trends[1] which is supposed to be a lot easier than the original one, but this too doesn't seem to work in my setup: 1. My doveconf output -> http://bit.ly/2k11iKb 2. Accounts are virtual, so I have a user - johndoe(a)dom.ain who MUST login as johndoe(a)dom.ain with a password. 3. His mailbox is in /var/spool/virtual/dom.ain/johndoe/Maildir/ So I try this - using the mail-trends code from [1] root@gw:/scripts/mail-trends # ./main.py --server=localhost --username=johndoe(a)dom.ain --password=1234 --use_ssl [2017-01-21 22:24:08,552] Initializing {'username': 'johndoe(a)dom.ain', 'use_ssl': '', 'password': '1234', 'server': 'localhost'} [2017-01-21 22:24:08,552] Connecting [2017-01-21 22:24:08,747] Logging in [2017-01-21 22:24:08,752] Getting mailboxes *[2017-01-21 22:24:08,753] Found INBOX.spam *<-- Where it is getting this from beats me! *[2017-01-21 22:24:08,753] Found INBOX* Traceback (most recent call last): File "./main.py", line 304, in <module> message_infos = GetMessageInfos(opts) File "./main.py", line 104, in GetMessageInfos for mailbox in m.GetMailboxes(): File "/scripts/mail-trends/mail.py", line 61, in GetMailboxes mailboxes.remove('[Gmail]') ValueError: list.remove(x): x not in list root@gw:/scripts/mail-trends # root@gw:/scripts/mail-trends # *ls -al /var/spool/virtual/dom.ain/johndoe/Maildir/* total 3256 drwx------ 5 mailnull mailnull 512 Jan 22 00:04 . drwx------ 3 mailnull mailnull 512 Jan 21 18:48 .. drwx------ 2 mailnull mailnull 1084416 Jan 22 00:04 cur -rw------- 1 mailnull mailnull 1074769 Jan 21 18:52 dovecot-uidlist -rw------- 1 mailnull mailnull 8 Jan 21 18:32 dovecot-uidvalidity -r--r--r-- 1 mailnull mailnull 0 Jan 21 18:32 dovecot-uidvalidity.58837ef3 drwx------ 2 mailnull mailnull 1084416 Jan 21 18:47 new -rw-r--r-- 1 mailnull mailnull 0 Jan 21 18:30 subscriptions drwx------ 2 mailnull mailnull 512 Jan 21 17:44 tmp If anyone is able to hack this with Dovecot, please share the details. [0] http://code.google.com/p/mail-trends/ [1] https://github.com/jpbarraca/mail-trends -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft."

2 2

Relative home path not allowed - but how is this relative?
by Roger Klorese 22 Jan '17

22 Jan '17

I just set up my server with MySQL support for authentication/authorization compatible with Postfix Admin. Initially, I was getting the "Relative home directory paths not supported" message, and it's easy to see why - Postfix Admin stores the maildir as "$domain/$userpart@$domain". But the directories in 10-mail.conf are set as mail_location = maildir:/home/mailboxes/%d/%u mail_home = maildir:/home/mailboxes/%d/%u ...and the user_query has been revised to: user_query = SELECT concat('/home/mailboxes/', maildir) as full_maildir FROM mailbox WHERE username = '%u'; ...so how are any of these relative paths?

1 1

Re: Mailbox problem on centos O/S after some "fiddling"
by Joseph Tam 21 Jan '17

21 Jan '17

> I do not understand why dovecot creates this folder as we ONLY ever use pop3 > (currently with plain text auth but going to secure when this sorted) > for mail and also why when it writes the blank folder it "owns" it with the > user accessing it (also the /var/mail/new folder takes the same owner) I think maybe those mailboxes were created because you've mapped all user home directories to the same folder (/var/mail), and thus, the first user to log in created files that subsequent users could not access. > mail_location = mbox:/var/mail/:INBOX=/var/mail/%u See this for the POP3 scenario you want: http://wiki.dovecot.org/MailLocation/mbox (Section: Only /var/mail mboxes) Don't need these > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } Joseph Tam <jtam.home(a)gmail.com>

1 0

Deleting a mailbox recursively
by Malte Schmidt 20 Jan '17

20 Jan '17

This topic was already discussed on this mailinglist: https://www.dovecot.org/list/dovecot/2011-November/079491.html I am also looking for a nice and convenient way of recursively deleting a mailbox which uses the mdbox-Format. Since then - was there any progress?

3 4

Replication between three servers
by James Pharaoh 19 Jan '17

19 Jan '17

Hi, Dovecot version: 2.2.27 I'm a little unsure if I have set up my replication correctly, and also how to set up replication on three servers, if this is possible. My replication works, with exactly the same configuration on both servers, except that the mail_replica contains the other server name in each case, of course. This seems to work fine. As I understand it, both need to be set up as a client and a server, since I have mail arriving on both. Is this a correct and supported configuration? I believe then I should be able to get three-way replication working, by pointing the three servers at each other in a circle. I am hoping this will cause a mail arriving at server 1 to be sent to server 2, which will then send it to server 3. Server 3 will attempt to send it back to server 1 which will already have it, and so this will terminate the loop. This is obviously going to create a bit of extra load, but I don't want to try it without some advice, and I'm not sure if the replication will be triggered properly by an email which is itself arriving via replication. Reading the description of the components, I think it should, since the aggregator service shouldn't care how an email has arrived, since it is simply reading the log, right? If a server fails, or needs to be taken out manually, I'll obviously need to reconfigure the loop, essentially taking it back to a standard two-server configuration. Similarly, I should be able to add a fourth server, and so on, if I wanted. I'm planning to distribute incoming emails over all servers, so that these will arrive and be stored on a working server during an outage without any reconfiguration, and to use something like nginx as a proxy to send each user to a specific server, to distribute the client load. Thanks in advance, James

1 0

Remove empty milder folders
by ＠lbutlr 18 Jan '17

18 Jan '17

Not sure if anyone will find this useful, but this is how I deleted a bunch (several hundred) of empty mail folders from a user account: # doveadm mailbox status -u “user(a)example.com" messages "*" ALL | grep "=0" | awk -F= '{print $1}' | awk '{print "rm -rf ."$1}' > list then I looked over list just to be sure it wasn’t mucked up and in the users root maildir: # sh < list and done. I probably could do some research on how to combine those two awk pipes but this worked, and it was fast. -- Apple broke AppleScripting signatures in Mail.app, so no random signatures.

2 2

Dynamic autoexpunge for IMAP folders
by Thorsten Hater 18 Jan '17

18 Jan '17

Dear all, is there a way to allow users to set up something like autoexpunge on an individual IMAP folder basis? The idea I implemented does not seem to work, namely returning namespace/inbox/mailbox/Bla/autoexpunge=6h from a userdb, which results in Debug: Unknown userdb setting: plugin/namespace/inbox/mailbox/Bla/autoexpunge=6h >From older questions on the mailing list I gather that the mailbox Bla needs to be set up in the config before I can override its fields. If there is a way around this, I would gladly use this. Another solution that comes to mind would be to use a table-driven cron job, but I would prefer the cleanup to be triggered at delivering and/or moving mail. Best regards, Thorsten

3 8