September 2014 - dovecot

My Dsync isn't replicating 'EXPUNGE' IMAP command
by Listas＠Adminlinux 16 Sep '14

16 Sep '14

Hi! I have two Dovecot-2.2.13 servers with Dsync Replication: server1 and server2. When I execute 'EXPUNGE' on server1 side, the messages with FLAG \Deleted are expunged only on server1. The message is still present in Server2. Could someone give me a hint reason for this ? Thanks in advance! -- Thiago Henrique ====================================================================== How I reproduce: == ON SERVER1 == Client: $ telnet <IP server1> 143 Trying <IP server1>... Connected to <IP server1>. Escape character is '^]'. Server: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] MAILBOX1 IMAP/POP3 server Client: AUTH LOGIN <user> <pass> Server: AUTH OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE QUOTA] Logged in Client: A002 SELECT "INBOX" Server: * FLAGS (\Answered \Flagged \Deleted \Seen \Draft nonjunk) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft nonjunk \*)] Flags permitted. * 2 EXISTS * 0 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1410284221] UIDs valid * OK [UIDNEXT 16] Predicted next UID * OK [HIGHESTMODSEQ 56] Highest A002 OK [READ-WRITE] Select completed (0.000 secs). Client: A003 FETCH 1:* (UID FLAGS) Server: * 1 FETCH (UID 13 FLAGS (nonjunk)) * 2 FETCH (UID 15 FLAGS (nonjunk)) A003 OK Fetch completed. Client: A005 STORE 1 +FLAGS \Deleted Server: * 1 FETCH (FLAGS (\Deleted nonjunk)) A005 OK Store completed. Client: A003 FETCH 1:* (UID FLAGS) Server: * 1 FETCH (UID 13 FLAGS (\Deleted nonjunk)) * 2 FETCH (UID 15 FLAGS (nonjunk)) A003 OK Fetch completed. Client: A006 EXPUNGE Server: * 1 EXPUNGE A006 OK Expunge completed. Client: A007 FETCH 1:* (UID FLAGS) Server: * 1 FETCH (UID 15 FLAGS (nonjunk)) A007 OK Fetch completed. Client: A008 LOGOUT Server: * BYE Logging out A008 OK Logout completed. Connection closed by foreign host. == ON SERVER2 == Client: $ telnet <IP server2> 143 Trying <IP server2>... Connected to <IP server2>. Escape character is '^]'. Server: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] MAILBOX2 IMAP/POP3 server Client: AUTH LOGIN <user> <pass> Server: AUTH OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE QUOTA] Logged in Client: A002 SELECT "INBOX" Server: * FLAGS (\Answered \Flagged \Deleted \Seen \Draft nonjunk) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft nonjunk \*)] Flags permitted. * 2 EXISTS * 0 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1410284221] UIDs valid * OK [UIDNEXT 17] Predicted next UID * OK [HIGHESTMODSEQ 61] Highest A002 OK [READ-WRITE] Select completed (0.000 secs). Client: A003 FETCH 1:* (UID FLAGS) Server: * 1 FETCH (UID 13 FLAGS (\Deleted nonjunk)) * 2 FETCH (UID 15 FLAGS (nonjunk)) A003 OK Fetch completed. Client: A008 LOGOUT Server: * BYE Logging out A008 OK Logout completed. Connection closed by foreign host. = My settings = * My settins age identical on both server1 and server2, except by 'listen', 'address' and 'mail_replica' directives. # doveconf -n # 2.2.13 (6bb26098a45c): /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-30-generic x86_64 Ubuntu 14.04.1 LTS auth_master_user_separator = * auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@= auth_worker_max_count = 1 disable_plaintext_auth = no doveadm_password = secret doveadm_port = 12345 listen = server1 log_path = /var/log/dovecot.log login_greeting = MAILBOX1 IMAP/POP3 server mail_fsync = never mail_gid = dovemail mail_plugins = " notify replication quota" mail_uid = dovemail passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } plugin { mail_replica = tcp:server2:12345 quota = dict:User quota::file:/var/lib/imap/%n/dovecot-quota quota_rule = *:storage=1GB } protocols = imap pop3 lmtp service aggregator { fifo_listener replication-notify-fifo { user = dovemail } unix_listener replication-notify { user = dovemail } } service auth-worker { user = $default_internal_user } service auth { client_limit = 1024 process_limit = 1 process_min_avail = 1 } service doveadm { inet_listener { port = 12345 } } service imap { process_limit = 1024 process_min_avail = 1 } service lmtp { inet_listener { address = server1 port = 24 } process_limit = 256 process_min_avail = 1 } service pop3-login { inet_listener pop3 { address = server1 port = 110 } } service pop3 { process_limit = 256 process_min_avail = 1 } service replicator { process_min_avail = 1 } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = tb-extra-mailbox-sep imap_idle_notify_interval = 2 mins imap_max_line_length = 64 k mail_max_userip_connections = 50 mail_plugins = " notify replication quota imap_quota" } protocol lmtp { mail_fsync = optimized mail_plugins = " notify replication sieve quota" } protocol pop3 { mail_plugins = " notify replication quota" }

3 3

Clear a single user mapping in Director setup
by Murray Trainer 15 Sep '14

15 Sep '14

Hi All, We are using Dovecot director setup. Is there a command to clear a single user's mapping to a backend mailstore? This would be useful on occasions. I couldn't find any command to do it. Thanks Murray

2 1

Case sensitivity
by John Oliver 15 Sep '14

15 Sep '14

I think I've answered my last question by changing mail_location But I'm still getting duplicate mailboxes: [joliver@localhost ~]$ sudo ls -l /var/vmail/ total 8 drwx------. 3 vmail vmail 4096 Sep 11 10:30 testuser1 drwx------. 3 vmail vmail 4096 Sep 11 10:36 testUser1 The cn for my user is 'testUser1', and that's where postfix writes mail. But dovecot wants to use 'testuser1', even if I log in as 'testUser1' I suppose one answer may be to try to get postfix to always use lower-case, but in case that can't happen, how can I get dovecot to ignore case when looking for mailboxes? -- *********************************************************************** * John Oliver http://www.john-oliver.net/ * * * ***********************************************************************

2 1

Configure Dovecot Master User
by Clovis Tristao 15 Sep '14

15 Sep '14

Hi, Does anyone have any idea or hint how to configure dovecot master user? I'm already on it for almost fifteen days and can not find a solution. I appreciate any help, Clovis -- Clovis Tristao - UNICAMP/Faculdade de Engenharia Agricola Administrador de Redes - Secao de Informatica (SINFO) E-mail: clovis(a)feagri.unicamp.br http://www.feagri.unicamp.br MSN: clovis_tristao33(a)hotmail.com Fone: 55(19) 35211031-35211038-35211047-91173116

5 10

dovecot and gmail backup
by David Mehler 15 Sep '14

15 Sep '14

Hello, I'm trying to use my server running dovecot to receive via imap a backup of my gmail account, messages. I'm getting an error from imap.gmail.com that it does support plain authentication but that it failed to download messages. If anyone has this working please let me know what you had to do. Thanks. Dave.

1 0

Per-folder (per-mailbox) message expiration with control from client side — is it possible?
by Lev Serebryakov 15 Sep '14

15 Sep '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 I'm migrating from «old skool» solution with one mail client (MUA) on one computer, which retrieves mail via POP3, sorts it and manages it locally to installation when there are several MUAs on different devices, accessing mail via IMAP4, and all sorting and management should be server-side. Sorting is “easy”: sieve. Here are some nuisance (like, if I want to rename folder/mailbox I need to edit script manually. BTW, it looks like that such thing could be done automagically, as language is very simple and find all references to mailboxes is not too hard task), but it works. But is here good solution for expiration? I have abut 50 folders (mailboxes) and rules are very different for them. They are mostly time-based (like "last 30 days"), but some folders are count-limited ("last 2000 messages") and some folders should have time limit but non-read messages could not be deleted at all. Ok, Thunderbird almost could do it (it doesn't have “don't remove unread messages” option), but I don't want to have any meaningful configuration in MUAs, as each of it could be non-active for long time. Only thing I could find about expiration in dovecot documentation is "doveadm expunge" and helper "Expire" plugin, but it looks like very low-level solution for admins, it could not be managed from client side without direct ssh access to server and it is, in general, very inconvenient. Is here any better solution, maybe, 3rd party one? - -- // Black Lion AKA Lev Serebryakov -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQJ8BAEBCgBmBQJUFf2BXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRGOTZEMUNBMEI1RjQzMThCNjc0QjMzMEFF QUIwM0M1OEJGREM0NzhGAAoJEOqwPFi/3EePphIQAJUlYIFgXWBcWcrejcbOFgYf op+g35YF4wfwboPkgb/mKk46V3lcjmQImcHir2fci0SCsSSfARcU1a8y4iaeSkPU l949PaMYD8stfukfCbXjoY5pD5FIpj1Os7dDtgdoygp0tfsA4mDg1O0exZoduR9s q4NNPlsnlKOjX2KMOdcWI2AR8/xiFi4zvDTB/vibQPMy8kXVB8ld4Mk0BF1TUyOv 80KKOKzFDxQeLzvoEiNm6FDAqYGEYmpECUaFGXyKG1a7wslhEmEeShJUH5lsj3Oz niMxoO/KTEW0U9QucHQogFJzrcsKkJiOByjqQovWKgZziJll38lCN0O1murMmRBC bDLmN9t53JC7Ef88AbKsaFeULy/AxriohdGU6ePb8j/4W9KlERSJyvgxFkcMxHTg 9mSPiYAHaPr+Ycrzs9SOqhki5b6tI8Q39W/etRorb2us9FS1JE7ib4XLk5ufiUje XOLc4TACUh1qnd/5UUgcIuUrg/akSJgJLZoXg36LqUF/1OeMJHec4RMJresvewAZ RwseWHH/KpD7KxOWlO2Zw1ceHlVFDLWOO/4KWoy/XwZ66fQxEAkLO8ZVyeKMh5Nh dYL+yLQKZdgNWAjalK4lFmwz3u/9jNITwtP5GYLbYnP28EcbDfiN/w9oKGOI8fsD ulD+ca3vx29qdmGGYcKt =9+bG -----END PGP SIGNATURE-----

2 3

sieve: is it possible to filter ALL mailing lists (with header List-Id) to their folders with ONE rule?
by Lev Serebryakov 15 Sep '14

15 Sep '14

Hello, Dovecot. Is it possible to write one rule in sieve, which will: (1) Trigger on any message with "List-Id" header AND (2) Put this message to folder with name build from content of "List-Id" header, in such way, that message with List-Id List-Id: This is decription of list <list-name.host.org> will be put into folder "org.host.list-name" where "." is namespace separator (so, such folders will be shown as hierarchy in mail client)? I don't want to write ~50 rules by hands and add new ones from time to time. I'm speaking about dovecot/pigeonhole sieve implementation, of course. All examples on net shows only manual one-rule-per-list approach :( -- // Black Lion AKA Lev Serebryakov <lev(a)serebryakov.spb.ru>

5 5

usenet/imap
by Edwardo Garcia 15 Sep '14

15 Sep '14

Halo, Has anyones had experiences with feeding usenet into imap folders, we like to have some group for all user, any problem with message limit? We only want the text newsgroups?

5 11

Migration - Getting it right the first time.
by Dan Carroll 15 Sep '14

15 Sep '14

Hello All, I’m currently in the process of migrating a very old imap installation to a new server. I think I have everything in place now but I’ve not yet written the procedure on how to do it. The outline will be as follows: put MTA-OLD into store mode where it holds the incoming emails for an indefinite period. Copy all IMAP data across to the new server. Process the IMAP data, converting it from courier to dovecot. put MTA-OLD into forward mode, sending all mail to MTA-NEW Adjust MX records accordingly so MTA-OLD is no longer used. The “process” part is where I need to take some care. I am aware of the migration tool available for moving the data, but I’m not confidant that my courier databases are in a healthy state. Does anyone have any idea how I can verify that this is the case? I’m happy to do it either before, or after the migration to dovecot, but I’d probably prefer to do it beforehand on the old server. The biggest thing I am concerned about is losing the order of mail messages. It’s not always enough to trust the “received date” for sorting mail, I’d rather my imap clients trust the imap server to send them the correct order. A second question. Is there a possibility to make the MTA switch, and migrate the messages across in an orderly fashion at a later date? Again, I’d like to ensure that older migrated messages appear further down the “order” than new messages coming into the MTA. Lastly, thanks for an awesome piece of software. My limited experience so far has been refreshing! -Dan

1 0

Does pigeonhole regex extension support PCRE?
by Lev Serebryakov 13 Sep '14

13 Sep '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 I've tried to use negative look-ahead in :regex match like this: if header :regex "List-Id" "<svn-([^-]+)-(?!all)([^.]+)\.freebsd\.org>" { ... } and manage-sieve server complains on save about such regex with diagnostic "repetition operator operand invalid" :( - -- Black Lion AKA Lev Serebryakov -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQJ8BAEBCgBmBQJUFDOlXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRGOTZEMUNBMEI1RjQzMThCNjc0QjMzMEFF QUIwM0M1OEJGREM0NzhGAAoJEOqwPFi/3EePzeMP/20iuXilZwM7aZYbMy66J/xK xLldS1PDRSKbeMQKB+Qedw0nyO65/89Uk9UVjoIga+2xh7nURoeCkvFgEu5kss2q Nxeo9rURPrP8pYrNvhv6yi00NaJiQ5qEJ29V8a3vOnHcvB/lOoOTUDWRkNbA48Tm zFC1svaiy5dUPnfZ9YdMvSdFLRVU20ej34R+avodT1Rv+E2TpFOIiNRc69v1lUFD cv05PYfLpE1/k5boZTrGFs0g1Cy/PmC12KxOtvODnQ7S9iGkfbii2bOpI9vTsxky B4diYBms38vxBKMCG8ItkQn2r1TH3VOw1H2hqLt71IhI0Ix78+yTYu3F6zD3nkys KG2VRvbO9AZLvFRHkb3P6xn70OYUvQYoU3UUVZPmbe4eL2tEu7Hg0sxwdKPxi0am i6sf1nMdk/SPd/FNGZapS+hgC+Ik3rQSq+1x38SX4V0IeJ522apTxtJoewRyt4fM D5s+Rsha/oXNHkto55qNlbE2Dn/e/QXrL2Yc+cx9aWpHIz6Iv2iijnqrdgajHpvB E1Iq9+EPnKrkJKtzy/g26Kxlllaahefz/EV5rF27aWrBZGGNwnokIox5Ucrj6Ta1 Huic//Fz6pixSc9jx4WzvO+4b5mECPj8AgEKmfZ/4C04EXbn+v56vjHxx1fwn1gU SU0wiNU2/zfRUeToaUPc =x/yT -----END PGP SIGNATURE-----

2 1