September 2014 - dovecot

Migration - Getting it right the first time.
by Dan Carroll 15 Sep '14

15 Sep '14

Hello All, I’m currently in the process of migrating a very old imap installation to a new server. I think I have everything in place now but I’ve not yet written the procedure on how to do it. The outline will be as follows: put MTA-OLD into store mode where it holds the incoming emails for an indefinite period. Copy all IMAP data across to the new server. Process the IMAP data, converting it from courier to dovecot. put MTA-OLD into forward mode, sending all mail to MTA-NEW Adjust MX records accordingly so MTA-OLD is no longer used. The “process” part is where I need to take some care. I am aware of the migration tool available for moving the data, but I’m not confidant that my courier databases are in a healthy state. Does anyone have any idea how I can verify that this is the case? I’m happy to do it either before, or after the migration to dovecot, but I’d probably prefer to do it beforehand on the old server. The biggest thing I am concerned about is losing the order of mail messages. It’s not always enough to trust the “received date” for sorting mail, I’d rather my imap clients trust the imap server to send them the correct order. A second question. Is there a possibility to make the MTA switch, and migrate the messages across in an orderly fashion at a later date? Again, I’d like to ensure that older migrated messages appear further down the “order” than new messages coming into the MTA. Lastly, thanks for an awesome piece of software. My limited experience so far has been refreshing! -Dan

1 0

Does pigeonhole regex extension support PCRE?
by Lev Serebryakov 13 Sep '14

13 Sep '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 I've tried to use negative look-ahead in :regex match like this: if header :regex "List-Id" "<svn-([^-]+)-(?!all)([^.]+)\.freebsd\.org>" { ... } and manage-sieve server complains on save about such regex with diagnostic "repetition operator operand invalid" :( - -- Black Lion AKA Lev Serebryakov -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQJ8BAEBCgBmBQJUFDOlXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRGOTZEMUNBMEI1RjQzMThCNjc0QjMzMEFF QUIwM0M1OEJGREM0NzhGAAoJEOqwPFi/3EePzeMP/20iuXilZwM7aZYbMy66J/xK xLldS1PDRSKbeMQKB+Qedw0nyO65/89Uk9UVjoIga+2xh7nURoeCkvFgEu5kss2q Nxeo9rURPrP8pYrNvhv6yi00NaJiQ5qEJ29V8a3vOnHcvB/lOoOTUDWRkNbA48Tm zFC1svaiy5dUPnfZ9YdMvSdFLRVU20ej34R+avodT1Rv+E2TpFOIiNRc69v1lUFD cv05PYfLpE1/k5boZTrGFs0g1Cy/PmC12KxOtvODnQ7S9iGkfbii2bOpI9vTsxky B4diYBms38vxBKMCG8ItkQn2r1TH3VOw1H2hqLt71IhI0Ix78+yTYu3F6zD3nkys KG2VRvbO9AZLvFRHkb3P6xn70OYUvQYoU3UUVZPmbe4eL2tEu7Hg0sxwdKPxi0am i6sf1nMdk/SPd/FNGZapS+hgC+Ik3rQSq+1x38SX4V0IeJ522apTxtJoewRyt4fM D5s+Rsha/oXNHkto55qNlbE2Dn/e/QXrL2Yc+cx9aWpHIz6Iv2iijnqrdgajHpvB E1Iq9+EPnKrkJKtzy/g26Kxlllaahefz/EV5rF27aWrBZGGNwnokIox5Ucrj6Ta1 Huic//Fz6pixSc9jx4WzvO+4b5mECPj8AgEKmfZ/4C04EXbn+v56vjHxx1fwn1gU SU0wiNU2/zfRUeToaUPc =x/yT -----END PGP SIGNATURE-----

2 1

Dovecot HA
by Hoggins! 13 Sep '14

13 Sep '14

Hello everyone, Following my previous message about replication (I'm still stuck), I was wondering in a more general way how to achieve high availability with Dovecot, and how to store the mail data. Do you have some thoughts about this ? Maybe one or two links leading to people who already have ideas or experience ? I don't host a big e-mail service, nor have a lot of clients connecting. I just need to ensure that data is always available, from the storage to the actual service. Thanks in advance.

3 2

charset-specific searches, and continuation lines
by Eric Abrahamsen 12 Sep '14

12 Sep '14

Hi there, I'm looking into improving IMAP search support for the Gnus Emacs mail client, and trying to add the ability to search non-ascii characters. So far as I know, I start this invocation with something like: . UID SEARCH CHARSET UTF-8 TEXT {NNN} Where NNN is the number of bytes in my search string. Dovecot then responds with: + OK So... what do I do then? I don't actually know what the next statement is, to provide the actual search string itself. Googling has proved unhelpful, as most of the examples online don't actually show this "+ OK" response. Can someone just briefly outline what's meant to happen next? I've tried including the search string immediately after the byte-size, separated by various combinations of \n\r, but that always gives me a "Missing LF after literal size" error. I'm using the Archlinux dovecot package, which reports version 2.2.13-1. Thanks! Eric

2 6

dovecot imap auth method issue
by nobody73 12 Sep '14

12 Sep '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi List , I run Debian GNU/Linux 7 and i have followed the guide on workaround dot org and at the end of it i have authentications issues with thunderbird .On workaround there is a local test for authentication and it was successfull .Thunderbird says: "the IMAP server doesn't support the selected authentication method ,please change the authetntication method .... " I have tried all of clear, starttls and ssl/tls . dovecot 10-auth.conf is set: disable_plaintext_auth = yes auth_mechanisms = plain login !include auth-sql.conf.ext auth-sql.conf.ex has: passdb { driver = sql args = /etc/dovecot/dovecot-sql.conf.ext } userdb { driver = static args = uid=vmail gid=vmail home=/var/vmail/%d/%n } My dovecot-sql.conf.ext content is: driver = mysql connect = host=127.0.0.1 dbname=maildb user=userdb password=123456789 default_pass_scheme = PLAIN-MD5 password_query = SELECT email as user, password FROM virtual_users WHERE email='%u'; and dovecot -n is: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-686-pae i686 Debian 7.6 ext3 auth_mechanisms = plain login mail_location = maildir:/var/vmail/%d/%n/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = </etc/dovecot/ssl/cert.pem ssl_key = </etc/dovecot/ssl/key.pem userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = static } protocol lda { mail_plugins = " sieve" } All help will be appreciated Regards Gab - -- Key fingerprint = D8E8 7374 49EA 8017 EC52 AD73 0294 F341 FF66 9495 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iF4EAREKAAYFAlQSM7EACgkQApTzQf9mlJXt9AD/SCQX8+LkKRfp2GyDkrGT9dQD SZeQ0E5Mv/OYbyfDO4wA/2vyHGxyUhv3N/N9+8xrVQT2KnfqIS5TrdhqIhfnEIc2 =gvNo -----END PGP SIGNATURE-----

2 1

Problem with virtual folders
by Urban Loesch 11 Sep '14

11 Sep '14

Hi, I'm trying to activate some virtual folders on a new installed dovecot server. My plan is to have two virtual folders like "All" and perhaps "Unseen", like Gmail style for the first step. - All: lists me all messages in the users mailbox - Unseen: all unseen messages in the users mailbox I'm using dovecot EE Release: ii dovecot-ee-core 1:2.2.13.8-1 amd64 secure mail server that supports mbox, maildir, dbox and mdbox mailboxes ii dovecot-ee-imapd 1:2.2.13.8-1 amd64 secure IMAP server that supports mbox, maildir, dbox and mdbox mailboxes ii dovecot-ee-lmtpd 1:2.2.13.8-1 amd64 secure LMTP server for Dovecot ii dovecot-ee-managesieved 0.4.3-1 amd64 secure ManageSieve server for Dovecot ii dovecot-ee-mysql 1:2.2.13.8-1 amd64 MySQL support for Dovecot ii dovecot-ee-sieve 0.4.3-1 amd64 sieve filters support for Dovecot But I can't get it to work. I can see the virtual folders in my Thunderbird, but the folders are empty and can't find any errors in mail log. I also tried it with "mail_debug = yes". Below is my doveconf -n: ... # 2.2.13.8 (71cc347a687c+): /etc/dovecot/dovecot.conf # OS: Linux 3.4.67-vs2.3.3.9-rol-em64t-efigpt x86_64 Debian 7.6 ext4 auth_cache_negative_ttl = 0 auth_cache_ttl = 0 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes deliver_log_format = msgid=%m: %$ %p %w disable_plaintext_auth = no login_trusted_networks = $INTERNAL mail_debug = yes mail_gid = mailstore mail_location = mdbox:/home/vmail/%d/%n:INDEX=/home/dovecotindex/%d/%n mail_log_prefix = "%s(%u pid:%p session:<%{session}>): " mail_plugins = " quota mail_log notify acl zlib stats virtual" mail_shared_explicit_inbox = yes mail_uid = mailstore managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate mdbox_rotate_size = 15 M namespace { list = children location = mdbox:/home/vmail/%%d/%%n:INDEX=/home/dovecotindex/%%d/%%n prefix = [shared]/%%u/ separator = / subscriptions = yes type = shared } namespace { hidden = no inbox = no list = children location = virtual:/home/virtual:INDEX=MEMORY prefix = [virtual]/ separator = / subscriptions = yes type = private } namespace inbox { inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql-account.conf driver = sql } plugin { acl = vfile acl_shared_dict = file:/home/vmail/%d/shared-mailboxes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create append mail_log_fields = uid box msgid size from mail_log_group_events = no quota = dict:Storage used::file:%h/dovecot-quota quota_rule2 = INBOX/Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_max_redirects = 15 stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 32 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours zlib_save = gz zlib_save_level = 9 } protocols = imap lmtp sieve service auth { unix_listener auth-userdb { group = mailstore mode = 0660 user = root } } service imap-login { inet_listener imap { port = 143 } process_limit = 256 process_min_avail = 25 service_count = 1 } service imap { process_limit = 256 process_min_avail = 25 service_count = 1 } service lmtp { inet_listener lmtp { address = * port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 110 } process_limit = 256 process_min_avail = 25 service_count = 1 } service pop3 { process_limit = 256 process_min_avail = 25 service_count = 1 } service quota-warning { executable = script /usr/local/rol/dovecot/quota-warning.sh unix_listener quota-warning { user = mailstore } user = mailstore } service stats { fifo_listener stats-mail { mode = 0600 user = mailstore } } ssl = no submission_host = localhost:25 userdb { args = /etc/dovecot/dovecot-sql-account.conf driver = sql } protocol lmtp { mail_fsync = optimized mail_plugins = " quota mail_log notify acl zlib stats virtual sieve zlib" } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep imap_id_log = * imap_logout_format = bytes=%i/%o session=<%{session}> mail_max_userip_connections = 40 mail_plugins = " quota mail_log notify acl zlib stats virtual imap_quota imap_acl imap_zlib imap_stats" } protocol pop3 { mail_plugins = " quota mail_log notify acl zlib stats virtual" pop3_logout_format = bytes_sent=%o top=%t/%p, retr=%r/%b, del=%d/%m, size=%s uidl_hash=%u session=<%{session}> } ... The virtual folders are stored in "/home/virtual/XXX" and are containg only the file "dovecot-virtual". Like: "/home/virtual/All/dovecot-virtual": <--------------------- * all ---------------------> Note: I just have active virtual folders on a different dovecot server version "2:2.2.13-1~auto+74". I copied the configuration from this server. The only three differences between the two servers are: - Server version is different. - The prefix of the default namespace on the new server is "prefix = INBOX/" and not "prefix =" - Mail storage and index files are seperated in different folders on the new server. Here are the relveant namespace configuraiton from the server where it ist working fine: ... namespace { list = children location = mdbox:/home/vmail/%%d/%%n prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { hidden = no inbox = no list = children location = virtual:/home/virtual:INDEX=~/virtual prefix = [rolmail]/ separator = / subscriptions = yes type = private } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Items" { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } ... Have you any hint for me how I can fix my problem. Thanks and regards Urban Loesch

1 0

minimal configuration for lucene fts
by Eric Abrahamsen 11 Sep '14

11 Sep '14

Hi, I'm using dovecot (version 2.2.13 on archlinux) in the simplest, no-brainer way possible. It sits between mbsync, which I use to fetch mail from servers, and Gnus, my MUA. Both mbsync and Gnus connect to dovecot with an invocation like this: /usr/lib/dovecot/imap -o mail_location=maildir:$HOME/.mail/ea/ I have three different mail accounts, all that changes is the final directory on the mail_location path above. I haven't touched anything else: there's no running daemon, no configuration, no user database, no PAM, no nothing. Now I'm trying to set up text searching via lucene, but all the examples I've seen online assume a full running daemon and user accounts. I tried to fake it by running: doveadm index -u eric@localhost -q INBOX -o mail_location-maildir:/home/eric/.mail/ea but it was clearly expecting a user database. Is there any way to create text indexes for my three different accounts, in their respective directories, without fully setting up a running dovecot? I'll do that if I have to, but my current setup works great, and is very simple, and I'd like to keep it simple if I can. Thanks! Eric

1 1

Dovecot can't read mail, creates duplicate directories
by John Oliver 11 Sep '14

11 Sep '14

CentOS 6.5, dovecot 2.0.9-7 I used http://www.linuxmail.info/postfix-dovecot-ldap-centos-5/ to configure LDAP authentication for postfix and dovecot. I can log in to dovecot via IMAP, but it cannot read messages. It does wind up creating alternate directories though: [joliver@localhost ~]$ sudo ls -l /var/vmail/ total 8 drwx------. 3 vmail vmail 4096 Sep 10 15:00 testuser1 drwx------. 3 vmail vmail 4096 Sep 10 14:59 testUser1 [joliver@localhost ~]$ sudo ls -l /var/vmail/testuser1/ total 4 drwx------. 3 vmail vmail 4096 Sep 10 15:00 mail [joliver@localhost ~]$ sudo ls -l /var/vmail/testuser1/mail/ total 0 [joliver@localhost ~]$ sudo ls -l /var/vmail/testUser1/ total 4 drwx------. 5 vmail vmail 4096 Sep 10 14:59 Maildir [joliver@localhost ~]$ sudo ls -l /var/vmail/testUser1/Maildir/ total 12 drwx------. 2 vmail vmail 4096 Sep 10 14:59 cur drwx------. 2 vmail vmail 4096 Sep 10 15:01 new drwx------. 2 vmail vmail 4096 Sep 10 15:01 tmp [joliver@localhost ~]$ sudo ls -l /var/vmail/testUser1/Maildir/new/ total 8 -rw-------. 1 vmail vmail 444 Sep 10 15:25 1410387938.Vfd02I1e89M2893.localhost.localdomain -rw-------. 1 vmail vmail 453 Sep 10 15:26 1410387970.Vfd02I1e8cM685475.localhost.localdomain [joliver@localhost ~]$ telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot ready. a1 LOGIN testuser1 password a1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in a2 EXAMINE INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS ()] Read-only mailbox. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1410388142] UIDs valid * OK [UIDNEXT 1] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest a2 OK [READ-ONLY] Select completed. [joliver@localhost ~]$ cat /etc/dovecot/conf.d/auth-ldap.conf.ext auth_username_format = %Lu passdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = static args = uid=504 gid=505 home=/var/vmail/%u } [joliver@localhost ~]$ grep vmail /etc/passwd vmail:x:504:505:Vmail:/var/vmail:/sbin/nologon -- *********************************************************************** * John Oliver http://www.john-oliver.net/ * * * ***********************************************************************

2 1

Re: Configure Dovecot Master User
by Joseph Tam 11 Sep '14

11 Sep '14

On Wed, 10 Sep 2014, Clovis Tristao writes: > userdb { > args = allow_all_users=yes master_user=%u > driver = static > } > ... > > I still can not authenticate with the master user, any suggestions or tips? Just a wild-ass guess, but shouldn't "master_user=%u" be something like "master_user=muser" where "muser" is the master user as defined in your master password file? Joseph Tam <jtam.home(a)gmail.com>

1 0

dovecot imap auth method issue
by nobody73 11 Sep '14

11 Sep '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi List , I run Debian GNU/Linux 7 and i have followed the guide on workaround dot org and at the end of it i have authentications issues with thunderbird .On workaround there is a local test for authentication and it was successfull .Thunderbird says: "the IMAP server doesn't support the selected authentication method ,please change the authetntication method .... " I have tried all of clear, starttls and ssl/tls . dovecot 10-auth.conf is set: > disable_plaintext_auth = yes auth_mechanisms = plain login !include > auth-sql.conf.ext auth-sql.conf.ex has: > passdb { driver = sql > > # Path for SQL configuration file, see > example-config/dovecot-sql.conf.ext args = > /etc/dovecot/dovecot-sql.conf.ext } > userdb { driver = static args = uid=vmail gid=vmail > home=/var/vmail/%d/%n } My dovecot-sql.conf.ext content is: > driver = mysql connect = host=127.0.0.1 dbname=maildb user=userdb > password=123456789 default_pass_scheme = PLAIN-MD5 password_query > = SELECT email as user, password FROM virtual_users WHERE > email='%u'; and dovecot -n says: > # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-686-pae i686 > Debian 7.6 ext3 auth_mechanisms = plain login mail_location = > maildir:/var/vmail/%d/%n/Maildir managesieve_notify_capability = > mailto managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave namespace inbox { inbox = yes > location = mailbox Drafts { special_use = \Drafts } mailbox Junk { > special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox > "Sent Messages" { special_use = \Sent } mailbox Trash { special_use > = \Trash } prefix = separator = } passdb { args = > /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = > ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap sieve > pop3" service auth { unix_listener /var/spool/postfix/private/auth > { group = postfix mode = 0660 user = postfix } } service imap-login > { inet_listener imap { port = 143 } inet_listener imaps { port = > 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = > 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = > </etc/dovecot/ssl/cert.pem ssl_key = </etc/dovecot/ssl/key.pem > userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = > static } protocol lda { mail_plugins = " sieve" } All help will be appreciated Regards Gab - -- Key fingerprint = D8E8 7374 49EA 8017 EC52 AD73 0294 F341 FF66 9495 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iF4EAREKAAYFAlQQ0xgACgkQApTzQf9mlJV/9AD9GI4J7CJ3bBgpDutdK9Zert/z 9PsbpN/BJQ0fB8APuBIA/RFD5s5D5aCR4QUnXLzG/e25Jb/4HwxJ+X4QZdm5Yr/Y =NPMR -----END PGP SIGNATURE-----

1 0