September 2014 - dovecot

Dovecot HA
by Hoggins! 13 Sep '14

13 Sep '14

Hello everyone, Following my previous message about replication (I'm still stuck), I was wondering in a more general way how to achieve high availability with Dovecot, and how to store the mail data. Do you have some thoughts about this ? Maybe one or two links leading to people who already have ideas or experience ? I don't host a big e-mail service, nor have a lot of clients connecting. I just need to ensure that data is always available, from the storage to the actual service. Thanks in advance.

3 2

charset-specific searches, and continuation lines
by Eric Abrahamsen 12 Sep '14

12 Sep '14

Hi there, I'm looking into improving IMAP search support for the Gnus Emacs mail client, and trying to add the ability to search non-ascii characters. So far as I know, I start this invocation with something like: . UID SEARCH CHARSET UTF-8 TEXT {NNN} Where NNN is the number of bytes in my search string. Dovecot then responds with: + OK So... what do I do then? I don't actually know what the next statement is, to provide the actual search string itself. Googling has proved unhelpful, as most of the examples online don't actually show this "+ OK" response. Can someone just briefly outline what's meant to happen next? I've tried including the search string immediately after the byte-size, separated by various combinations of \n\r, but that always gives me a "Missing LF after literal size" error. I'm using the Archlinux dovecot package, which reports version 2.2.13-1. Thanks! Eric

2 6

dovecot imap auth method issue
by nobody73 12 Sep '14

12 Sep '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi List , I run Debian GNU/Linux 7 and i have followed the guide on workaround dot org and at the end of it i have authentications issues with thunderbird .On workaround there is a local test for authentication and it was successfull .Thunderbird says: "the IMAP server doesn't support the selected authentication method ,please change the authetntication method .... " I have tried all of clear, starttls and ssl/tls . dovecot 10-auth.conf is set: disable_plaintext_auth = yes auth_mechanisms = plain login !include auth-sql.conf.ext auth-sql.conf.ex has: passdb { driver = sql args = /etc/dovecot/dovecot-sql.conf.ext } userdb { driver = static args = uid=vmail gid=vmail home=/var/vmail/%d/%n } My dovecot-sql.conf.ext content is: driver = mysql connect = host=127.0.0.1 dbname=maildb user=userdb password=123456789 default_pass_scheme = PLAIN-MD5 password_query = SELECT email as user, password FROM virtual_users WHERE email='%u'; and dovecot -n is: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-686-pae i686 Debian 7.6 ext3 auth_mechanisms = plain login mail_location = maildir:/var/vmail/%d/%n/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = </etc/dovecot/ssl/cert.pem ssl_key = </etc/dovecot/ssl/key.pem userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = static } protocol lda { mail_plugins = " sieve" } All help will be appreciated Regards Gab - -- Key fingerprint = D8E8 7374 49EA 8017 EC52 AD73 0294 F341 FF66 9495 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iF4EAREKAAYFAlQSM7EACgkQApTzQf9mlJXt9AD/SCQX8+LkKRfp2GyDkrGT9dQD SZeQ0E5Mv/OYbyfDO4wA/2vyHGxyUhv3N/N9+8xrVQT2KnfqIS5TrdhqIhfnEIc2 =gvNo -----END PGP SIGNATURE-----

2 1

Problem with virtual folders
by Urban Loesch 11 Sep '14

11 Sep '14

Hi, I'm trying to activate some virtual folders on a new installed dovecot server. My plan is to have two virtual folders like "All" and perhaps "Unseen", like Gmail style for the first step. - All: lists me all messages in the users mailbox - Unseen: all unseen messages in the users mailbox I'm using dovecot EE Release: ii dovecot-ee-core 1:2.2.13.8-1 amd64 secure mail server that supports mbox, maildir, dbox and mdbox mailboxes ii dovecot-ee-imapd 1:2.2.13.8-1 amd64 secure IMAP server that supports mbox, maildir, dbox and mdbox mailboxes ii dovecot-ee-lmtpd 1:2.2.13.8-1 amd64 secure LMTP server for Dovecot ii dovecot-ee-managesieved 0.4.3-1 amd64 secure ManageSieve server for Dovecot ii dovecot-ee-mysql 1:2.2.13.8-1 amd64 MySQL support for Dovecot ii dovecot-ee-sieve 0.4.3-1 amd64 sieve filters support for Dovecot But I can't get it to work. I can see the virtual folders in my Thunderbird, but the folders are empty and can't find any errors in mail log. I also tried it with "mail_debug = yes". Below is my doveconf -n: ... # 2.2.13.8 (71cc347a687c+): /etc/dovecot/dovecot.conf # OS: Linux 3.4.67-vs2.3.3.9-rol-em64t-efigpt x86_64 Debian 7.6 ext4 auth_cache_negative_ttl = 0 auth_cache_ttl = 0 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes deliver_log_format = msgid=%m: %$ %p %w disable_plaintext_auth = no login_trusted_networks = $INTERNAL mail_debug = yes mail_gid = mailstore mail_location = mdbox:/home/vmail/%d/%n:INDEX=/home/dovecotindex/%d/%n mail_log_prefix = "%s(%u pid:%p session:<%{session}>): " mail_plugins = " quota mail_log notify acl zlib stats virtual" mail_shared_explicit_inbox = yes mail_uid = mailstore managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate mdbox_rotate_size = 15 M namespace { list = children location = mdbox:/home/vmail/%%d/%%n:INDEX=/home/dovecotindex/%%d/%%n prefix = [shared]/%%u/ separator = / subscriptions = yes type = shared } namespace { hidden = no inbox = no list = children location = virtual:/home/virtual:INDEX=MEMORY prefix = [virtual]/ separator = / subscriptions = yes type = private } namespace inbox { inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql-account.conf driver = sql } plugin { acl = vfile acl_shared_dict = file:/home/vmail/%d/shared-mailboxes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create append mail_log_fields = uid box msgid size from mail_log_group_events = no quota = dict:Storage used::file:%h/dovecot-quota quota_rule2 = INBOX/Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_max_redirects = 15 stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 32 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours zlib_save = gz zlib_save_level = 9 } protocols = imap lmtp sieve service auth { unix_listener auth-userdb { group = mailstore mode = 0660 user = root } } service imap-login { inet_listener imap { port = 143 } process_limit = 256 process_min_avail = 25 service_count = 1 } service imap { process_limit = 256 process_min_avail = 25 service_count = 1 } service lmtp { inet_listener lmtp { address = * port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service pop3-login { inet_listener pop3 { port = 110 } process_limit = 256 process_min_avail = 25 service_count = 1 } service pop3 { process_limit = 256 process_min_avail = 25 service_count = 1 } service quota-warning { executable = script /usr/local/rol/dovecot/quota-warning.sh unix_listener quota-warning { user = mailstore } user = mailstore } service stats { fifo_listener stats-mail { mode = 0600 user = mailstore } } ssl = no submission_host = localhost:25 userdb { args = /etc/dovecot/dovecot-sql-account.conf driver = sql } protocol lmtp { mail_fsync = optimized mail_plugins = " quota mail_log notify acl zlib stats virtual sieve zlib" } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep imap_id_log = * imap_logout_format = bytes=%i/%o session=<%{session}> mail_max_userip_connections = 40 mail_plugins = " quota mail_log notify acl zlib stats virtual imap_quota imap_acl imap_zlib imap_stats" } protocol pop3 { mail_plugins = " quota mail_log notify acl zlib stats virtual" pop3_logout_format = bytes_sent=%o top=%t/%p, retr=%r/%b, del=%d/%m, size=%s uidl_hash=%u session=<%{session}> } ... The virtual folders are stored in "/home/virtual/XXX" and are containg only the file "dovecot-virtual". Like: "/home/virtual/All/dovecot-virtual": <--------------------- * all ---------------------> Note: I just have active virtual folders on a different dovecot server version "2:2.2.13-1~auto+74". I copied the configuration from this server. The only three differences between the two servers are: - Server version is different. - The prefix of the default namespace on the new server is "prefix = INBOX/" and not "prefix =" - Mail storage and index files are seperated in different folders on the new server. Here are the relveant namespace configuraiton from the server where it ist working fine: ... namespace { list = children location = mdbox:/home/vmail/%%d/%%n prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { hidden = no inbox = no list = children location = virtual:/home/virtual:INDEX=~/virtual prefix = [rolmail]/ separator = / subscriptions = yes type = private } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Items" { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } ... Have you any hint for me how I can fix my problem. Thanks and regards Urban Loesch

1 0

minimal configuration for lucene fts
by Eric Abrahamsen 11 Sep '14

11 Sep '14

Hi, I'm using dovecot (version 2.2.13 on archlinux) in the simplest, no-brainer way possible. It sits between mbsync, which I use to fetch mail from servers, and Gnus, my MUA. Both mbsync and Gnus connect to dovecot with an invocation like this: /usr/lib/dovecot/imap -o mail_location=maildir:$HOME/.mail/ea/ I have three different mail accounts, all that changes is the final directory on the mail_location path above. I haven't touched anything else: there's no running daemon, no configuration, no user database, no PAM, no nothing. Now I'm trying to set up text searching via lucene, but all the examples I've seen online assume a full running daemon and user accounts. I tried to fake it by running: doveadm index -u eric@localhost -q INBOX -o mail_location-maildir:/home/eric/.mail/ea but it was clearly expecting a user database. Is there any way to create text indexes for my three different accounts, in their respective directories, without fully setting up a running dovecot? I'll do that if I have to, but my current setup works great, and is very simple, and I'd like to keep it simple if I can. Thanks! Eric

1 1

Dovecot can't read mail, creates duplicate directories
by John Oliver 11 Sep '14

11 Sep '14

CentOS 6.5, dovecot 2.0.9-7 I used http://www.linuxmail.info/postfix-dovecot-ldap-centos-5/ to configure LDAP authentication for postfix and dovecot. I can log in to dovecot via IMAP, but it cannot read messages. It does wind up creating alternate directories though: [joliver@localhost ~]$ sudo ls -l /var/vmail/ total 8 drwx------. 3 vmail vmail 4096 Sep 10 15:00 testuser1 drwx------. 3 vmail vmail 4096 Sep 10 14:59 testUser1 [joliver@localhost ~]$ sudo ls -l /var/vmail/testuser1/ total 4 drwx------. 3 vmail vmail 4096 Sep 10 15:00 mail [joliver@localhost ~]$ sudo ls -l /var/vmail/testuser1/mail/ total 0 [joliver@localhost ~]$ sudo ls -l /var/vmail/testUser1/ total 4 drwx------. 5 vmail vmail 4096 Sep 10 14:59 Maildir [joliver@localhost ~]$ sudo ls -l /var/vmail/testUser1/Maildir/ total 12 drwx------. 2 vmail vmail 4096 Sep 10 14:59 cur drwx------. 2 vmail vmail 4096 Sep 10 15:01 new drwx------. 2 vmail vmail 4096 Sep 10 15:01 tmp [joliver@localhost ~]$ sudo ls -l /var/vmail/testUser1/Maildir/new/ total 8 -rw-------. 1 vmail vmail 444 Sep 10 15:25 1410387938.Vfd02I1e89M2893.localhost.localdomain -rw-------. 1 vmail vmail 453 Sep 10 15:26 1410387970.Vfd02I1e8cM685475.localhost.localdomain [joliver@localhost ~]$ telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot ready. a1 LOGIN testuser1 password a1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in a2 EXAMINE INBOX * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS ()] Read-only mailbox. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1410388142] UIDs valid * OK [UIDNEXT 1] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest a2 OK [READ-ONLY] Select completed. [joliver@localhost ~]$ cat /etc/dovecot/conf.d/auth-ldap.conf.ext auth_username_format = %Lu passdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext } userdb { driver = static args = uid=504 gid=505 home=/var/vmail/%u } [joliver@localhost ~]$ grep vmail /etc/passwd vmail:x:504:505:Vmail:/var/vmail:/sbin/nologon -- *********************************************************************** * John Oliver http://www.john-oliver.net/ * * * ***********************************************************************

2 1

Re: Configure Dovecot Master User
by Joseph Tam 11 Sep '14

11 Sep '14

On Wed, 10 Sep 2014, Clovis Tristao writes: > userdb { > args = allow_all_users=yes master_user=%u > driver = static > } > ... > > I still can not authenticate with the master user, any suggestions or tips? Just a wild-ass guess, but shouldn't "master_user=%u" be something like "master_user=muser" where "muser" is the master user as defined in your master password file? Joseph Tam <jtam.home(a)gmail.com>

1 0

dovecot imap auth method issue
by nobody73 11 Sep '14

11 Sep '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi List , I run Debian GNU/Linux 7 and i have followed the guide on workaround dot org and at the end of it i have authentications issues with thunderbird .On workaround there is a local test for authentication and it was successfull .Thunderbird says: "the IMAP server doesn't support the selected authentication method ,please change the authetntication method .... " I have tried all of clear, starttls and ssl/tls . dovecot 10-auth.conf is set: > disable_plaintext_auth = yes auth_mechanisms = plain login !include > auth-sql.conf.ext auth-sql.conf.ex has: > passdb { driver = sql > > # Path for SQL configuration file, see > example-config/dovecot-sql.conf.ext args = > /etc/dovecot/dovecot-sql.conf.ext } > userdb { driver = static args = uid=vmail gid=vmail > home=/var/vmail/%d/%n } My dovecot-sql.conf.ext content is: > driver = mysql connect = host=127.0.0.1 dbname=maildb user=userdb > password=123456789 default_pass_scheme = PLAIN-MD5 password_query > = SELECT email as user, password FROM virtual_users WHERE > email='%u'; and dovecot -n says: > # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-686-pae i686 > Debian 7.6 ext3 auth_mechanisms = plain login mail_location = > maildir:/var/vmail/%d/%n/Maildir managesieve_notify_capability = > mailto managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave namespace inbox { inbox = yes > location = mailbox Drafts { special_use = \Drafts } mailbox Junk { > special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox > "Sent Messages" { special_use = \Sent } mailbox Trash { special_use > = \Trash } prefix = separator = } passdb { args = > /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = > ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap sieve > pop3" service auth { unix_listener /var/spool/postfix/private/auth > { group = postfix mode = 0660 user = postfix } } service imap-login > { inet_listener imap { port = 143 } inet_listener imaps { port = > 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = > 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = > </etc/dovecot/ssl/cert.pem ssl_key = </etc/dovecot/ssl/key.pem > userdb { args = uid=vmail gid=vmail home=/var/vmail/%d/%n driver = > static } protocol lda { mail_plugins = " sieve" } All help will be appreciated Regards Gab - -- Key fingerprint = D8E8 7374 49EA 8017 EC52 AD73 0294 F341 FF66 9495 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iF4EAREKAAYFAlQQ0xgACgkQApTzQf9mlJV/9AD9GI4J7CJ3bBgpDutdK9Zert/z 9PsbpN/BJQ0fB8APuBIA/RFD5s5D5aCR4QUnXLzG/e25Jb/4HwxJ+X4QZdm5Yr/Y =NPMR -----END PGP SIGNATURE-----

1 0

outlook 2013
by Bob Miller 10 Sep '14

10 Sep '14

I am trying really hard to wrap my head around why people insist on using this program... Where I have outlook 2013 users, I have had nothing but problems getting their mail to work with imap. my solution has been to set them up with pop, which works just like it always has. Or move them to a different program. recently, I have a customer who requires multiple machines, all using outlook 2013, to access the same email address, so pretty much have to use imap. if I set up just one of the machines with imap, it works more less as expected, with hiccups such as mail taking an hour or two or more to show up. But shortly after I connect a 2nd machine to the same account, one or both machines start to go wonky. Symptoms include deleted items returning, read messages becoming unread again, and duplicates being constantly created and deleted. The last I can confirm by watching in webmail and refreshing the inbox every few seconds; as mail shows up and deletes in outlook, so it does in webmail too. On my test machine connected to the same server, I have evolution, outlook and thunderbird all connecting to one account with no problems. Well, outlook hiccups, but it's not unusable. And I have other users on the system that share email accounts across a variety of other clients and platforms, including older versions of outlook. I have tried checking message rules, there are none; removing all folder subscriptions; running scanpst, which finds errors even before the account finishes syncing and ever time I run it after that; I have looked for viruses/malware; I have confirmed there is no forwarding or some trickery happening on the server; chkdsk and similar hardware checks all come up clean, the computers are only a couple of months old; I have got certs set up with SANs and the CA installed such that outlook does not error on the certificate; and I have tried just about every combination of settings that seem relevant. The one thing that does seem to work, at least for a few minutes or an hour or two, is deleting and recreating the accounts on one of the computers. But the problem inevitably returns in short order. Surely people have outlook 2013 connecting via imap to dovecot without problems; is there some special trick that google is hiding from me? -- Computerisms Bob Miller 867-334-7117 / 867-633-3760 http://computerisms.ca

6 9

Dovecot replication
by Hoggins! 10 Sep '14

10 Sep '14

Hello list, I'm trying to achieve very simple replication, but I'm not sure if I'm starting the good way. I have two Dovecot servers that use the same GlusterFS storage. Of course, the indexes get corrupted eventually, even if I apply an "NFS-like" configuration. So I'd like to synchronize my two servers with each other. I'm trying to follow this page : http://wiki2.dovecot.org/Replication, but I have to admit that it's not really self-explanatory. I got several errors, so I decided to start fresh, and that is why I'm not giving you any configuration, but I prefer asking if I have the prerequisites. The page states that my userdb should have "user listing", and that you can check it by issuing `doveadm user '*'`. But I don't know what it's supposed to produce, apart from my userlist (my userdb is the system passwd file). As my servers are located on the same private LAN, I decided I would not go with the SSH replication solution, but with the simple mutual TCP connection... Maybe this is a wrong start. Any help will be appreciated. Thanks in advance !

1 0