August 2014 - dovecot

Trying Dovecot Replication with dsync
by Minhas Listas 14 Aug '14

14 Aug '14

Hi, I have a failover cluster for mail server with: Ubuntu12.04 + DRBD (for block replication) + Ext4 filesystem + Dovecot-2.0.19-2 with Mdbox It works fine with ~50k accounts. My cluster design: http://adminlinux.com.br/cluster_design.txt I plan to test Dovecot Replication with dsync to build an active/active cluster with load balancing. Can anyone direct me to some literature? A tutorial for example. I'm installing a cluster (for tests) with Ubuntu 14.04 + Ext4 filesystem (without Drbd) + Dovecot-2.2.9-1ubuntu2.1. My conf is in: http://adminlinux.com.br/replication-doveconf.txt I'm following this doc http://wiki2.dovecot.org/Replication but I'm getting some errors: 1) Aug 14 15:39:34 ceph1 dovecot: imap(account=domaintest.com): Error: open(/var/run/dovecot/replication-notify-fifo) failed: Permission denied What is the correct perms for /var/run/dovecot/replication-notify-fifo ? Currently: # ll /var/run/dovecot/replication-notify-fifo prw------- 1 root root 0 Aug 14 15:57 /var/run/dovecot/replication-notify-fifo| 2) Aug 14 16:02:34 ceph1 dovecot: dsync-server(account=domaintest.com): Error: Couldn't create lock */var/lib/imap/account=domaintest.com <http://domaintest.com>/*.dovecot-sync.lock: No such file or directory Aug 14 16:02:34 ceph1 dovecot: dsync-local(account=domaintest.com): Error: Couldn't create lock */var/lib/imap/account=domaintest.com <http://domaintest.com>/*.dovecot-sync.lock: No such file or directory In my production cluster, it is automatically created by dovecot when the user performs the first login: */var/lib/imap/*<account> for INDEX */var/spool/imap/*<account> for Mdbox Thanks! -- Thiago Henrique

1 0

panic: dsync and imapc
by Alex Ha 14 Aug '14

14 Aug '14

Hi Dovecot list! I try to sync from a remote imap server to my local dovecot server via the dsync tool with imapc. Here is my command: # /usr/local/dovecot/bin/dsync -c /usr/local/dovecot/etc/dovecot/dovecot.conf -D -o imapc_user= test(a)example.com -o imapc_password=pwd backup -R -u test(a)example.com imapc: Here the error message: dsync(test(a)example.com): Panic: file quota-maildir.c: line 827: unreached Please see the attached debug.txt for a full debug messages and stacktrace. System info OS: Ubuntu 14.04 Server 64 Bit Dovecot: 2.2.13 Thanks, Alex

1 0

Quota Help
by user7743 14 Aug '14

14 Aug '14

Hi all, First post here so hopefully I get all the required information correct. I am running a mail server on Debian, its consists of Postfix (2.9.6-2), Dovecot (2.1.7) and MySQL (5.5). Basic stuff is all working find so I decided to try and implement quotas. This is working to an extent but not properly and I am a little lost so looking for some help. In my configuration the default mailbox quota is set to "*:storage=100M". When I create a mailbox with 250M specified in the database, dovecot is applying the default quota rather than that specified in the database. So in the database I have a test user with the following entry password,email,quota_kb [hash], test(a)example.org, 25000 If I turn debugging on for mail and auth I see the following logged when the user logs in (logs pasted at the end in a bid to maintain some readability) If I check the quota with doveadm I get the limit back of 102400 which is the default mailbox size rather than that from the database. doveadm quota get -u test(a)example.org Quota, name, Type, Value, Limit, % User quota, STORAGE, 19139, 102400, 18 User quota, MESSAGE, 567, - I can't quite figure out where I am going wrong in terms of getting the database value to supersede the default value set in 90-quota.conf. I did read one thing in the quota documentation on the dovecot website (http://wiki2.dovecot.org/Quota/Configuration) that I didn't get and this might be where I am going wrong but can't check. It says "Check that dovecot-lda is called with -d parameter." Where would this be configured and where could I check? Below are some other inputs - hopefully they help. ### Debug logs at login Aug 14 14:06:24: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 14 14:06:24: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Aug 14 14:06:24: auth: Debug: auth client connected (pid=8090) Aug 14 14:06:24: auth: Debug: auth client connected (pid=8093) Aug 14 14:06:24: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=2QDLu5UAKAAuBSdf#011lip=99.99.99.99#011rip=55.55.55.55#011lport=993#011rport=50216 Aug 14 14:06:24: auth: Debug: client out: CONT#0111#011 Aug 14 14:06:24: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=ZBnLu5UAKQAuBSdf#011lip=99.99.99.99#011rip=55.55.55.55#011lport=993#011rport=50217 Aug 14 14:06:24: auth: Debug: client out: CONT#0111#011 Aug 14 14:06:24: auth: Debug: client in: CONT<hidden> Aug 14 14:06:24: auth-worker(8095): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 14 14:06:24: auth-worker(8095): Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Aug 14 14:06:24: auth-worker(8095): mysql(127.0.0.1): Connected to database mailserver Aug 14 14:06:24: auth-worker(8095): Debug: sql(test.example.org,55.55.55.55): query: SELECT email as user, password FROM users WHERE email='test.example.org'; Aug 14 14:06:24: auth: Debug: client out: OK#0111#011user=test.example.org Aug 14 14:06:24: auth: Debug: master in: REQUEST#0111720057857#0118090#0111#0114bf45b372441751900d7d967578b0e03 Aug 14 14:06:24: auth-worker(8095): Debug: sql(test.example.org,55.55.55.55): SELECT CONCAT('/var/vmail/',CONCAT(SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1))) AS home, 5000 AS uid, 5000 AS gid, CONCAT('maildir:storage=+',quota_kb) AS quota_rule FROM users WHERE email='test.example.org'; Aug 14 14:06:24: auth: Debug: master out: USER#0111720057857#011test.example.org#011home=/var/vmail/contriveit.com/te… Aug 14 14:06:24: imap-login: Login: user=<test.example.org>, method=PLAIN, rip=55.55.55.55, lip=99.99.99.99, mpid=8097, TLS, session=<2QDLu5UAKAAuBSdf> Aug 14 14:06:24: auth: Debug: client in: CONT<hidden> Aug 14 14:06:24: auth-worker(8095): Debug: sql(test.example.org,55.55.55.55): query: SELECT email as user, password FROM users WHERE email='test.example.org'; Aug 14 14:06:24: auth: Debug: client out: OK#0111#011user=test.example.org Aug 14 14:06:24: imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Aug 14 14:06:24: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Aug 14 14:06:24: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so Aug 14 14:06:24: imap: Debug: Added userdb setting: plugin/quota_rule=maildir:storage=+250000 Aug 14 14:06:24: imap(test.example.org): Debug: Effective uid=5000, gid=5000, home=/var/vmail/contriveit.com/test Aug 14 14:06:24: imap(test.example.org): Debug: Quota root: name=User quota backend=maildir args= Aug 14 14:06:24: imap(test.example.org): Debug: Quota rule: root=User quota mailbox=maildir bytes=+256000000 messages=0 Aug 14 14:06:24: imap(test.example.org): Debug: Quota rule: root=User quota mailbox=Trash bytes=+10485760 messages=0 Aug 14 14:06:24: imap(test.example.org): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/contriveit.com/test/Maildir Aug 14 14:06:24: auth: Debug: master in: REQUEST#011635830273#0118093#0111#011316aed6aaba731b5f79c78d2664a7c99 Aug 14 14:06:24: imap(test.example.org): Debug: maildir++: root=/var/vmail/contriveit.com/test/Maildir, index=, control=, inbox=/var/vmail/contriveit.com/test/Maildir, alt= Aug 14 14:06:24: auth-worker(8095): Debug: sql(test.example.org,55.55.55.55): SELECT CONCAT('/var/vmail/',CONCAT(SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1))) AS home, 5000 AS uid, 5000 AS gid, CONCAT('maildir:storage=+',quota_kb) AS quota_rule FROM users WHERE email='test.example.org'; Aug 14 14:06:24: auth: Debug: master out: USER#011635830273#011test.example.org#011home=/var/vmail/contriveit.com/tes… Aug 14 14:06:24: imap-login: Login: user=<test.example.org>, method=PLAIN, rip=55.55.55.55, lip=99.99.99.99, mpid=8098, TLS, session=<ZBnLu5UAKQAuBSdf> Aug 14 14:06:24: imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Aug 14 14:06:24: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Aug 14 14:06:24: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so Aug 14 14:06:24: imap: Debug: Added userdb setting: plugin/quota_rule=maildir:storage=+250000 Aug 14 14:06:24: imap(test.example.org): Debug: Effective uid=5000, gid=5000, home=/var/vmail/contriveit.com/test Aug 14 14:06:24: imap(test.example.org): Debug: Quota root: name=User quota backend=maildir args= Aug 14 14:06:24: imap(test.example.org): Debug: Quota rule: root=User quota mailbox=maildir bytes=+256000000 messages=0 Aug 14 14:06:24: imap(test.example.org): Debug: Quota rule: root=User quota mailbox=Trash bytes=+10485760 messages=0 Aug 14 14:06:24: imap(test.example.org): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/vmail/contriveit.com/test/Maildir Aug 14 14:06:24: imap(test.example.org): Debug: maildir++: root=/var/vmail/contriveit.com/test/Maildir, index=, control=, inbox=/var/vmail/contriveit.com/test/Maildir, alt= ### doveconf -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab084.17 x86_64 Debian 7.6 simfs auth_debug = yes auth_mechanisms = plain login dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } mail_debug = yes mail_location = maildir:/var/vmail/%d/%n/Maildir mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = create special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = maildir:User quota quota_rule = *:storage=100M quota_rule2 = Trash:storage=+10M sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)example.org protocols = " imap sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl_cert = </etc/dovecot/cert.pem ssl_key = </etc/dovecot/key.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = " quota sieve quota" } protocol imap { mail_max_userip_connections = 15 mail_plugins = " quota imap_quota" } ### /etc/dovecot/dovecot-dict-sql.conf.ext connect = host=127.0.0.1 dbname=db user=user password=password map { pattern = priv/quota/storage table = virtual_users username_field = email value_field = quota_kb } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } } #### /etc/dovecot/dovecot-sql.conf.ext default_pass_scheme = PLAIN-MD5 password_query = SELECT email as user, password FROM users WHERE email='%u'; user_query = SELECT CONCAT('/var/vmail/',CONCAT(SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1))) AS home, 5000 AS uid, 5000 AS gid, CONCAT('maildir:storage=+',quota_kb) AS quota_rule FROM users WHERE email='%u'; Any help appreciated.

2 2

Domain name lost for SASL
by Dominic Wong 13 Aug '14

13 Aug '14

Hi, I'm trying to set up Postfix + Dovecot (2.0.9) + PostfixAdmin on CentoOS (the standard amazon machine image) and am having problems with my SMTP user authentication. Turning on auth debugging I can see the username is losing the first part of the domain so one(a)two.three becomes one.three dovecot: auth: Debug: sql(one.three, ... ): query: SELECT username AS user,password FROM mailbox WHERE username = 'one.three' AND active='1' I don't know if it's postfix or dovecot which is trimming the username, any tips on what causes this would be greatly appreciated. Thanks

1 0

Test / can you see my mail??
by Michael Ludwig 12 Aug '14

12 Aug '14

Hi! I have to excuse my behave and I am really sorry. Yesterday I wrote two mails to this list and they never showed up in the online archives where I checked it. So that's the reason for this testmail. I hope this mail is readable to all of you? Cheers, Michael

6 5

Defer email via LMTP when there is 'no space left on device' instead of rejecting it
by Christian Rohmann 12 Aug '14

12 Aug '14

Hello dovecot-users, (This problem was being discussed a little in this thread from 2011: http://www.dovecot.org/list/dovecot/2011-May/059009.html) I noticed (using LMTP) that Dovecot handles 'no space left on device' just like an 'over-quota', if I read this part of method "static int client_deliver(struct client *client, const struct mail_recipient *rcpt, struct mail *src_mail, struct mail_deliver_session *session)" "lmtp/commands.c" correctly: --- cut --- [...] else if (storage != NULL) { error = mail_storage_get_last_error(storage, &mail_error); if (mail_error == MAIL_ERROR_NOSPACE) { client_send_line(client, "%s <%s> %s", dctx.set->quota_full_tempfail ? "452 4.2.2" : "552 5.2.2", rcpt->address, error); } else { client_send_line(client, "451 4.2.0 <%s> %s", rcpt->address, error); } ret = -1; [...] --- /cut --- In consequence this means the configuration option quota_full_tempfail is applied in both cases. But to me there is a major difference between a full disk (a.k.a "admin fucked up") and over-quota (a.k.a. "user has simply too much stuff in his mailbox"). So I would like to be able tell Dovecot to reject messages due to full mailboxes, but simply defer those that cannot be stored due to a full disk (which I am to blame for). To me this should result in two separate configuration options for the two problem root-causes: quota_full_tempfail storage_full_tempfail Or did I simply miss or completely misunderstood anything here? Regards Christian

10 18

doveadm pw with SHA512-CRYPT won't roundtrip
by Jon Hulatt 12 Aug '14

12 Aug '14

Hi, Not sure if this is a PBKAC or not:- root@ds3:/usr/share/postfixadmin# doveadm pw -s SHA512-CRYPT -p password {SHA512-CRYPT}$6$aUgGXP0UshkMj7hY$9JV4yMRsjIe/98CzmglYrMjf.9NJ.FXzxcLE9B0v3doCRUWo2wRncc6hg6VCs0DCUHQbeC/bRDZdGCge/nB/h/ root@ds3:/usr/share/postfixadmin# doveadm pw -t {SHA512-CRYPT}$6$aUgGXP0UshkMj7hY$9JV4yMRsjIe/98CzmglYrMjf.9NJ.FXzxcLE9B0v3doCRUWo2wRncc6hg6VCs0DCUHQbeC/bRDZdGCge/nB/h/ -p password doveadm(root): Fatal: reverse password verification check failed: Password mismatch root@ds3:/usr/share/postfixadmin# dovecot --version 2.2.9 It works ok with other schemes that i’ve tried (e.g. SSHA-512). Is this a bug, or my mistake? thanks Jon

4 3

Frequent error: unknown namespace Trash
by Michael Ludwig 12 Aug '14

12 Aug '14

Hello to all of you! ;-) My first post on this list. I frequently get this error in dovecot.log every time a user logs in and out: ============================= imap(mailaddress): Error: quota: Unknown namespace: Trash ============================= When I change my conf.d/90-quota.conf from "Trash" to ".Trash" (as this is the imap/maildir folder name, the error stays the same, but with the ".Trash" in dovecot.log This is what my 90-quoato.conf looks like: ============================= plugin { quota_rule = *:storage=2G quota_rule2 = Trash:storage=+100M quota_grace = 10%% } ============================= Where can I start my search, what is going wrong? Just for letting you know: This mailserver is a fresh and clean setup. I am using postfix/dovecotvimbadmin/mysql/spamassassin/clamsmtp. Cheers, Michael

2 1

Sieve: Saving "pristine" messages for backups and spam training
by Jeff Rice 12 Aug '14

12 Aug '14

Hello, I'm trying to work out a way to have my Sieve filter save a "pristine" version of email messages as a backup, primarily to use for training the spam filter. I would like is to have every message saved into a single, site-wide directory (in the global sieve) before being processed additionally and delivered. The messages in that directory will be used to train the spam filter without having to worry about removing Spamassassin headers and so forth. I thought fileinto :copy might do what I wanted, but this creates a backup directory individually for each user. That's unmanageable for the spam training process I use. redirect *could* work, but that adds a header during the process so the email saved would not be "pristine". I'm thinking of using the extprograms plugin to pipe to a program that will do a simple copy. That feels very hackish, however, and I'm hoping there is a more elegant solution. Am I missing something obvious here? Thanks! Jeff

4 4

Re: Throttling pop3-login connections
by Joseph Tam 12 Aug '14

12 Aug '14

Alex <mysqlstudent(a)gmail.com> writes: > Okay, that makes sense, and is in line with what I was also thinking. This > is like 30 concurrent requests, then nothing for a minute or two, then > another 30 concurrent requests. 30 concurrent requests at 1 or 2 minute intervals? This seems weird, as I would expect it to be more or less randomly distributed over that interval. Does this happen at the top of each minute? If what you observe is true, the only situation I can think of that would cause this is a bunch of POP3 fetch clients running as a cron job synchronized to a minute grid (i.e seconds=0). Joseph Tam <jtam.home(a)gmail.com>

1 0