- dovecot - dovecot.org

[Dovecot] Ambiguous behavior with prefetch database?
by Axel Luttgens 13 Jul '13

13 Jul '13

Hello, Let's say dovecot.conf contains: mail_uid = dovemailer mail_gid = dovemailer mail_home = /some/path/%n mail_location = mbox:~/mboxes:INBOX=~/mboxes/inbox and that the password database query is of the form: password_query = \ SELECT \ passwd AS password, \ nickname AS user, \ mail_home AS userdb_home, \ mail_location AS userdb_mail, \ WHERE \ ... The database initially comes with NULL for both mail_home and mail_location, the goal being to be able to progressively replace legacy settings. With the above, one gets such entries in the logs upon a pop or imap connection: auth-worker(11262): Debug: auth(u12345678,127.0.0.1): username changed u12345678 -> john.doe auth: Debug: auth(u12345678,127.0.0.1,<dsNsasbgRQB/AAAB>): username changed u12345678 -> john.doe [...] auth: Debug: prefetch(john.doe,127.0.0.1,<dsNsasbgRQB/AAAB>): passdb didn't return userdb entries, trying the next userdb and, of course, the userdb_query fails since it isn't supposed to be invoked under such circumstances. Of course, the userdb_query could be adapted so as to handle pop/imap connections in addition to say, lmtp or doveadm connections, but this would anyway raise the question: why bother with a prefetch database setup? In fact, it seems that the problem comes from the fact that the password_query returns NULL values (i.e. "do not override dovecot.conf settings") for all userdb_xxx settings even if, technically speaking, it returns such columns. A slight yet somewhat silly modification of the password_query, such as this one: password_query = \ SELECT \ passwd AS password, \ nickname AS user, \ 'dovemailer' AS userdb_uid, \ mail_home AS userdb_home, \ mail_location AS userdb_mail, \ WHERE \ ... indeed seems to bring back all the expected behavior: now, the "passdb returns userdb entries" and, for example, the config's mail_home expands to the expected value /some/path/john.doe. Could it be that the case "userdb_xxx columns returned, even if all with NULL values" has been somehow overlooked in the code? Or am I erring with my interpetation of all those matters? TIA, Axel

2 5

[Dovecot] A sqlite-based quota dict
by Axel Luttgens 13 Jul '13

13 Jul '13

Hello, While experimenting with the sqlite backend, I noticed a big vacuum wrt its use for a quota dict. This is thus an opportunity to share a solution I managed to devise after some trials and errors and a (very quick and unscientific) look at the code. And also the opportunity to ask the community to check for possible flaws. Yes, nothing comes for free... ;-) TIA, Axel This is the SQL for creating the database or for adding needed table/trigger to an existing database (with many comments and few "active" lines): CREATE TABLE quota ( -- We will assume that, in the case of a sqlite DB (and probably a pgsql DB -- as well), Dovecot will *always* act along these lines: -- In case of a "row creation": -- INSERT INTO quota (subject, byte_count) -- VALUES (<some id>, <byte count>); -- INSERT INTO quota (subject, message_count) -- VALUES (<some id>, <msg count>); -- In case of a recalculation: -- UPDATE quota -- SET byte_count = byte_count + <byte count diff>, -- message_count = message_count + <msg count diff> -- WHERE subject = <some id>; -- In case of a row deletion: -- DELETE FROM quota -- WHERE subject = <some id>; -- For example, a "doveadm quota recalc" may first delete the relevant row -- if it exists, then (re-)create it. -- Clearly, the "row creation" case is a bit problematic, hence the need for -- a trigger. -- An id for the entity subjected to a quota (a user/mailbox, a domain...). subject TEXT PRIMARY KEY NOT NULL, -- The entity's size, expressed as a storage space use and as a message -- count. -- Note the NULL defaults: they allow to simplify the trigger's logics. byte_count INTEGER DEFAULT NULL, message_count INTEGER DEFAULT NULL ); CREATE TRIGGER quota_insert BEFORE INSERT ON quota FOR EACH ROW BEGIN -- If there's a row to update, that's because the first INSERT of the "row -- creation" has been performed. -- (this UPDATE could probably be simplified if the insertion order, -- byte_count then message_count, was guaranteed; anyway, since the "row -- creation" operation shouldn't be very frequent, we may afford a slight -- inefficiency). UPDATE quota SET byte_count = CASE WHEN NEW.byte_count ISNULL THEN byte_count ELSE NEW.byte_count END, message_count = CASE WHEN NEW.message_count ISNULL THEN message_count ELSE NEW.message_count END WHERE subject = NEW.subject; -- In which case we may ignore that second (current) INSERT, since the -- previously inserted row has just been updated with the value coming -- from the current INSERT statement. SELECT raise(IGNORE) WHERE EXISTS (SELECT * FROM quota WHERE subject = NEW.subject); END; The corresponding dict configuration being thus supposed to be similar to this one: connect = /path/to/database map { pattern = priv/quota/storage table = quota username_field = subject value_field = byte_count } map { pattern = priv/quota/messages table = quota username_field = subject value_field = message_count }

1 0

[Dovecot] Dovecot Virtual Folders... could these be managed by a/the Client?
by Charles Marcus 12 Jul '13

12 Jul '13

Hi all/Timo, I was thinking about Thunderbirds ability to create Virtual folders allowing you to have many different views of your messages... The downside though, is you only see these in Thunderbird. I know that dovecot supports server side virtual folders: http://wiki2.dovecot.org/Plugins/Virtual But I'm wondering about the possibility to manage these from the client side... For example, would it be possible to create an extension in Thunderbird that allowed the user to manage these (create, edit the filters for, delete, rename, etc)? Thanks, -- Best regards, Charles

2 1

[Dovecot] (no subject)
by Gab IIpop 12 Jul '13

12 Jul '13

>From the documentation, virtual users seem like a good idea if you plan on having a lot of users. Although I'm wondering about the following: What other benefits/consequences are there to using virtual over system users and vice versa? Will virtual users have the same protection as system users (system users would use linux permissions, which is pretty secure)? How easy will it be to switch from using system users to virtual users or vice versa?

2 1

[Dovecot] avoid log message when using nagios check
by lluis 12 Jul '13

12 Jul '13

Hello, I'm using a nagios check to monitor dovecot status, since dovecot v2 I see those syslog messages on every nagios check: pop3-login: Aborted login (no auth attempts in 0 secs) imap-login: Aborted login (no auth attempts in 0 secs) I tried to avoid those messages sending a logout string: check_imap -H localhost -e 'OK' -s 'a logout' check_pop -H localhost -e 'OK' -s 'quit' but now I get imap-login: Disconnected (no auth attempts in 0 secs) pop3-login: Disconnected (no auth attempts in 0 secs) what can I do to avoid a log message on every nagios check? thanks! Lluís

6 12

[Dovecot] getting quota error when accessing private namespace
by Andreas Oster 12 Jul '13

12 Jul '13

Hi all, I have run into a problem which I cannot find a solution for. I have created an additional private namespace with the following commands in dovecot.conf : namespace { disabled = no hidden = no ignore_on_failure = no inbox = no list = children location = maildir:/var/vmail/archives/%Ln/Maildir mailbox "archived mails" { auto = subscribe driver = special_use = \Archive } prefix = Archives/ separator = / subscriptions = yes type = private } plugin { quota = maildir:User quota:ns= quota2 = maildir:Archives quota:ns=Archives/ quota2_rule = *:storage=5G quota_rule = *:storage=1G quota_rule2 = Trash:storage=+200M } I can access the new namespace without any problems but every time a folder in this namespace is accessed, I get the following error messages in mail.err log: dovecot: imap(testuser): Error: quota: Unknown namespace: Archives/ dovecot: last message repeated 49 times Quota seems to work, though I have the feeling, that it only will be updated when closing and reopening the mail client, but this can also be a client issue. Quota for the INBOX is either taken from LDAP or, if there is no value defined in LDAP, will be assigned a quota of 1G The Archives/ namespace has a static quota of 5G for every user. Does anyone have idea how to get rid of these error messages ? Thank you for your kind help Andreas

2 5

[Dovecot] Multiple Folders Continually Auto-Created
by Cassidy Larson 12 Jul '13

12 Jul '13

I've had reports of a number of clients running Outlook 2011 on Mac where they have quite a few folders with the same name appended by multiple "1"s. So far I've only narrowed it down to Outlook 2011 on Mac. We've been in the process of migrating to sdbox on a new server from maildir using dsync backup. Example folder structure: INBOX INBOX 1 INBOX 1 1 INBOX 1 1 1 INBOX 1 1 1 1 INBOX 1 1 1 1 1 INBOX 1 1 1 1 1 1 INBOX 1 1 1 1 1 1 1 INBOX 1 1 1 1 1 1 1 1 INBOX 1 1 1 1 1 1 1 1 1 INBOX 1 1 1 1 1 1 1 1 1 1 Junk Junk 1 Junk 1 1 Junk 1 1 1 Junk 1 1 1 1 Junk 1 1 1 1 1 Junk 1 1 1 1 1 1 Junk 1 1 1 1 1 1 1 Junk 1 1 1 1 1 1 1 1 and so on for "Sent Messages", etc. Seems that the the default folders for these clients are getting created over and over again, each time with a new "1" at the end. Anybody else see this? I'm digging for a client I can troubleshoot with and reproduce with me watching. Thanks, -c

2 2

[Dovecot] SSL cert problem
by Peter von Nostrand 12 Jul '13

12 Jul '13

Hi, I'm running a new dovecot 2.0.9 under Centos 6.4. I'm having an issue with SSL certificate not being accepted by the email client. I have my own CA and I have generated certificates for web usage without a problem. For imaps and pop3s what I did was generate a certificate for the hostname of my dovecot server and then cat that cert with the intermediate and root CA certificates. No matter what thunderbird still complains with Unknown identity. # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.2.1.el6.x86_64 x86_64 CentOS release 6.4 (Final) auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %n disable_plaintext_auth = no log_path = /var/log/dovecot.log mail_fsync = never mail_home = /vmail/%u mail_location = maildir:~/Maildir mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl passdb { driver = pam } plugin { quota = maildir:User quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service lmtp { unix_listener lmtp { user = vmail } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = </etc/pki/dovecot/certs/mail.pem ssl_key = </etc/pki/dovecot/private/mail.example.com.key userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_ssl = yes protocol lmtp { mail_fsync = optimized mail_plugins = sieve quota } protocol lda { mail_plugins = sieve quota } protocol imap { mail_plugins = quota imap_quota } protocol pop3 { mail_plugins = quota This is the log: Jul 11 15:38:45 imap-login: Warning: SSL: where=0x10, ret=1: before/accept initialization [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2001, ret=1: before/accept initialization [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2002, ret=-1: SSLv2/v3 read client hello A [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 read client hello A [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 write server hello A [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 write certificate A [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 write key exchange A [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 write server done A [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 flush data [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2002, ret=-1: SSLv3 read client certificate A [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2002, ret=-1: SSLv3 read client certificate A [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 read client key exchange A [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 read finished A [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 write session ticket A [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 write change cipher spec A [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 write finished A [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2001, ret=1: SSLv3 flush data [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x20, ret=1: SSL negotiation finished successfully [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL: where=0x2002, ret=1: SSL negotiation finished successfully [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL alert: where=0x4004, ret=558: fatal certificate unknown [192.168.0.1] Jul 11 15:38:45 imap-login: Warning: SSL alert: where=0x4008, ret=256: warning close notify [192.168.0.1] Jul 11 15:38:45 imap-login: Info: Disconnected (no auth attempts): rip=192.168.0.1, lip=192.168.1.1, TLS: SSL_read() failed: error:14094416:SSL routines:SSL3_READ_BYTES:sslv3 alert certificate unknown: SSL alert number 46 Thx in advance -- Peter

4 3

[Dovecot] dsync/imapc migration question
by Gedalya 12 Jul '13

12 Jul '13

Doing an imapc migration with the pop3 migration plugin, using doveadm backup -R. I occasionally get the following output: dsync(user(a)domain.tld): Error: imapc(mail01.domain.tld:143): Server disconnected unexpectedly dsync(user(a)domain.tld): Error: imapc(mail01.domain.tld:143): Server disconnected unexpectedly dsync(user(a)domain.tld): Error: imapc(mail01.domain.tld:143): Server disconnected unexpectedly dsync(user(a)domain.tld): Warning: I/O leak: 0xb7648650 (line 1229, fd 10) dsync(user(a)domain.tld): Warning: I/O leak: 0xb7648650 (line 1229, fd 11) dsync(user(a)domain.tld): Warning: Timeout leak: 0xb76488b0 (line 1316) dsync(user(a)domain.tld): Warning: Timeout leak: 0xb76488b0 (line 1316) The source server is really crappy, no need to look at the dovecot side for causes. My question is: is it possible that the migration did complete successfully? Dovecot does seem to continue and it's kind of vague on what went wrong, and did it re-try. This operation can take several hours on large mailboxes so this question is really meaningful in my case. (I'd try with -D but it's really hard to reproduce this on demand). Thanks Gedalya

2 3

Re: [Dovecot] SSL cert problem
by Reindl Harald 11 Jul '13

11 Jul '13

Am 11.07.2013 21:51, schrieb Peter von Nostrand: > On Thu, Jul 11, 2013 at 4:23 PM, Reindl Harald > because thunderbird does not trust your own CA by default > without import it there by hand - you can not expect to > cat your CA to the cert for the server and that is enough > to get truested by the client - if so everybody would do > this to make his DNS forgery successful > > Sorry, I should specify that I already have my root CA certificates loaded in thunderbird much more important you should reply this to the list and not off-list, fixed by me, no need to send it again

1 0