June 2012 - dovecot - dovecot.org

Re: [Dovecot] Different but probably related issue
by Johannes Berg 11 Jun '12

11 Jun '12

Hi Marc, [+list since I'm unlikely to be able to solve this problem myself] > I am trying to setup a debian testing (wheeze) mail server using > postfix, dovecot and amavisd-new with spamassassin. I have everything > working fine, using mdbox mailboxes and system users. As a final touch > for this setup, I wanted to be able to train the (global) bayes > database directly through IMAP. > > Hence, I installed your plugin (directly from the official debian > repositories) and set it up to report mails to spamassassin. I am > using the "pipe" backend to call a wrapper script, that stores the > mail into a temporary file and launches sa-learn to learn it. My tests > indicate that this is working properly. Ok, nice. > However, when the dovecot-antispam plugin is enabled, I have a weird > problem sending emails. This is, whenever my MUA tries to save the > just sent message to the "Sent" folder, dovecot shows the following > error: Hmm, ok, let's see > > --------------------------------------------------- > > Dovecot's error log: > > --------------------------------------------------- > > Jun 4 22:35:14 aiur dovecot: imap(user): Error: mdbox /home/user/.mdbox/mailboxes/Sent/dbox-Mails: map uid lost for uid 0 > > Jun 4 22:36:06 aiur dovecot: imap(user): Error: /home/user/.mdbox/mailboxes/Spam/dbox-Mails/dovecot.index reset, view is now inconsistent > > Jun 4 22:36:09 aiur dovecot: imap(user): Error: Log synchronization error at seq=8,offset=27592 for /home/user/.mdbox/storage/dovecot.map.index: Append with UID 56056, but next_uid = 56057 > > Jun 4 22:36:09 aiur dovecot: lda(user): Error: Log synchronization error at seq=8,offset=27592 for /home/user/.mdbox/storage/dovecot.map.index: Append with UID 56056, but next_uid = 56057 > > Jun 4 22:36:10 aiur dovecot: imap(user): Error: /home/user/.mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index reset, view is now inconsistent > > > As a result, the MUA hangs for a while (some minute and a half). After > that it closes the IMAP session properly, but I am left with two > copies of the sent email in the "Sent" folder: one that is marked as > unread and one that is not. Curious. I think the problem is likely the mdbox storage... There have always been some issues with it and the antispam plugin when combined. The first issue was that we couldn't access the raw text or something ... not sure what's up now. > > IMAP Conversation (as logged by roundcube webmail) > > [04-Jun-2012 22:35:14 +0200]: [4A68] C: A0005 APPEND INBOX.Sent (\Seen) {519+} > > [04-Jun-2012 22:35:14 +0200]: [4A68] C: Received: from cpe-76-169-183-245.socal.res.rr.com ([76.169.183.245]) > > by server.domain.tld > > with HTTP (HTTP/1.1 POST); Mon, 04 Jun 2012 22:35:14 +0200 > > MIME-Version: 1.0 ... > > [04-Jun-2012 22:36:10 +0200]: [4A68] S: A0005 OK [APPENDUID > 1338488996 4274] Append completed. That looks ... pretty normal. > At this point, I do not know what else to try or how to fix this > problem. Thus, I have had to disable your plugin for now. Do you have > any ideas on how to proceed? I can give you access to this machine if > need be (it's a personal server). Unfortunately, I don't. I can only suggest, as a test, trying with some other storage format -- I only use Maildir -- to see if the problem is really in the interaction with mdbox. I'm fairly sure that's likely the problem, maybe the plugin doesn't pass something through append that is needed by mdbox, but I've never even attempted to understand mdbox. Maybe Timo can comment. Timo, you can find the latest code here: http://git.sipsolutions.net/?p=dovecot-antispam.git;a=summary johannes

2 1

[Dovecot] Accessing maildir snapshots through dovecot / namespace
by Karl Oulmi 11 Jun '12

11 Jun '12

Hi, I've the following setup : - FreeBSD 9.0 / Dovecot 2.1.7 - Maildir storage over iSCSI (Dell MD3200i) - Virtual users over LDAP to render the storage snapshots available through dovecot (to allow my users to browse their mail history). Here is my conf : namespace { type = private inbox = yes list = yes prefix = INBOX. location = maildir:/home/%u/Maildir:CONTROL=/home/dovecot/control/%u:INDEX=/home/dovecot/indexes/%u } namespace snap { prefix = INBOX.snapshot.h0. hidden = no inbox = no list = yes location = maildir:/da1/%u/Maildir:INDEX=/da1/dovecot/indexes/%u:CONTROL=/da1/dovecot/control/%u type = private } The problem is that I don't see the content of the inbox folder contained in the snapshots whereas subfolders are perfectly viewed ! Inbox cur|new are is /da1/%u/Maildir/ If anyone have a tip, It would be nice... Regards, Karl. -- _______________________________________________________________ Karl OULMI Centre de Ressources Informatiques Institut de Biologie de Lille - CNRS GDS3366 _______________________________________________________________

2 1

[Dovecot] dovecot does not find libpam when compiling with customized prefix
by Roland 11 Jun '12

11 Jun '12

Hello everybody, I try to compile dovecot 2.1.7 with a customized --prefix setting and --with-pam . Although I installed libpam into the same --prefix, dovecot does not find it: checking for pam_start in -lpam... no configure: error: Can't build with PAM support: libpam not found The same or a similar problem seems to have appeared 4 years ago: http://www.dovecot.org/list/dovecot/2008-February/028750.html Which libpam file does dovecot expect in which directory? And possibly there is something wrong with the pam_start function? Thanks in advance, Roland

2 1

[Dovecot] Dovecot over NFS
by James Devine 11 Jun '12

11 Jun '12

I'm playing with running dovecot over NFS and I am running into some issues. I have followed the guide at http://wiki2.dovecot.org/NFS and my setup includes 1 nfs server and 1 client running postfix/dovecot. In testing I am running postal via the command: postal -t 10 -c 10 localhost users399 The test file has a list of 399 users to deliver to. I've provided a sample of the errors I'm receiving and my configuration below, I am running dovecot 2.0.19. Any idea what I might be doing wrong and what I might do to resolve it? My ultimate goal is to setup multiple clients with director so each user is still handled on a single machine, however with a single machine I still seem to be having issues. Here is a sample of some of the errors I'm seeing: Jun 6 15:55:12 test-gluster-client1 dovecot: lmtp(12072, testuser130): Error: mdbox /mnt/testuser130/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:12 test-gluster-client1 dovecot: lmtp(11999, testuser99): Error: Log synchronization error at seq=2,offset=556 for /mnt/testuser99/mdbox/storage/dovecot.map.index: Append with UID 2, but next_uid = 3 Jun 6 15:55:14 test-gluster-client1 dovecot: lmtp(12047, testuser41): Error: mdbox /mnt/testuser41/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:18 test-gluster-client1 dovecot: lmtp(12133, testuser138): Error: Log synchronization error at seq=2,offset=556 for /mnt/testuser138/mdbox/storage/dovecot.map.index: Append with UID 2, but next_uid = 3 Jun 6 15:55:19 test-gluster-client1 dovecot: lmtp(12076, testuser217): Error: mdbox /mnt/testuser217/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:19 test-gluster-client1 dovecot: lmtp(12047, testuser41): Error: mdbox /mnt/testuser41/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:23 test-gluster-client1 dovecot: lmtp(11985, testuser166): Error: mdbox /mnt/testuser166/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:23 test-gluster-client1 dovecot: lmtp(12072, testuser130): Error: Log synchronization error at seq=2,offset=204 for /mnt/testuser130/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: uid_validity updated unexpectedly: 1339019655 -> 1339019656 Jun 6 15:55:23 test-gluster-client1 dovecot: lmtp(11928, testuser130): Error: Log synchronization error at seq=2,offset=204 for /mnt/testuser130/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: uid_validity updated unexpectedly: 1339019655 -> 1339019656 Jun 6 15:55:24 test-gluster-client1 dovecot: lmtp(11954, testuser192): Error: mdbox /mnt/testuser192/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:24 test-gluster-client1 dovecot: lmtp(12130, testuser128): Error: mdbox /mnt/testuser128/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:27 test-gluster-client1 dovecot: lmtp(12076, testuser217): Error: mdbox /mnt/testuser217/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:27 test-gluster-client1 dovecot: lmtp(12211, testuser60): Error: mdbox /mnt/testuser60/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:27 test-gluster-client1 dovecot: lmtp(12112, testuser190): Error: mdbox /mnt/testuser190/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:27 test-gluster-client1 dovecot: lmtp(12047, testuser41): Error: Log synchronization error at seq=2,offset=204 for /mnt/testuser41/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: uid_validity updated unexpectedly: 1339019658 -> 1339019659 Jun 6 15:55:27 test-gluster-client1 dovecot: lmtp(11937, testuser41): Error: Log synchronization error at seq=2,offset=204 for /mnt/testuser41/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: uid_validity updated unexpectedly: 1339019658 -> 1339019659 Jun 6 15:55:28 test-gluster-client1 dovecot: lmtp(11985, testuser166): Error: mdbox /mnt/testuser166/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:30 test-gluster-client1 dovecot: lmtp(12130, testuser128): Error: mdbox /mnt/testuser128/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 My dovecot config is: auth_debug = yes auth_debug_passwords = yes auth_username_format = %Ln auth_verbose = yes base_dir = /var/run/dovecot-service/ disable_plaintext_auth = no instance_name = dovecot-service mail_debug = yes mail_fsync = always mail_location = mdbox:~/mdbox mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota mdbox_rotate_size = 16 M mmap_disable = yes passdb { driver = pam } plugin { quota = dict:User quota::file:%h/mdbox/dovecot-quota } protocols = " imap lmtp pop3" service auth { unix_listener auth-userdb { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { port = 10143 } } service lmtp { inet_listener lmtp { port = 10024 } } service pop3-login { inet_listener pop3 { port = 10110 } } ssl = no ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd }

3 4

[Dovecot] Frequently login problem
by Jitendra Bhaskar 11 Jun '12

11 Jun '12

Hi, I am using dovecot 2.1.3 on centos 5.7. It was working fine but last few days I need to restart or reload dovecot service because at that time users are not able to login. Each time I am getting information from doveco.log is as : Jun 04 11:52:54 auth: Error: BUG: Authentication client gave a PID 17564 of existing connection Jun 04 11:52:54 auth: Error: BUG: Authentication client gave a PID 17566 of existing connection Jun 04 11:52:59 auth: Error: BUG: Authentication client gave a PID 17564 of existing connection -- * Thanks & Regards * *Jitendra Kumar Bhaskar* Cell:- +91 7306311531 +91 8102997821

2 2

[Dovecot] Dovecot antispam plugin bug: got an empty message
by Petr Bravenec 10 Jun '12

10 Jun '12

It is few months ago I requested help with combination dovecot - dovecot- antispam plugin and dspam. Now I got into troubles with a lot of spam delivering to users inbox. Problem described bellow is now better hidden but stil remains: When moving a message from INBOX to Junk, dspam got an empty message. I made a wrapper about dspamc and there is no input on stdio. The dspam was not trained (got an empty message). Looking to source code of dspam and antispam plugin I suspect the dovecot not to sending any content to plugin when moving from inbox to junk. Petr Bravenec Dne Wednesday 25 of January 2012 17:19:18 Tom Hendrikx napsal(a): > On 25-01-12 08:05, Petr Bravenec wrote: > > Few weeks ago I upgraded dovecot from 1.2 to 2.0.16 and antispam plugin > > to 2.0_pre20101222. Since the upgrade I'm not able to move messages to > > my Junk folder. In the maillog I have found this message: > > > > dspam[25060]: empty message (no data received) > > Gentoo has included the antispam plugin from Johannes historically, but > added the fork by Eugene to support upgrades to dovecot 2.0. It is not > really made clear by the gentoo ebuild is that the forked plugin needs a > slightly different config. > > I use the config below with dovecot 2.0.17 and a git checkout for > dovecot-antispam: > > ===8<======== > plugin { > antispam_signature = X-DSPAM-Signature > antispam_signature_missing = move > antispam_spam_pattern_ignorecase = Junk;Junk.* > antispam_trash_pattern_ignorecase = Trash;Deleted Items;Deleted > Messages > > # Backend specific > antispam_backend = dspam > antispam_dspam_binary = /usr/bin/dspamc > antispam_dspam_args = > --user;%u;--deliver=;--source=error;--signature=%%s > antispam_dspam_spam = --class=spam > antispam_dspam_notspam = --class=innocent > #antispam_dspam_result_header = X-DSPAM-Result > } > > > -- > Regards, > Tom

2 1

[Dovecot] director userdb problem
by Костырев Александр Алексеевич 10 Jun '12

10 Jun '12

hello ! I'm trying to get users from dovecot director server: doveadm director map doveadm(root): Error: User listing returned failure doveadm(root): Error: user listing failed user mail server ip expire time <unknown> 192.168.5.101 2012-06-10 21:54:06 in logs I get: Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): mysql(172.5.14.1): Connected to database EXIM Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): Warning: mysql: Query failed, retrying: Table 'EXIM.users' doesn't exist Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): Error: sql: Iterate query failed: Table 'EXIM.users' doesn't exist (using built-in default iterate_query: SELECT username, domain FROM users) in my dovecot.conf I have: userdb { driver = sql args = /etc/dovecot/dovecot-sql.conf } passdb { driver = static args = proxy=y nopassword=y } and in /etc/dovecot/dovecot-sql.conf: user_query = select MBOX_NAME AS user from M_MAILBOX WHERE (MBOX_NAME = '%u'); Do I have to use special table named users ? is it hard-coded?

1 2

[Dovecot] Restoring older messages to new server?
by Voytek Eymont 10 Jun '12

10 Jun '12

I had Dovcot 1.x setup, all was working well (till...) Server got stuffed up and same Dovecot 1.x was rebuilt, put back in service, all's working well. I have recovered data from Maildirs messages from the old server, As some of the inboxes now have new messages, what is correct way to copy older messages from old server to new server ? (There are no duplicates, simply old messages from past server, data is physically on new server) Thanks for pointers, Voytek -- Swyped on my Motrix with K-9 Mail. Please excuse my brevity.

2 2

[Dovecot] Dovecot setup fails w. multiple mail locations (gnus/dovecot/offlineimap)
by Johnny 10 Jun '12

10 Jun '12

Hi, I am trying to setup a Gnus - Dovecot - Offlineimap - Webmail (Gmail / Fastmail) chain and cannot configure the correct behaviour. Any advice to get this working properly would be very appreciated! I have set up Offlineimap to synchronise two mail accounts into separate folders under ~/Maildir. After running Offlineimap, the folders look as below. Maildir/ |-- Gmail | |-- cur | |-- dovecot.index.log | |-- dovecot-uidlist | |-- dovecot-uidvalidity | |-- dovecot-uidvalidity.4fd3b80e | |-- [Gmail].All\ Mail | |-- [Gmail].Drafts | |-- [Gmail].Important | |-- [Gmail].Sent\ Mail | |-- [Gmail].Spam | |-- [Gmail].Starred | |-- [Gmail].Trash | |-- INBOX | |-- new | |-- Personal | |-- Receipts | |-- tmp | |-- Travel | `-- Work `-- Fastmail |-- cur |-- dovecot.index.log |-- dovecot.mailbox.log |-- dovecot-uidlist |-- dovecot-uidvalidity |-- dovecot-uidvalidity.4fd3b75e |-- INBOX |-- INBOX.Drafts |-- INBOX.Sent\ Items `-- INBOX.Trash The Dovecot config is below. (I have set up a blank "MailTest" directory as inbox, believing that this may preserve the two imap directories better for offlineimap synching (not sure if this is correct)). ,---- | mail_location = maildir:~/Maildir:LAYOUT=fs | | namespace inbox { | location = maildir:~/MailTest | inbox = yes | } | | namespace mygmail { | type = private | separator = . | prefix = "mygmail." | location = maildir:%h/Maildir/Gmail/:LAYOUT=fs | inbox = no | hidden = no | list = yes | subscriptions = yes | } | | namespace myfastmail { | type = private | separator = . | prefix = "myfastmail." | location = maildir:%h/Maildir/FASTMAIL/:LAYOUT=fs | inbox = no | hidden = no | list = yes | subscriptions = yes | } `---- Accessing dovecot through gnus with this setup only sees the files in the directories that are not prefixed (e.g. under Fastmail, INBOX is the only seen folder, all INBOX.subfolder are not there). Removing the prefix manually they can be seen again however (e.g. INBOX.subfolder -> subfolder). If I remove LAYOUT=fs in the dovecot config, nothing is seen at all, although the directories look like proper Maildirs! A second issue is that running Offlineimap a second time seems to work ok for gmail, but Fastmail complains that "cannot create directory '.'"? Thanks! -- Johnny Dovecot 2.1.6 Offlineimap 6.5.2.1 Ma Gnus v0.6

1 0

[Dovecot] director: backend health monitoring
by Костырев Александр Алексеевич 10 Jun '12

10 Jun '12

Hello! I am wonder if there are plans to include backend health monitoring feature to Dovecot Director ? Yes, I'm aware of poolmon by Brad Davidson but I think it's kind of must-have feature out of box. thanks

2 1