- dovecot - dovecot.org

[Dovecot] Dovecot over NFS
by James Devine 11 Jun '12

11 Jun '12

I'm playing with running dovecot over NFS and I am running into some issues. I have followed the guide at http://wiki2.dovecot.org/NFS and my setup includes 1 nfs server and 1 client running postfix/dovecot. In testing I am running postal via the command: postal -t 10 -c 10 localhost users399 The test file has a list of 399 users to deliver to. I've provided a sample of the errors I'm receiving and my configuration below, I am running dovecot 2.0.19. Any idea what I might be doing wrong and what I might do to resolve it? My ultimate goal is to setup multiple clients with director so each user is still handled on a single machine, however with a single machine I still seem to be having issues. Here is a sample of some of the errors I'm seeing: Jun 6 15:55:12 test-gluster-client1 dovecot: lmtp(12072, testuser130): Error: mdbox /mnt/testuser130/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:12 test-gluster-client1 dovecot: lmtp(11999, testuser99): Error: Log synchronization error at seq=2,offset=556 for /mnt/testuser99/mdbox/storage/dovecot.map.index: Append with UID 2, but next_uid = 3 Jun 6 15:55:14 test-gluster-client1 dovecot: lmtp(12047, testuser41): Error: mdbox /mnt/testuser41/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:18 test-gluster-client1 dovecot: lmtp(12133, testuser138): Error: Log synchronization error at seq=2,offset=556 for /mnt/testuser138/mdbox/storage/dovecot.map.index: Append with UID 2, but next_uid = 3 Jun 6 15:55:19 test-gluster-client1 dovecot: lmtp(12076, testuser217): Error: mdbox /mnt/testuser217/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:19 test-gluster-client1 dovecot: lmtp(12047, testuser41): Error: mdbox /mnt/testuser41/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:23 test-gluster-client1 dovecot: lmtp(11985, testuser166): Error: mdbox /mnt/testuser166/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:23 test-gluster-client1 dovecot: lmtp(12072, testuser130): Error: Log synchronization error at seq=2,offset=204 for /mnt/testuser130/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: uid_validity updated unexpectedly: 1339019655 -> 1339019656 Jun 6 15:55:23 test-gluster-client1 dovecot: lmtp(11928, testuser130): Error: Log synchronization error at seq=2,offset=204 for /mnt/testuser130/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: uid_validity updated unexpectedly: 1339019655 -> 1339019656 Jun 6 15:55:24 test-gluster-client1 dovecot: lmtp(11954, testuser192): Error: mdbox /mnt/testuser192/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:24 test-gluster-client1 dovecot: lmtp(12130, testuser128): Error: mdbox /mnt/testuser128/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:27 test-gluster-client1 dovecot: lmtp(12076, testuser217): Error: mdbox /mnt/testuser217/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:27 test-gluster-client1 dovecot: lmtp(12211, testuser60): Error: mdbox /mnt/testuser60/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:27 test-gluster-client1 dovecot: lmtp(12112, testuser190): Error: mdbox /mnt/testuser190/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:27 test-gluster-client1 dovecot: lmtp(12047, testuser41): Error: Log synchronization error at seq=2,offset=204 for /mnt/testuser41/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: uid_validity updated unexpectedly: 1339019658 -> 1339019659 Jun 6 15:55:27 test-gluster-client1 dovecot: lmtp(11937, testuser41): Error: Log synchronization error at seq=2,offset=204 for /mnt/testuser41/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: uid_validity updated unexpectedly: 1339019658 -> 1339019659 Jun 6 15:55:28 test-gluster-client1 dovecot: lmtp(11985, testuser166): Error: mdbox /mnt/testuser166/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 Jun 6 15:55:30 test-gluster-client1 dovecot: lmtp(12130, testuser128): Error: mdbox /mnt/testuser128/mdbox/mailboxes/INBOX/dbox-Mails: Invalid dbox header size: 0 My dovecot config is: auth_debug = yes auth_debug_passwords = yes auth_username_format = %Ln auth_verbose = yes base_dir = /var/run/dovecot-service/ disable_plaintext_auth = no instance_name = dovecot-service mail_debug = yes mail_fsync = always mail_location = mdbox:~/mdbox mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota mdbox_rotate_size = 16 M mmap_disable = yes passdb { driver = pam } plugin { quota = dict:User quota::file:%h/mdbox/dovecot-quota } protocols = " imap lmtp pop3" service auth { unix_listener auth-userdb { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imap { port = 10143 } } service lmtp { inet_listener lmtp { port = 10024 } } service pop3-login { inet_listener pop3 { port = 10110 } } ssl = no ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd }

3 4

[Dovecot] Frequently login problem
by Jitendra Bhaskar 11 Jun '12

11 Jun '12

Hi, I am using dovecot 2.1.3 on centos 5.7. It was working fine but last few days I need to restart or reload dovecot service because at that time users are not able to login. Each time I am getting information from doveco.log is as : Jun 04 11:52:54 auth: Error: BUG: Authentication client gave a PID 17564 of existing connection Jun 04 11:52:54 auth: Error: BUG: Authentication client gave a PID 17566 of existing connection Jun 04 11:52:59 auth: Error: BUG: Authentication client gave a PID 17564 of existing connection -- * Thanks & Regards * *Jitendra Kumar Bhaskar* Cell:- +91 7306311531 +91 8102997821

2 2

[Dovecot] Dovecot antispam plugin bug: got an empty message
by Petr Bravenec 10 Jun '12

10 Jun '12

It is few months ago I requested help with combination dovecot - dovecot- antispam plugin and dspam. Now I got into troubles with a lot of spam delivering to users inbox. Problem described bellow is now better hidden but stil remains: When moving a message from INBOX to Junk, dspam got an empty message. I made a wrapper about dspamc and there is no input on stdio. The dspam was not trained (got an empty message). Looking to source code of dspam and antispam plugin I suspect the dovecot not to sending any content to plugin when moving from inbox to junk. Petr Bravenec Dne Wednesday 25 of January 2012 17:19:18 Tom Hendrikx napsal(a): > On 25-01-12 08:05, Petr Bravenec wrote: > > Few weeks ago I upgraded dovecot from 1.2 to 2.0.16 and antispam plugin > > to 2.0_pre20101222. Since the upgrade I'm not able to move messages to > > my Junk folder. In the maillog I have found this message: > > > > dspam[25060]: empty message (no data received) > > Gentoo has included the antispam plugin from Johannes historically, but > added the fork by Eugene to support upgrades to dovecot 2.0. It is not > really made clear by the gentoo ebuild is that the forked plugin needs a > slightly different config. > > I use the config below with dovecot 2.0.17 and a git checkout for > dovecot-antispam: > > ===8<======== > plugin { > antispam_signature = X-DSPAM-Signature > antispam_signature_missing = move > antispam_spam_pattern_ignorecase = Junk;Junk.* > antispam_trash_pattern_ignorecase = Trash;Deleted Items;Deleted > Messages > > # Backend specific > antispam_backend = dspam > antispam_dspam_binary = /usr/bin/dspamc > antispam_dspam_args = > --user;%u;--deliver=;--source=error;--signature=%%s > antispam_dspam_spam = --class=spam > antispam_dspam_notspam = --class=innocent > #antispam_dspam_result_header = X-DSPAM-Result > } > > > -- > Regards, > Tom

2 1

[Dovecot] director userdb problem
by Костырев Александр Алексеевич 10 Jun '12

10 Jun '12

hello ! I'm trying to get users from dovecot director server: doveadm director map doveadm(root): Error: User listing returned failure doveadm(root): Error: user listing failed user mail server ip expire time <unknown> 192.168.5.101 2012-06-10 21:54:06 in logs I get: Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): mysql(172.5.14.1): Connected to database EXIM Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): Warning: mysql: Query failed, retrying: Table 'EXIM.users' doesn't exist Jun 10 21:41:14 mail-lvsm dovecot: auth-worker(17510): Error: sql: Iterate query failed: Table 'EXIM.users' doesn't exist (using built-in default iterate_query: SELECT username, domain FROM users) in my dovecot.conf I have: userdb { driver = sql args = /etc/dovecot/dovecot-sql.conf } passdb { driver = static args = proxy=y nopassword=y } and in /etc/dovecot/dovecot-sql.conf: user_query = select MBOX_NAME AS user from M_MAILBOX WHERE (MBOX_NAME = '%u'); Do I have to use special table named users ? is it hard-coded?

1 2

[Dovecot] Restoring older messages to new server?
by Voytek Eymont 10 Jun '12

10 Jun '12

I had Dovcot 1.x setup, all was working well (till...) Server got stuffed up and same Dovecot 1.x was rebuilt, put back in service, all's working well. I have recovered data from Maildirs messages from the old server, As some of the inboxes now have new messages, what is correct way to copy older messages from old server to new server ? (There are no duplicates, simply old messages from past server, data is physically on new server) Thanks for pointers, Voytek -- Swyped on my Motrix with K-9 Mail. Please excuse my brevity.

2 2

[Dovecot] Dovecot setup fails w. multiple mail locations (gnus/dovecot/offlineimap)
by Johnny 10 Jun '12

10 Jun '12

Hi, I am trying to setup a Gnus - Dovecot - Offlineimap - Webmail (Gmail / Fastmail) chain and cannot configure the correct behaviour. Any advice to get this working properly would be very appreciated! I have set up Offlineimap to synchronise two mail accounts into separate folders under ~/Maildir. After running Offlineimap, the folders look as below. Maildir/ |-- Gmail | |-- cur | |-- dovecot.index.log | |-- dovecot-uidlist | |-- dovecot-uidvalidity | |-- dovecot-uidvalidity.4fd3b80e | |-- [Gmail].All\ Mail | |-- [Gmail].Drafts | |-- [Gmail].Important | |-- [Gmail].Sent\ Mail | |-- [Gmail].Spam | |-- [Gmail].Starred | |-- [Gmail].Trash | |-- INBOX | |-- new | |-- Personal | |-- Receipts | |-- tmp | |-- Travel | `-- Work `-- Fastmail |-- cur |-- dovecot.index.log |-- dovecot.mailbox.log |-- dovecot-uidlist |-- dovecot-uidvalidity |-- dovecot-uidvalidity.4fd3b75e |-- INBOX |-- INBOX.Drafts |-- INBOX.Sent\ Items `-- INBOX.Trash The Dovecot config is below. (I have set up a blank "MailTest" directory as inbox, believing that this may preserve the two imap directories better for offlineimap synching (not sure if this is correct)). ,---- | mail_location = maildir:~/Maildir:LAYOUT=fs | | namespace inbox { | location = maildir:~/MailTest | inbox = yes | } | | namespace mygmail { | type = private | separator = . | prefix = "mygmail." | location = maildir:%h/Maildir/Gmail/:LAYOUT=fs | inbox = no | hidden = no | list = yes | subscriptions = yes | } | | namespace myfastmail { | type = private | separator = . | prefix = "myfastmail." | location = maildir:%h/Maildir/FASTMAIL/:LAYOUT=fs | inbox = no | hidden = no | list = yes | subscriptions = yes | } `---- Accessing dovecot through gnus with this setup only sees the files in the directories that are not prefixed (e.g. under Fastmail, INBOX is the only seen folder, all INBOX.subfolder are not there). Removing the prefix manually they can be seen again however (e.g. INBOX.subfolder -> subfolder). If I remove LAYOUT=fs in the dovecot config, nothing is seen at all, although the directories look like proper Maildirs! A second issue is that running Offlineimap a second time seems to work ok for gmail, but Fastmail complains that "cannot create directory '.'"? Thanks! -- Johnny Dovecot 2.1.6 Offlineimap 6.5.2.1 Ma Gnus v0.6

1 0

[Dovecot] director: backend health monitoring
by Костырев Александр Алексеевич 10 Jun '12

10 Jun '12

Hello! I am wonder if there are plans to include backend health monitoring feature to Dovecot Director ? Yes, I'm aware of poolmon by Brad Davidson but I think it's kind of must-have feature out of box. thanks

2 1

[Dovecot] Upgrading 1.2.17 -> 2.1.x
by Adam G Tilghman 10 Jun '12

10 Jun '12

We're planning to upgrade our site from 1.2.17 to 2.1.x within the next few months, but we must ensure our ability to revert to 1.2.17 if problems arise. I don't expect our maildir storage would present a problem, but am less certain about 2.1.x index/control files remaining readable under 1.2.17. Should I have any reason to worry? -- Adam Tilghman Systems Support / Academic Computing & Media Services agt(a)ucsd.edu 858-822-0711 University of California, San Diego

2 1

[Dovecot] Deliver quota-warning via director
by Daniel Parthey 10 Jun '12

10 Jun '12

Hi there, I'm using NFS with Dovecot 2.0.20 and would like to deliver a quota warning to the user using the LMTP director. I have configured quota warnings according to http://wiki2.dovecot.org/Quota/Configuration But it seems that lda delivers the mail directly to the local filesystem and is not using our lmtp director, which prevents NFS mailboxes from getting corrupted. Is there a way to tell lda to use LMTP or the director and ignore the quota while delivering the notification? Regards Daniel

2 1

[Dovecot] Dovecot 1.x on AIX -> Dovecot 2.x on Ubuntu
by root＠yuma.acns.colostate.edu 10 Jun '12

10 Jun '12

We are working on migrating Dovecot 1.2.17 running on AIX 5.3 (believe it or not!) to Dovecot 2.0.13 running on Ubuntu. We have hundreds of users mboxes we will be migrating. My question is regarding the index files. Should we remove those after the migration, but before we open it up to users so Dovecot can create new ones? I did a test migration of a single user, and Dovecot detects the architecture change and put out some panic errors, corrupt files and backtrace messages in syslog on Ubuntu. The messages are shown below. If every user is going to generate these types of errors, I'm thinking maybe it makes sense to remove all the .imap directories and let Dovecot create new clean ones. I realize that may slow things down for awhile while Dovecot is rebuilding new files. Thanks for any info. Jackie Hunt Acad Computing & Networking Srvcs Colorado State University Jun 6 13:43:02 newlamar dovecot: imap-login: Login: user=<cacti>, method=PLAIN, rip=129.82.100.64, lip=129.82.100.124, mpid=19593, TLS Jun 6 13:43:21 newlamar dovecot: imap-login: Login: user=<cacti>, method=PLAIN, rip=129.82.100.64, lip=129.82.100.124, mpid=19597, TLS Jun 6 13:43:21 newlamar dovecot: imap-login: Login: user=<cacti>, method=PLAIN, rip=129.82.100.64, lip=129.82.100.124, mpid=19600, TLS Jun 6 13:44:11 newlamar dovecot: imap(cacti): Disconnected: Logged out bytes=107/441 Jun 6 13:44:11 newlamar dovecot: imap(cacti): Disconnected: Logged out bytes=1676/2724868 Jun 6 13:44:11 newlamar dovecot: imap(cacti): Disconnected: Logged out bytes=129/759 Jun 6 13:51:49 newlamar dovecot: imap-login: Login: user=<cacti>, method=PLAIN, rip=129.82.100.64, lip=129.82.100.124, mpid=19657, TLS Jun 6 13:51:49 newlamar dovecot: imap(cacti): Error: Rebuilding index file /adhome/cacti/.imap/INBOX/dovecot.index: CPU architecture changed Jun 6 13:51:58 newlamar dovecot: imap-login: Login: user=<cacti>, method=PLAIN, rip=129.82.100.64, lip=129.82.100.124, mpid=19662, TLS Jun 6 13:51:58 newlamar dovecot: imap(cacti): Error: Corrupted transaction log file /adhome/cacti/.imap/Trash/dovecot.index.log seq 16777216: log file shrank (1428 < 6144) (sync_offset=6144) Jun 6 13:51:58 newlamar dovecot: imap(cacti): Panic: file buffer.c: line 295 (buffer_set_used_size): assertion failed: (used_size <= buf->alloc) Jun 6 13:51:58 newlamar dovecot: imap(cacti): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x374fa) [0x7f3ada59c4fa] -> /usr/lib/dovecot/libdovecot.so.0(+0x3753e) [0x7f3ada59c53e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f3ada576837] -> /usr/lib/dovecot/libdovecot.so.0(+0x35319) [0x7f3ada59a319] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_file_open+0x21e) [0x7f3ada87acee] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_open+0xb8) [0x7f3ada877a68] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_open+0xe5) [0x7f3ada860e75] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0xbc) [0x7f3ada826eac] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5f7fb) [0x7f3ada8417fb] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x28c4c) [0x7f3ada80ac4c] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_enable+0x24) [0x7f3ada827584] -> dovecot/imap(imap_status_get+0xfd) [0x7f3adacead8d] -> doveco t/imap(cmd_status+0x182) [0x7f3adace1f92] -> dovecot/imap(+0x1105d) [0x7f3adace405d] -> dovecot/imap(+0x11135) [0x7f3adace4135] -> dovecot/imap(client_handle_input+0x125) [0x7f3adace4385] -> dovecot/imap(client_input+0x65) [0x7f3adace4c35] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x48) [0x7f3ada5a8048] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f3ada5a90c7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f3ada5a7fd8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f3ada5962c3] -> dovecot/imap(main+0x2f4) [0x7f3adacdc544] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xed) [0x7f3ada1e530d] -> dovecot/imap(+0x95d5) [0x7f3adacdc5d5] Jun 6 13:51:59 newlamar dovecot: imap-login: Login: user=<cacti>, method=PLAIN, rip=129.82.100.64, lip=129.82.100.124, mpid=19664, TLS Jun 6 13:51:59 newlamar dovecot: imap(cacti): Error: Transaction log file /adhome/cacti/.imap/Trash/dovecot.index.log: marked corrupted Jun 6 13:51:59 newlamar dovecot: imap(cacti): Error: Rebuilding index file /adhome/cacti/.imap/Trash/dovecot.index: CPU architecture changed

3 2