- dovecot - dovecot.org

[Dovecot] Using different auth_default_realm on multiple sockets with postfix. Is it possible?
by Gábor Lénárt 22 Feb '13

22 Feb '13

Hi, I have more postfix smtpd instances (via master.cf) listening on different ports, and the FW passes the inbound mail submit connections to the right port. The problem: it seems postfix is not able to append "default realm" and I need to set different values for the instances. As far as I see, it's not possible as postfix only passes the base64 encoded string from the user to the dovecot auth service (as I'm using dovecot for sasl authentication). We're talking about PLAIN and LOGIN methods. In the other hand, dovecot is happily append "realm" with auth_default_realm. It works (which does not with postfix) but again: I need more defaults. I wouldn't like to run multiple instances of dovecot (just for having a single setting be different), so I've tried similar solutions: service auth { unix_listener /var/spool/postfix/private/auth-dom1 { group = postfix mode = 0660 user = postfix } auth_default_realm = domain1.com } And the same for /var/spool/postfix/private/auth-dom2 with domain2.com. I thought then I could use postfix's master.cf to give different auth socket (like /var/spool/postfix/private/auth-dom1 and auth-dom2) with smtpd_sasl_path postfix parameter. However it seems dovecot finds auth_default_realm invalid unless it's used in the global scope of the configuration. It's dovecot 2.0.19 (in Ubuntu 12.04 LTS). Is it possible at all, what I would like to do? Maybe with newer dovecot, or can you suggest me some other solution? Any feedback is welcomed and thanked. Thanks, - Gábor

2 1

[Dovecot] Errors after enable vnd.dovecot.duplicate
by Alessio Cecchi 22 Feb '13

22 Feb '13

Hi, on dovecot 2.1.14 and pigeonhole-0.3.3 after creating a default.sieve like this: require ["vnd.dovecot.duplicate", "fileinto", "mailbox"]; if duplicate { fileinto "Trash"; } I have two strange errors, one is many of this error in lda.log: Feb 19 14:43:17 lda(info(a)domain.com): Error: file_dotlock_create(/home/vpopmail/domains/domain.com/info/.dovecot.lda-dup… failed: Resource temporarily unavailable Feb 19 14:43:43 lda(info(a)domain.com): Error: file_dotlock_create(/home/vpopmail/domains/domain.com/info/.dovecot.lda-dup… failed: Resource temporarily unavailable Feb 19 14:44:29 lda(info(a)domain.com): Error: rename(/home/vpopmail/domains/domain.com/info/.dovecot.lda-dupes.lock, /home/vpopmail/domains/domain.com/info/.dovecot.lda-dupes) failed: No such file or directory Feb 19 14:44:29 lda(info(a)domain.com): Error: file_dotlock_replace(/home/vpopmail/domains/domain.com/info/.dovecot.lda-du… failed: No such file or directory Note that my mailboxes are store on NFS. This happens for many accounts. Another error is that some messages have not Message-ID in lda.log and when this happens emails are treated as duplicate: # grep "msgid=: stored" /var/log/dovecot/lda.log Feb 18 08:02:13 lda(info(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'INBOX' Feb 18 09:37:06 lda(info(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'Trash' Feb 18 10:29:37 lda(cracigna(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'Trash' Feb 18 11:38:00 lda(info(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'Trash' Feb 18 12:09:22 lda(info(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'Trash' Feb 18 16:10:52 lda(info(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'Trash' Feb 19 14:18:19 lda(cracigna(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'Trash' Feb 19 14:24:21 lda(panizzon(a)domain.com): Info: sieve: msgid=: stored mail into mailbox 'INBOX' After some investigations this emails are sent all from the same user with a Lotus Domino Server. Can these errors be solved? My dovecot configuration: # 2.1.14: /usr/local/dovecot-2.1/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 auth_cache_size = 512 k auth_worker_max_count = 60 default_login_user = nobody dict { acl = mysql:/usr/local/dovecot-2.1/etc/dovecot/dovecot-share-folder.conf expire = mysql:/usr/local/dovecot-2.1/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no dotlock_use_excl = no first_valid_gid = 89 first_valid_uid = 89 last_valid_gid = 89 last_valid_uid = 89 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot/dovecot.log mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = quota acl zlib expire maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.duplicate mmap_disable = yes namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = cache_key=%s%u webmail=192.168.13.215 driver = vpopmail } plugin { acl = vfile:/usr/local/dovecot-2.1/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = proxy::acl expire = Trash expire2 = Spam expire_dict = proxy::expire quota = maildir:UserQuota quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_default = /usr/local/dovecot-2.1/etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.duplicate } protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = vchkpw mode = 0660 user = vpopmail } } service dict { unix_listener dict { group = vchkpw mode = 0660 user = vpopmail } } service imap-login { service_count = 0 } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { service_count = 0 } service quota-warning { executable = script /usr/local/dovecot-2.1/etc/dovecot/scripts/quota-warning.sh unix_listener quota-warning { user = vpopmail } user = vpopmail } ssl_cert = </usr/local/dovecot-2.1/etc/ssl/wildcard.pem ssl_key = </usr/local/dovecot-2.1/etc/ssl/wildcard.key submission_host = localhost userdb { args = quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol lda { log_path = /var/log/dovecot/lda.log mail_plugins = quota acl zlib expire sieve } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_idle_notify_interval = 29 mins mail_max_userip_connections = 18 mail_plugins = quota acl zlib expire imap_quota imap_acl } protocol sieve { mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 5 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it

3 4

[Dovecot] Full-text search
by Valery V. Sedletski 22 Feb '13

22 Feb '13

Hi all I discovered that the full-text search (fts) plugin can work without SQUAT/LUCENE/SOLR backend. I.e., Dovecot creates separate indexes for header search in files dovecot.index and dovecot.index.cache. Even, the search by headers is fast enough, and can search for phrases. Also, it seems that this buillt-in search is faster than Solr-based search. But if I enable the Solr backend (fts_solr), then the FTS generic plugin built-in search becomes disabled. But, Solr-based Full-text search is faster if search inside message bodies. Also, it appears that the built-in search inside message bodies works too, but very slow (it seems that is because it is dumb file-based search and does not use indexes at all) So, my question is: is it possible to combine the built-in search with Solr or Lucene plugin-based search so that the first one searches by headers, and the second one works by bodies? This could make the advantages of both search methods combined. WBR, valery

2 1

[Dovecot] LDA misbehavior?
by Eugene Paskevich 22 Feb '13

22 Feb '13

Hello, Could somebody please give me a hint on what might be going wrong? Feb 21 16:33:07 hopper dovecot: lda(eugene): Panic: file mail-storage.c: line 1757 (mailbox_transaction_commit_get_changes): assertion failed: (ret < 0 || seq_range_count(&changes_r->saved_uids) == save_count) Feb 21 16:33:07 hopper dovecot: lda(eugene): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6019a) [0x7f38e5ef619a] -> /usr/lib/dovecot/ibdovecot.s o.0(i_syslog_fatal_handler+0x2b) [0x7f38e5ef621b] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f38e5eb81f4] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x7c0de) [0x7f38e61cd0de] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver_save+0x1b2) [0x7f38e6469d62] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0xe3) [0x7f38e646a113] -> /usr/lib/dovecot/dovecot-lda(main+0x38a) [0x40295a] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f38e5b2aead] -> /usr/lib/dovecot/dovecot-lda() [0x4031e1] Feb 21 16:33:07 hopper exim[10094]: 1U8XCf-0002Za-4s ** eugene(a)hopper.volia.net <root(a)hopper.volia.net> R=local_user T=dovecot_delivery: Child process of dovecot_delivery transport (running command "/usr/lib/dovecot/dovecot-lda -f $sender_address -a $original_local_part@$original_domain") was terminated by signal 6 (Aborted) Feb 21 16:33:07 hopper exim[10094]: 1U8XCf-0002Za-4s Frozen (delivery error message) It started a couple of days ago. Triggered by the mass delivery. E.g. by for i in {1..50}; do { mail -s "test $i" eugene(a)hopper.volia.net <<< "Try $i" & }; done I suspected that sieve might cause that, but disabling it gave nothing. Current root@hopper[pts/0]:/etc/dovecot> doveconf -n # 2.2.beta1 (808a64899e8a): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.0 mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } postmaster_address = hopper(a)volia.net protocols = imap service imap-login { inet_listener imap { port = 143 } inet_listener imap2 { port = 1357 } } ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = passwd } Is there any other info I could provide? -- Eugene Paskevich | *==)----------- | Plug me into eugene(a)raptor.kiev.ua | -----------(==* | The Matrix

2 1

[Dovecot] Bug: empty m-files
by Peer Heinlein 22 Feb '13

22 Feb '13

Having an empty m-File, doveadm force-resync isn't able to detect and repair this: -rw------- 1 vmail vmail 4948043 8. Jan 20:32 m.634 -rw------- 1 vmail vmail 5237411 8. Jan 20:32 m.635 -rw------- 1 vmail vmail 0 9. Jan 16:23 m.636 mail1:~ # doveadm force-resync -u user mailbox INBOX doveadm(user): Warning: fscking index file /vmail/example.com/user//mdbox/storage/dovecot.map.index doveadm(user): Warning: mdbox /vmail/example.com/user//mdbox/storage: rebuilding indexes doveadm(user): Error: Corrupted dbox file /vmail/example.com/user//mdbox/storage/m.636 (around offset=0): EOF while reading file header doveadm(user): Error: mdbox rebuild: Failed to fix file /vmail/example.com/user//mdbox/storage/m.636 doveadm(user): Error: mdbox /vmail/example.com/user//mdbox/storage: Duplicate GUID 2cafdd2f0224ec50773c0000085c1439 in m.627:16 and m.638:16 Peer -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-42 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

[Dovecot] Crash in dsync [dovecot 2.1.7]
by Joe Beaubien 22 Feb '13

22 Feb '13

Just taught i'd report this crash while running the ofllowing command: 19748 Aborted (core dumped) $DSYNC_BINARY -f -u document backup mdbox:$LOCAL_BACKUP_PATH/emails/document >> $LOG_FILE 2>&1 Here is the traceback I got: dsync(document): Error: Mailbox INBOX/Julie: Corrupted index, uidvalidity=0 dsync(document): Warning: mdbox /backup_hdd/current/emails/document/storage: rebuilding indexes dsync(document): Panic: file mdbox-storage-rebuild.c: line 66 (mdbox_storage_rebuild_init): assertion failed: (!storage->rebuilding_storage) dsync(document): Error: Raw backtrace: /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(+0x4203a) [0x7faa3bbde03a] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7faa3bbde0fa] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7faa3bbb53f0] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_storage_rebuild_in_context+0x117e) [0x7faa3be656de] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_sync_begin+0x23a) [0x7faa3be62b1a] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_sync+0x33) [0x7faa3be630f3] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_storage_sync_init+0x7e) [0x7faa3be631be] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x31) [0x7faa3bea2871] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x7faa3bea2997] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_mark_index_deleted+0x9b) [0x7faa3bea3aeb] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0x85) [0x7faa3bea3a25] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_storage_rebuild_in_context+0xb7b) [0x7faa3be650db] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_sync_begin+0x23a) [0x7faa3be62b1a] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_sync+0x33) [0x7faa3be630f3] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mdbox_storage_sync_init+0x7e) [0x7faa3be631be] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x31) [0x7faa3bea2871] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x7faa3bea2997] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x8a) [0x7faa3bec47da] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xc002) [0x7faa3a775002] -> /opt/dovecot/bin/dsync() [0x42bf9a] -> /opt/dovecot/bin/dsync(dsync_worker_mailbox_iter_next+0x29) [0x428eb9] -> /opt/dovecot/bin/dsync() [0x423bfe] -> /opt/dovecot/bin/dsync(dsync_brain_sync+0x832) [0x4233a2] -> /opt/dovecot/bin/dsync(dsync_brain_sync_all+0x18) [0x423ee8] -> /opt/dovecot/bin/dsync() [0x420f36] -> /opt/dovecot/bin/dsync() [0x4215b2] -> /opt/dovecot/bin/dsync() [0x40e798] -> /opt/dovecot/bin/dsync() [0x40f1ea]

2 1

[Dovecot] Problem with managesieve proxy
by Lance A. Brown 22 Feb '13

22 Feb '13

Hi folks, I'm setting up a new dovecot email service and have a proxy server running in front of it to facilitate migrating users from my very old UW-IMAP-based mail server to the new one. I have a mysql proxy table that directs inbound IMAP and LMTP connections to the correct server, works great. Managesieve connections are not working through the proxy using either with the sieverules plugin for RoundCube or the Sieve plugin for Thunderbird. If I point them directly at the actual dovecot server everything works fine, so I must have something wrong in my proxy setup. This is what I get in the maillogs when I try to connect to the managesieve proxy: PROXY machine: Feb 21 16:16:38 sortie dovecot: managesieve-login: Error: proxy: Remote x.y.z.110:4190 disconnected: Connection closed (state=0, duration=0s): user=<brown>, method=PLAIN, rip=x.y.z.83, lip=x.y.z.109, TLS, session=<0jUal0LWswCYAxZT> Feb 21 16:16:38 sortie dovecot: managesieve-login: Disconnected (internal failure, 1 succesful auths): user=<brown>, method=PLAIN, rip=x.y.z.83, lip=x.y.z.109, TLS, session=<0jUal0LWswCYAxZT> SERVER machine: Feb 21 16:16:38 postie dovecot: managesieve-login: Disconnected: Too many invalid commands. (no auth attempts in 0 secs): user=<>, rip=x.y.z.109, lip=x.y.z.110, session=<REgal0LWnQCYAxZt> Output of a 'tcpdump -A' is attached as well if needed. x.y.z.83 - Roundcube webmail server x.y.z.109 - PROXY x.y.z.110 - SERVER If I turn off TLS all-around I get an error in the roundcube log that says: [20-Feb-2013 23:02:27] No supported authentication method found. The server supports these methods: , but we want to use: PLAIN (): [20-Feb-2013 23:02:27] Not currently in AUTHORISATION state (1): I am using Pigeonhole 0.3.3 on both proxy and server. Dovecot configurations for the proxy and server are attached below. Here are the SQL files referenced in the proxy configs. Long lines broke for readability. /etc/dovecot/dovecot-sql.conf.ext driver = mysql connect = host=localhost dbname=dovecot user=dovecot password=XXX password_query = SELECT NULL AS password, 'any-cert' as 'ssl', \ 'Y' as nopassword, host, user as destuser, \ 'Y' AS proxy \ FROM proxy WHERE user = '%u' /etc/dovecot/dovecot-sql-lmtp.conf.ext driver = mysql connect = host=localhost dbname=dovecot user=dovecot password=XXX password_query = SELECT NULL AS password, 'any-cert' as 'ssl', \ 'Y' as nopassword, host, user as destuser, 'Y' AS proxy \ FROM proxy WHERE user = '%n' The proxy DB table looks like this: - -- Table structure for table `proxy` -- CREATE TABLE IF NOT EXISTS `proxy` ( `id` int(11) NOT NULL AUTO_INCREMENT, `user` varchar(255) NOT NULL, `email` varchar(64) NOT NULL, `host` varchar(16) DEFAULT NULL, PRIMARY KEY (`id`), UNIQUE KEY `user_index` (`user`) ) ENGINE=MyISAM DEFAULT CHARSET=latin1 AUTO_INCREMENT=379 ; -- -- Dumping data for table `proxy` -- INSERT INTO `proxy` (`id`, `user`, `email`, `host`) VALUES (1, 'brown', '', 'x.y.z.110'), (2, 'fizgig', '', 'x.r.z.15'), 110 is the new dovecot IMAP server, 15 is the old UW-IMAP server. Any advice on getting managesieve proxy running would be greatly appreciated. Thanks, --[Lance] -- GPG Fingerprint: 409B A409 A38D 92BF 15D9 6EEE 9A82 F2AC 69AC 07B9 CACert.org Assurer

1 1

[Dovecot] Dovecot list archives not updating
by Mark Sapiro 22 Feb '13

22 Feb '13

The February archive indexes of this list haven't been updating since Feb 8. The text file at <http://dovecot.org/pipermail/dovecot/2013-February.txt> appears to be up to date with all posts, but the index pages at <http://dovecot.org/pipermail/dovecot/2013-February/thread.html>, <http://dovecot.org/pipermail/dovecot/2013-February/subject.html>, <http://dovecot.org/pipermail/dovecot/2013-February/author.html> and <http://dovecot.org/pipermail/dovecot/2013-February/date.html> have no posts after the one at <http://dovecot.org/pipermail/dovecot/2013-February/071213.html> from Fri Feb 8 16:31:49 EET 2013. Subsequent posts appear to not have individual HTML pages either as URLs <http://dovecot.org/pipermail/dovecot/2013-February/071214.html> and <http://dovecot.org/pipermail/dovecot/2013-February/071215.html> return 404 errors. I suspect there is a permissions issue starting soon after Fri Feb 8 16:31:49 EET 2013 and that Mailman's error log has lots of tracebacks from this. If that is the case, the messages were probably all shunted and running Mailman's bin/unshunt after fixing the underlying issue and also making sure that any messages older than Fri Feb 8 16:31:49 EET 2013 in Mailman's 'shunt' queue that should not also be reprocessed are removed. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 0

[Dovecot] Public folders and dsync replication Dovecot v2.1.7
by Steve Brown 21 Feb '13

21 Feb '13

Dear all I have a few public folders setup and working fine, and one such public folder is 'Public/General'. I'm trying to sort dsync replication out to another server and notice that the system log is full of error messages similar to: dovecot: doveadm: Error: dsync-remote(username: Error: Can't update subscription Pu blic/General: Invalid mailbox name The replication setup is basically as per the v2 wiki. It seems that when a mail client subscribes to a public folder, the folder name is put into '~/Maildir/subscriptions' and this seems to be the cause of the error during replication. The mails are not synchronised to the other server. Public namespace is: namespace { type = public separator = / prefix = Public/ location = maildir:/home/shared/public subscriptions = no list = yes } Hopefully somebody can send the clue bus over? Steve -- Steve Brown Operations Manager Connection Services Ltd +44 (0)1189 711 765 Direct +44 (0)870 751 7571 Fax www.connectionservices.com www.hotspot-directory.com

3 2

Re: [Dovecot] Dovecot LDA LDAP lookups on samba4 server ends very often in timeouts (Christian Wiese)
by Marco Carcano 21 Feb '13

21 Feb '13

Dear Christian thank you very much - you got it at the very first shot: modified /etc/ openldap/ldap.conf adding REFERRALS off en everything works without issues now many thanks Marco Carcano

1 0