- dovecot - dovecot.org

[Dovecot] dovecot: auth: Error: ldap(...) failed: No such object
by Bruce Hammond 06 Apr '12

06 Apr '12

I just installed the 2.1.3 version of dovecot. When I telnet to my dovecot linux server on the imap port (143) and try to login I get the error "No [UNAVAILABLE] Temporary authentication failure" on the telnet display and dovecot: auth: Error: ldap(bhammond_test(a)131.103.212.38,128.121.121.193): ldap_search(base=uid=bhammond_test(a)131.103.212.38,ou=users,dc=aspect filter=(&(objectClass=posixAccount)(productFeature=mail))) failed: No such object in the /var/log/maillog. I am not familiar with ldap and I haven't been able to find anything using google. Anyone have any ideas with the problem? Thanks. Here is my configuration: # 2.1.3: /usr/local/packages/dovecot2/etc/dovecot/dovecot.conf # OS: Linux 2.6.18-274.3.1.el5.secure i686 Red Hat Enterprise Linux Server release 5.7 (Tikanga) auth_mechanisms = plain login auth_verbose = yes default_login_user = dovecot disable_plaintext_auth = no listen = * mail_location = maildir:~/mail passdb { args = /etc/devel/passdb.conf driver = ldap } pop3_lock_session = yes protocols = imap pop3 service auth { user = dovecot } service imap-login { process_limit = 128 process_min_avail = 30 service_count = 0 user = dovecot vsz_limit = 64 M } service pop3-login { process_limit = 128 process_min_avail = 30 service_count = 0 user = dovecot vsz_limit = 64 M } shutdown_clients = no ssl_cert = </etc/ssl.cert ssl_cipher_list = ALL:!LOW!SSLv2 ssl_key = </etc/ssl.key userdb { args = /usr/local/packages/dovecot2/etc/userdb.conf driver = ldap } protocol imap { imap_max_line_length = 64 k } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_uidl_format = %08Xv%08Xu }

1 0

[Dovecot] create mailboxes in /var/mail via doveadm
by Radim Kolar 05 Apr '12

05 Apr '12

what usedid is used by doveadm for creating mailboxes? can it be setup to run as dovecot:mail? cant create mailbox from command line ponto# ls -ld /var/mail drwxrwxr-x 8 root mail 24 Apr 5 20:35 /var/mail ponto# doveadm mailbox create -u jboss INBOX doveadm(jboss): Error: Can't create mailbox INBOX: Permission denied mail_location = maildir:%h/Maildir:INBOX=/var/mail/%u

1 0

[Dovecot] dovecot and unison
by FZiegler 05 Apr '12

05 Apr '12

I am successfully using dovecot purely as a personal local mail store on my desktop. (There is only one account, and it's only ever accessed by local mail clients on the machine. The point is to have a common store I can use with any client; plus, I prefer dovecot's Mailbox storage to Thunderbird's mboxes.) Now I'd like if possible, to replicate this setup on my laptop and keep both in sync with unison (http://www.cis.upenn.edu/~bcpierce/unison/) which I am already using to sync much of my home dir about once a day. I found at least one positive message regarding this topic (http://dovecot.org/list/dovecot/2010-April/048092.html) but I feel I could use some more advice. Namely, which of the ancillary files should I be syncing (or perhaps deleting before sync)? In addition to the mails themselves I'm seeing: -rw------- 1 fz 501 13 Apr 1 17:10 dovecot-keywords -rw------- 1 fz 501 2483 Apr 1 17:10 dovecot-uidlist -rw------- 1 fz 501 1040 Mar 29 14:50 dovecot.index -rw------- 1 fz 501 44032 Apr 1 17:10 dovecot.index.cache -rw------- 1 fz 501 9772 Apr 1 17:10 dovecot.index.log and at the top level (in .local/var/Maildir/): -rw------- 1 fz 501 8 Apr 1 17:10 dovecot-uidvalidity -r--r--r-- 1 fz 501 0 Apr 1 17:10 dovecot-uidvalidity.4efb323d -rw------- 1 fz 501 3288 Apr 1 17:10 dovecot.mailbox.log -rw------- 1 fz 501 4104 Mar 28 10:53 dovecot.mailbox.log.2 -rw------- 1 fz 501 5114 Apr 1 17:10 subscriptions In my naive trials I ended up at least once in a situation where Thunderbird would not see some subfolders (even though they were there). That's since fixed but I guess my question is, what's the safe recommended way to not have this happen? Thanks, FZiegler

3 3

[Dovecot] Listener not binding to port
by Mike Jones! 05 Apr '12

05 Apr '12

Hello. Dovecot is not binding or listening on port 993 when I start it. $ sudo netstat -tlnp | grep -c 993 0 Dovecot starts fine and runs without complaints. $ sudo service dovecot restart Restarting IMAP/POP3 mail server: dovecot. $ sudo tail /var/log/mail.log Apr 4 13:42:39 mwjones dovecot: master: Warning: Killed with signal 15 (by pid=16238 uid=0 code=kill) Apr 4 13:42:39 mwjones dovecot: master: Dovecot v2.0.18 starting up (core dumps disabled) $ sudo ps -ef | grep -i [d]ovecot root 16243 1 0 13:42 ? 00:00:00 /usr/sbin/dovecot -c /etc/dovecot/dovecot.conf dovecot 16245 16243 0 13:42 ? 00:00:00 dovecot/anvil root 16246 16243 0 13:42 ? 00:00:00 dovecot/log root 16248 16243 0 13:42 ? 00:00:00 dovecot/config Still no listener :( $ sudo netstat -tlnp | grep -c 993 0 Other infos for your scrutiny. $ sudo dovecot --version 2.0.18 $ doveconf -n # 2.0.18: /etc/dovecot/dovecot.conf # OS: Linux 3.2.5-grsec x86_64 Debian wheezy/sid ext4 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes first_valid_uid = 1000 log_timestamp = "%Y-%m-%d %H:%M:%S " mail_debug = yes mail_location = maildir:/home/vmail/%d/%n/Maildir passdb { args = /home/vmail/%d/etc/passwd driver = passwd-file } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service imap-login { service_count = 1 } service ssl-params { type = startup } ssl_cert = </etc/apache2/ssl/GandiStandardSSLCA.pem ssl_key = </etc/apache2/ssl/ssl.key userdb { args = /home/vmail/%d/etc/passwd driver = passwd-file } verbose_ssl = yes What am I missing and how do I fix this? Thanks, mwjones

3 3

[Dovecot] Dovecot allows creation of folders outside of a user's directory
by Christoph Bußenius 05 Apr '12

05 Apr '12

Hi, in our dovecot 2.0 setup with shared folders, users can make dovecot create directories outside their mail directory. Which is a bit scary imho. The following command: . create inbox.shared.abc123 or even . create "inbox.shared.strange &ANY- characters" -- even though it will fail with a "permission denied" error -- will create a directory like "/mail/users/strange &ANY- characters". That directory will only contain a subdirectory "Maildir" and therein dovecot-acl-list. I think basically the reason for this behaviour is that Dovecot checks whether the directory has enough ACLs for the user to access it, and auto-creates the directory in the process. Is there way to avoid this auto-creation - or maybe a way to make Dovecot check whether the directory name is an existing username? Here's a config to reproduce this: # 2.0.19: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-35-server x86_64 Ubuntu 10.04.4 LTS auth_username_format = %Ln disable_plaintext_auth = no mail_gid = vmail mail_home = /mail/users/%u mail_location = maildir:~/Maildir mail_plugins = " acl" mail_uid = vmail maildir_very_dirty_syncs = yes namespace default { inbox = yes location = prefix = INBOX. separator = . type = private } namespace sharedns { inbox = no list = children location = maildir:/mail/users/%%u/Maildir prefix = INBOX.shared.%%u. separator = . subscriptions = no type = shared } passdb { args = /usr/local/dovecot/etc/dovecot/users driver = passwd-file } plugin { acl = vfile:/usr/local/dovecot/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/mail/vmail/shared-mailboxes.db } service auth { unix_listener auth-userdb { group = vmail mode = 0660 } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem syslog_facility = local6 userdb { args = /usr/local/dovecot/etc/dovecot/users driver = passwd-file } protocol lmtp { mail_plugins = " sieve" } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = " acl imap_acl" } Content of the "users" file looks like this: user1:{plain}(hidden):::user1:/mail/users/user1:: user2:{plain}(hidden):::user2:/mail/users/user2:: testuser:{plain}(hidden):::testuser:/mail/users/testuser:: Cheers, Christoph -- Christoph Bußenius Rechnerbetriebsgruppe der Fakultäten Informatik und Mathematik Technische Universität München +49 89-289-18519 <> Raum 00.05.055 <> Boltzmannstr. 3 <> Garching

2 2

[Dovecot] problem to configuration dovecot and postfix
by Akihiko Sato 05 Apr '12

05 Apr '12

Hi, I'm having a problem with dovecot and postfix. I'm using a dovecot version 2.0.13. Postfix (Version: 2.8.5) config is changed according to the http://wiki2.dovecot.org/LDA/Postfix: I have thought to build a virtual user and virtual mailbox, and use the functionality of the Sieve. However, when the test set, the mail not received the mailbox. Record that there was a "temporary failure" in the log of Postfix. It delivered and to change the "virtual" to "dovecot", I think that's a matter of dovecot. To ensure that mail is delivered as intended, will How do I? Can anyone give me a hint what to do? # doveconf -n: # 2.0.13: /etc/dovecot/dovecot.conf # OS: Linux 3.0.0-12-server x86_64 Ubuntu 11.10 ext4 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes disable_plaintext_auth = no info_log_path = /var/log/dovecot-info.log lda_mailbox_autosubscribe = yes listen = * log_path = /var/log/dovecot.log mail_debug = yes mail_location = maildir:/var/mail/vhosts/%d/%n managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables bo dy enotify environment mailbox date namespace { inbox = yes list = yes location = prefix = INBOX/ separator = / subscriptions = yes type = private } namespace { hidden = no list = yes location = maildir:/var/mail/shared/:INDEX=/var/mail/vhosts/%d/%n/shared/:CONTROL=/var/mail/vhosts/%d/%n/shared/ prefix = &UXFnCQ-/ separator = / subscriptions = yes type = public } passdb { args = /etc/auth/passwd.main driver = passwd-file } passdb { args = username_format=%n /etc/auth/%d/passwd driver = passwd-file } passdb { driver = pam } plugin { sieve = /var/mail/vhosts/%d/%n/_dovecot.sieve sieve_dir = /var/mail/vhosts/%d/%n/sieve/ } postmaster_address = postmaster(a)dom3.gs3 protocols = imap sieve service auth { user = root } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } userdb { args = /etc/auth/passwd.main driver = passwd-file } userdb { args = username_format=%n /etc/auth/%d/passwd driver = passwd-file } userdb { driver = passwd } protocol imap { mail_plugins = autocreate } protocol lda { mail_plugins = " sieve" } # postconf -n: alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases append_dot_mydomain = no biff = no broken_sasl_auth_clients = yes config_directory = /etc/postfix default_transport = error home_mailbox = Maildir/ inet_interfaces = all inet_protocols = all mailbox_command = /usr/lib/dovecot/deliver -c /etc/dovecot/conf.d/01-mail-stack-delivery.conf -m "${EXTENSION}" mailbox_size_limit = 1300000000 message_size_limit = 130000000 mydestination = qbu.example.com, qbu, localhost.localdomain, localhost myhostname = qbu mynetworks = 127.0.0.0/8 [::ffff:127.0.0.0]/104 [::1]/128 myorigin = /etc/mailname readme_directory = no recipient_delimiter = + relay_transport = error relayhost = smtp_tls_session_cache_database = btree:${data_directory}/smtp_scache smtp_use_tls = yes smtpd_banner = $myhostname ESMTP $mail_name (Ubuntu) smtpd_recipient_restrictions = reject_unknown_sender_domain, reject_unknown_recipient_domain, reject_unauth_pipelining, permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_authenticated_header = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = private/dovecot-auth smtpd_sasl_security_options = noanonymous smtpd_sasl_type = dovecot smtpd_sender_restrictions = reject_unknown_sender_domain smtpd_tls_auth_only = yes smtpd_tls_cert_file = /etc/ssl/certs/ssl-mail.pem smtpd_tls_key_file = /etc/ssl/private/ssl-mail.key smtpd_tls_mandatory_ciphers = medium smtpd_tls_mandatory_protocols = SSLv3, TLSv1 smtpd_tls_received_header = yes smtpd_tls_session_cache_database = btree:${data_directory}/smtpd_scache smtpd_use_tls = yes tls_random_source = dev:/dev/urandom virtual_alias_maps = hash:/etc/postfix/virtual virtual_gid_maps = static:5000 virtual_mailbox_base = /var/mail/vhosts virtual_mailbox_domains = hash:/etc/postfix/vmaildomains virtual_mailbox_limit = 1300000000 virtual_mailbox_maps = hash:/etc/postfix/vmailbox virtual_minimum_uid = 100 virtual_transport = dovecot virtual_uid_maps = static:5000 /etc/postfix/master.cf: + dovecot unix - n n - - pipe + flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/dovecot-lda -f ${sender} -d ${recipient} /var/log/mail.log: Apr 5 16:38:36 qbu postfix/pickup[25470]: BDC3221212: uid=0 from=<root> Apr 5 16:38:36 qbu postfix/cleanup[25500]: BDC3221212: message-id=<20120405073836.BDC3221212@qbu> Apr 5 16:38:36 qbu postfix/qmgr[25471]: BDC3221212: from=<root(a)qbu.example.com>, size=230, nrcpt=1 (queue active) Apr 5 16:38:36 qbu postfix/pipe[25502]: BDC3221212: to=<a(a)example.com>, relay=dovecot, delay=0.04, delays=0.02/0/0/0.02, dsn=4.3.0, status=deferred (temporary failure) Regards, Akihiko

3 5

[Dovecot] Dovecot upgrade from 1.2.x to 2.0.x: roundcube/squirrelmail sent folder doesn't work any more
by Gerhard Wiesinger 05 Apr '12

05 Apr '12

Hello, After upgrading from 1.2.x to 2.0.x I'm having problems using sent folder in Webmail applications like roundcube mail and squirrelmail. Relevant config dovecot.conf: mail_location = mbox:~:INBOX=/var/mail/%u Different LIST behaviour from rawlog: 1.2.x: with Prefix ~/Mail A002 LIST "" "~/Mail/sent" * LIST (\NoInferiors \UnMarked) "/" "~/Mail/sent" A002 OK List completed. 2.0.x: with Prefix ~/Mail A0003 LIST "" ~/Mail/sent A0003 OK List completed.: Configured prefix for private spaces in roundcube mail is ~/Mail . Roundcube Webmail application checks for existence of the folder but dovecot doesn't return anything in 2.x.latest. Is this by design? Any ideas to fix it by configuration? (I tried prefix Mail/ in roundcube mail without success) Thunderbird works well. Thnx. Ciao, Gerhard

2 4

[Dovecot] Modifying LDAP search results for user_attrs
by Patrick Ben Koetter 05 Apr '12

05 Apr '12

I need to authenticate users via LDAP either by mailaddress or login name. In both cases the mailbox location is /src/mail/%d/%n. I can easily deduct that path from the mailaddress, but not so from the login name. Can I get the mail address as part of fetching user_attrs and modify it on the fly? Something along the lines of this: user_attrs = mail:/srv/mail/%d/%n=home,uidNumber=uid,gidNumber=gid Or would I be able to modify this with a post-login script? p@rick -- state of mind () Digitale Kommunikation http://www.state-of-mind.de Franziskanerstraße 15 Telefon +49 89 3090 4664 81669 München Telefax +49 89 3090 4666 Amtsgericht München Partnerschaftsregister PR 563

3 2

[Dovecot] Backtrace on mdbox index
by Francisco Wagner C. Freire 04 Apr '12

04 Apr '12

Hello, I current using dovecot with mdbox and on one account i get this error: doveadm(user@domain): Panic: file mail-index-sync-ext.c: line 209 (sync_ext_reorder): assertion failed: (offset < (uint16_t)-1) doveadm(user@domain): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3fd8a) [0x7fae684fdd8a] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7fae684fde72] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7fae684d719f] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9bdc3) [0x7fae68c1edc3] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_ext_intro+0x1e6) [0x7fae68c1fa76] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0x49f) [0x7fae68c21a3f] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x234) [0x7fae68c225a4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map+0x86) [0x7fae68c13cd6] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x8b609) [0x7fae68c0e609] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_open+0x210) [0x7fae68c0eaa0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x591c6) [0x7fae68bdc1c6] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_map_get_zero_ref_files+0x2d) [0x7fae68bdcd6d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_purge+0xbc) [0x7fae68bde7ac] -> doveadm() [0x40a135] -> doveadm() [0x40a813] -> doveadm(doveadm_mail_single_user+0x61) [0x40a8d1] -> doveadm() [0x40aafd] -> doveadm(doveadm_mail_try_run+0x141) [0x40af11] -> doveadm(main+0x381) [0x4109c1] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7fae67d6ec8d] -> doveadm() [0x409ff9] Aborted All doveadm commands fail on thie error, index / force-resync / search / fetch etc. Any help?

3 6

[Dovecot] imapsync, namespaces and Dovecot 2.x
by Aleix Dorca 04 Apr '12

04 Apr '12

Hi people, I recently tried to migrate from Exchange using imapsync. It didn't work because it complained that dovecot had no namespace capablity. After looking through Dovecot's config files I found that namespaces could be defined, but if you did not a 'private' default one was created. In the 2.x wiki documentation (http://wiki2.dovecot.org/Migration) it says nothing about Namespaces. I don't know if I have to create one or not. If I add the parameters --sep2 . --prefix2 '' to imapsync then it works fine. I'm proxying using dovecot as frontend and backend, version 2.0.18 (The one that comes with Debian Wheezy). Any thoughts, please? Thanks, Aleix.

2 2

[Dovecot] doveadm user -f index
by Micah Anderson 04 Apr '12

04 Apr '12

I've configured my mail_location to have a different location for performance reasons so they aren't in the same location as the mail_location. The 'doveadm user -f home' is useful to find where a user's home directory is for various scripting purposes, but I can't seem to find a way to determine the location of the user's indexes. I can do something with the output of dovecot -a to find the mail_location and then look for a configured INDEX, but then I don't have a good way of translating the %d/%1n/%n type string formatters into their values for a user. thanks for any suggestions! micah --

2 1

[Dovecot] Dovecot and scalable database storage
by list＠airstreamcomm.net 04 Apr '12

04 Apr '12

I saw some interesting mails from TImo back in 2009 talking about the idea of using something like Cassandra db or similar as a storage platform for both email and index/logs. I was wondering if this has been discussed since then, and if there are any plans to support something like this in the future? I have been playing with Cassandra and found that their RackAwareStrategy gives you the ability to replicate writes to as many nodes as you would like, but more importantly what nodes and one of those nodes could be defined by what rack it lives in or what data center it lives in. This means multiple sites high available storage clusters, seemingly a system that dovecot could benefit from in terms of performance and redundancy and simplicity. Any takers?

2 1

[Dovecot] ldap userdb warning in v2.1.1
by Nikolaos Milas 04 Apr '12

04 Apr '12

Hi, I've upgraded from 2.0.13 to 2.1.1 and when I started the service, I got the following warning: Mar 21 10:07:23 imapserver dovecot: master: Dovecot v2.1.1 starting up (core dumps disabled) Mar 21 10:08:17 imapserverdovecot: auth: Warning: ldap: Ignoring changed user_attrs in /etc/dovecot/dovecot-passdb-ldap.conf, because userdb ldap not used. (If this is intentional, set userdb_warning_disable=yes) I didn't see such warnings in 2.0.13. I guess I should/could remove the "user_attrs" line from dovecot-passdb-ldap.conf because it's not needed? (I could also set "userdb_warning_disable=yes" as advised, but I'm trying to figure out what's the real cause of the warning.) The config follows below. Thanks, Nick ============================================================= protocols = imap pop3 mail_location = maildir:~/Maildir/ mail_gid = 502 mail_uid = 502 auth_mechanisms = plain login auth_username_format = %Lu auth_verbose = yes disable_plaintext_auth = no mail_plugins = quota protocol imap { imap_client_workarounds = "delay-newmail " mail_plugins = quota imap_quota } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master info_log_path = log_path = mail_plugins = quota postmaster_address = sysadmin(a)example.com sendmail_path = /usr/lib/sendmail } userdb { args = /etc/dovecot/dovecot-usrdb-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-passdb-ldap.conf driver = ldap } plugin { quota = maildir:User quota quota_rule = *:storage=4G quota_rule2 = Trash:storage=+3%% quota_warning = storage=75%% quota-warning 75 %u quota_warning2 = storage=90%% quota-warning 90 %u } service quota-warning { executable = script /opt/mail1.sh user = vmail unix_listener quota-warning { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service imap-login { service_count = 1 vsz_limit = 64 M } service pop3-login { service_count = 1 vsz_limit = 64 M } ssl_ca = </etc/pki/tls/certs/chain-650.pem ssl_cert = </etc/pki/tls/certs/cert-650.pem ssl_key = </etc/pki/tls/private/key-650.pem syslog_facility = local1 ============================================================= and dovecot-usrdb-ldap.conf is identical to dovecot-passdb-ldap.conf: ============================================================= hosts = localhost tls = no base = ou=people, dc=example, dc=com scope = onelevel ldap_version = 3 dn = uid=authenticate,ou=System,dc=example,dc=com dnpass = secret auth_bind = yes user_filter = (uid=%u) pass_filter = (uid=%u) pass_attrs = uid=user,userPassword=password auth_bind_userdn = uid=%u,ou=people,dc=example,dc=com user_attrs = roomNumber=quota_rule=*:bytes=%$,uid=home=/home/vmail/%u iterate_filter = (objectClass=*) =============================================================

2 2

[Dovecot] dovecot 2.0.19 Panic: file mail-index-sync-ext.c: line 209 (sync_ext_reorder): assertion failed: (offset < (uint16_t)-1)
by Jim Lawson 04 Apr '12

04 Apr '12

Had a user who couldn't access his INBOX: > Mar 21 09:21:17 penguina dovecot: imap([USER]): Panic: file > mail-index-sync-ext.c: line 209 (sync_ext_reorder): assertion fai > led: (offset < (uint16_t)-1) > Mar 21 09:21:17 penguina dovecot: imap([USER]): Error: Raw backtrace: > /usr/lib/dovecot/libdovecot.so.0 [0x342683c660] -> /usr > /lib/dovecot/libdovecot.so.0 [0x342683c6b6] -> > /usr/lib/dovecot/libdovecot.so.0 [0x342683bb73] -> > /usr/lib/dovecot/libdovecot > -storage.so.0 [0x3426c966a8] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_ext_intro+0x240) > [0x3426c979c0] -> / > usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0x401) > [0x3426c99151] -> /usr/lib/dovecot/libdovecot-storage.s > o.0(mail_index_sync_map+0x245) [0x3426c99c55] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map+0x71b) > [0x3426c8afbb > ] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x3426c85d8b] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_open+0x1c > e) [0x3426c8617e] -> > /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0xb5) > [0x3426c4d865] -> /usr/lib/dov > ecot/libdovecot-storage.so.0 [0x3426c75eab] -> > /usr/lib/dovecot/libdovecot-storage.so.0 [0x3426c31006] -> > dovecot/imap [hdtod > d 10.245.30.58 SELECT](cmd_ Stack trace made it look like it was the INBOX, so I deleted the index files for his INBOX and everything was OK. doveconf -n: > # OS: Linux 2.6.18-274.18.1.el5 x86_64 Red Hat Enterprise Linux Server > release 5.8 (Tikanga) > auth_gssapi_hostname = penguina.uvm.edu > auth_krb5_keytab = /etc/krb5.keytab.dovecot > auth_master_user_separator = * > auth_mechanisms = plain login gssapi > base_dir = /var/run/dovecot/ > default_process_limit = 250 > first_valid_uid = 50 > lock_method = flock > login_trusted_networks = [REDACTED] > mail_location = mbox:~/mail:INBOX=/var/spool/mail/%1u/%1.1u/%u > mail_max_lock_timeout = 30 secs > mail_max_userip_connections = 100 > mbox_read_locks = flock > mbox_write_locks = flock > mmap_disable = yes > namespace { > inbox = yes > location = > prefix = > separator = / > type = private > } > namespace { > hidden = yes > list = no > location = > prefix = mail/ > separator = / > type = private > } > namespace { > hidden = yes > list = no > location = > prefix = ~/mail/ > separator = / > type = private > } > namespace { > hidden = yes > list = no > location = > prefix = ~%u/mail/ > separator = / > type = private > } > passdb { > args = /etc/dovecot/passwd.masterusers > driver = passwd-file > master = yes > } > passdb { > driver = pam > } > service imap { > process_limit = 4096 > } > service lmtp { > client_limit = 1 > inet_listener lmtp { > port = 24 > } > } > ssl_cert = <[REDACTED] > ssl_key = < [REDACTED] > userdb { > driver = passwd > } > verbose_proctitle = yes Any questions/suggestions welcome. Jim

2 3

[Dovecot] dovecot-auth restaring and caching
by Angel L. Mateo 04 Apr '12

04 Apr '12

Hello, I'm trying to configure dovecot (2.0.13) to cache user and pass dbs. This a mail server whose purpose is only to deliver messages through dovecot lda. My users are in a ldap server. So I have configure auth_cache_size (with 20MB) and auth_cache_ttl (with 1 day). I have checked that caching is being done, and it is. If a send a message to a user, dovecot looks for it in my ldap server. If then I send another, then it uses cache information. The problem I'm having is that if I have no activity in the server, dovecot stops its auth process and when another message is received, it restarted it, but with an empty cache. This is the auth log for the first message: Mar 22 10:29:41 lynx10 dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Mar 22 10:29:41 lynx10 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Mar 22 10:29:41 lynx10 dovecot: auth: Debug: master in: USER#0111#011amateo#011service=lda Mar 22 10:29:41 lynx10 dovecot: auth: Debug: prefetch(amateo): passdb didn't return userdb entries, trying the next userdb Mar 22 10:29:41 lynx10 dovecot: auth: Debug: userdb-cache(amateo): miss Mar 22 10:29:41 lynx10 dovecot: auth: Debug: ldap(amateo): user search: <search base and filter> fields=irisMailbox,homeDirectory,uidNumber,gidNumber Mar 22 10:29:41 lynx10 dovecot: auth: Debug: ldap(amateo): result: uidNumber(uid)=XXXXX gidNumber(gid)=XXX homeDirectory(home)=XXXXXXXXXX Mar 22 10:29:41 lynx10 dovecot: auth: Debug: master out: USER#0111#011amateo#011uid=XXXXXX#011gid=XXX#011home=XXXXXXXXXXXX And this is the second one, just after a few minutes: Mar 22 10:41:03 lynx10 dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Mar 22 10:41:03 lynx10 dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Mar 22 10:41:03 lynx10 dovecot: auth: Debug: master in: USER#0111#011amateo#011service=lda Mar 22 10:41:03 lynx10 dovecot: auth: Debug: prefetch(amateo): passdb didn't return userdb entries, trying the next userdb Mar 22 10:41:03 lynx10 dovecot: auth: Debug: userdb-cache(amateo): miss Mar 22 10:41:03 lynx10 dovecot: auth: Debug: ldap(amateo): user search: <search base and filter> fields=irisMailbox,homeDirectory,uidNumber,gidNumber Mar 22 10:41:03 lynx10 dovecot: auth: Debug: ldap(amateo): result: uidNumber(uid)=XXXXX gidNumber(gid)=XXX homeDirectory(home)=XXXXXXXXXXX Mar 22 10:41:03 lynx10 dovecot: auth: Debug: master out: USER#0111#011amateo#011uid=XXXXX#011gid=XXX#011home=XXXXXXXXXX This is my configuration: root@lynx10:/etc/dovecot/conf.d# doveconf -n # 2.0.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-4-amd64 x86_64 Ubuntu 10.04.4 LTS auth_cache_size = 20 M auth_cache_ttl = 1 days auth_debug = yes auth_verbose = yes hostname = lynx10 passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_redirects = 15 } postmaster_address = postmaster(a)um.es protocols = " imap lmtp pop3" service auth { unix_listener auth-userdb { mode = 0666 } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" } Any idea? -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337

2 3

[Dovecot] File/folder permission issues in 2.1.3
by Christian Rößner 04 Apr '12

04 Apr '12

Hi, I figured out that Dovecot does not honer secondary groups with auth/auth-worker (??), if doing LDAP/TLS stuff. I had to use file system acls to add the user "vmail" to /etc/ssl/private and to the corresponding key file: doveconf -n # 2.1.3: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-40-generic-pae i686 Ubuntu 10.04.4 LTS auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes hostname = mail.roessner-net.de lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_access_groups = vmail mail_gid = vmail mail_location = mdbox:~/mdbox mail_plugins = autocreate quota acl fts fts_solr zlib mail_log notify mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = children location = mdbox:%%h/mdbox prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox "Deleted Messages" { special_use = \Trash } mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox junkmail { special_use = \Junk } prefix = separator = / type = private } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/var/mail/virtual/shared-mailboxes.db autocreate = Trash autocreate2 = Sent autocreate3 = Drafts autocreate4 = junkmail autosubscribe = Trash autosubscribe2 = Sent autosubscribe3 = Drafts autosubscribe4 = junkmail fts = solr fts_solr = break-imap-search url=http://localhost:8080/solr/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:User quota::file:%h/mdbox/dovecot-quota quota_rule = *:storage=300M:messages=20000 quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } protocols = imap pop3 lmtp sieve service auth-worker { unix_listener auth-worker { user = vmail } user = vmail } service auth { unix_listener auth-userdb { mode = 0600 user = vmail } user = vmail } service dict { unix_listener dict { mode = 0600 user = vmail } } service lmtp { inet_listener lmtp { address = ::1 port = 24 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_ca = </ca/psw_net/SSL123_CA_Bundle.pem ssl_cert = </ca/psw_net/mail_roessner-net_de.crt ssl_key = </ca/psw_net/mail_roessner-net_de.key userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = autocreate quota acl fts fts_solr zlib mail_log notify sieve } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags mail_max_userip_connections = 50 mail_plugins = autocreate quota acl fts fts_solr zlib mail_log notify imap_quota imap_acl imap_zlib } Normally, mail is placed under /var/mail/virtual as user vmail, group vmail. Is there something wrong with my config that prevents switching to secondary groups? /etc/dovecot/dovecot-ldap.conf.ext: uris = ldap://ldap0.roessner-net.de/ ldap://db.roessner-net.de/ sasl_bind = yes sasl_mech = EXTERNAL tls = yes tls_ca_cert_file = /etc/ssl/certs/ca-certificates.crt tls_cert_file = /etc/ssl/certs/mx0.roessner-net.de.pem tls_key_file = /etc/ssl/private/mx0.roessner-net.de.key.pem tls_require_cert = hard base = ou=people,ou=it,dc=roessner-net,dc=de user_attrs = rnsMSQuota=quota_rule=*:storage=%$,rnsMSMailboxHome=home user_filter = (&(objectClass=rnsMSDovecotAccount)(rnsMSRecipientAddress=%u)) pass_attrs = rnsMSDeliverToAddress=user,userPassword=password pass_filter = (&(objectClass=rnsMSDovecotAccount)(rnsMSRecipientAddress=%u)(rnsMSEnableDovecot=TRUE)) iterate_attrs = rnsMSDovecotUser=user iterate_filter = (objectClass=rnsMSDovecotAccount) default_pass_scheme = CRYPT Thanks in advance. -Christian --- Roessner-Network-Solutions Bachelor of Science Informatik Nahrungsberg 81, 35390 Gießen F: +49 641 5879091, M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com

2 1

Re: [Dovecot] Many messages clustered around the same date.saved value
by Joseph Tam 04 Apr '12

04 Apr '12

Timo Sirainen <tss(a)iki.fi> wrote: >>> Which mailbox format? With Maildir the date.saved is taken from >>> dovecot.index.cache file, and in some cases that might get dropped. If >>> it does, then it fallbacks to using the file's ctime. >> >> mbox. > > Ah, with mbox there isn't any usable fallback for date.saved. If it's > not in dovecot.index.cache, the current time is used. I'm a little confused as to why it needed a fallback. In other words, why wasn't date.saved put into the index as soon as the IMAP operation copied it into "Trash"? If this data isn't set at that time, when does it get instantiated? When I actually ask for it? Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] Is it possible to migrating mail to dovecot using imapc?
by Dr Josef Karthauser 04 Apr '12

04 Apr '12

I'm excited to hear that dovecot now supports imap as a mailbox type. I've got a mailbox over on another imap server, which I want to migrate to dovecot. I was wondering whether I could use 'doveadm backup' to setup a two way synchronisation process between the old imap mailbox and the new dovecot mailbox. That way I can do the migration, and can coordinate the mail clients changing where they pick up their email from later. But, I can't find much documentation on imapc, other than it exists. Is this kind of move possible now? Would someone mind giving me some hints as to how to make it work please? Thanks :), Joe

2 9

[Dovecot] dovecot 2.1 breaks FTS + pre-auth?
by dm-list-email-dovecot＠scs.stanford.edu 04 Apr '12

04 Apr '12

Hi. I use dovecot in the simplest possible way, as an IMAP server in pre-auth mode over ssh or just locally over a unix-domain socket (e.g., with offlineimap, which runs much faster using dovecot for the local message store). Ideally I would like to avoid running any extra daemons or setting up anything as root. Until recently, this has worked fine by just setting the CONFIG_FILE environment variable to something in my home directory. Here is my configuration: $ export CONFIG_FILE=$HOME/etc/dovecot.conf $ dovecot -n # 2.1.3: /home/dm/etc/dovecot.conf # OS: Linux 3.2.13-1-ARCH x86_64 mail_location = maildir:~/Mail/inbox mail_plugins = " fts fts_squat" plugin { fts = squat fts_squat = partial=4 full=10 } doveconf: Error: ssl enabled, but ssl_cert not set doveconf: Fatal: Error in configuration file /home/dm/etc/dovecot.conf: ssl enabled, but ssl_cert not set Full text search used to work just fine with this configuration, and still does on a machine I have running dovecot 2.0.13. However, on the machine with 2.1, I get errors about /var/run/dovecot/index not existing. $ printf "a select INBOX\nb search text xyzzy\nc logout\n" \ | /usr/lib/dovecot/imap * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE] Logged in as dm imap(dm): Error: net_connect_unix(/var/run/dovecot/indexer) failed: No such file or directory ... Needless to say, no dovecot.index.search or dovecot.index.search.uids file is created after this error. While I can't write /var/run/dovecot, this is not a permission issue. For example, adding base_dir=/home/dm (my home directory) to the configuration file yields the same error for /home/dm/indexer. I'm guessing something has changed where imap requires an indexer daemon and doesn't launch it in pre-auth mode any more, but I can't find anything about this in the documentation. In short, if anyone can tell me how to use FTS in conjunction with pre-auth mode or point me to a working example, I would appreciate it.

2 1

[Dovecot] 2.1.3: doveadm mailbox delete lost the -s option
by Micah Anderson 04 Apr '12

04 Apr '12

Looks like the recently added -s (for unsubscribing) option to doveadm mailbox delete went missing: root@vireo# /usr/bin/doveadm mailbox delete -u micahtest -s restored delete: invalid option -- 's' doveadm mailbox delete [-u <user>|-A] [-S <socket_path>] [-s] <mailbox> [...] although the option still is shown as valid :) micah --

2 1

[Dovecot] Dovecot stones
by Timo Sirainen 03 Apr '12

03 Apr '12

For the last few days I've been thinking about my company and what it really should do, and as much as the current plan seems reasonable, I think in good conscience I really can't help but to bring up an alternative plan: The support for Dovecot is quite good already, but wouldn't it be better if it was GUARANTEED that your email server was ALWAYS working with zero downtime or other problems? After some thinking, planning and consulting with my spiritual guides I realized I really should just go ahead and do it: From now on you can buy blessed Dovecot stones (http://www.dovecot.org/tmp/stone1.jpg) which are guaranteed to keep your email server running. I don't think there's really any further reason for me to provide commercial support. Probably the whole Dovecot mailing list will be pretty much useless after this as well, so I might as well stop posting there. If you have any problems, you'll just buy a Dovecot stone and the problem will go away. If for any reason that doesn't work, it means that your problem is more difficult than most and you need to buy a few more stones. Please remember that each shipment may take up to 3 weeks to reach you, so get your stones early and in sufficient quantities. A small email server will be happy enough with a single small Dovecot stone, but the more users you have the more stones you'll likely need. This is because most people are rather unhappy with their lives, and they project their negative energies towards their surroundings, including their email servers. To overcome this negative energy you need to have a counterbalancing positive energy, which the Dovecot stones will provide you. The Dovecot stones are hand painted from the finest materials available to the sister of the author of Dovecot that she could find in the local shops. Each stone contains such love and dedication towards the well being of Dovecot that you will shed tears when you lay your eyes upon their physical being. The images provided here unfortunately don't do justice to them. http://www.dovecot.org/tmp/stone2.jpg - This is how i keep my home desktop running all day every day. I have NEVER broken a single hard drive in my life. I don't even bother to keep backups, because I KNOW it is useless for me. A small Dovecot stone can be bought for 10 euros, a medium sized stone for 100 euros and a large stone for 500 euros. Each large stone can usually handle around 1000-2000 users before you need to buy more. If you have millions of users we'll need to find you a larger rock from my parents' backyard. There are only a limited number of such rocks available (we disposed of most of them to our neighbors' yards years ago), so their prices need to be negotiated in advance.

12 12

[Dovecot] Mail migration troubles
by Spyros Tsiolis 03 Apr '12

03 Apr '12

Hello all, OK, I would really appreciate your help on this. I managed to do a pretty straight-forward and flawless migration on dovecot from one domain to another. However, I have this nagging problem with most of the thunderbird MTAs. When I try to delete some "test" messages I sent to make sure that everything works, it comes back with the following message on the bottom of the Thunderbird window : "The current operation on InBox did not succeed. The mail server for account "Account(a)bloomingdomain.gr" responded [TRYCREATE] mailbox doesn't exist : Trash" Now, I know it has to do something with automatically creating a trash folder. But don't know anything more. Could someone shed some light on this ? Dovecot v1.2.15 AFAIK CentOS 5.5 x86 (32-bit) other stuff On Clients : Thunderbird v11.0.1 (XP Pro / 32-bit) s. ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis

3 4

[Dovecot] imapdir still a configuration option?
by Kurt Mosiejczuk 03 Apr '12

03 Apr '12

I've been looking at moving an old IMAPdir-based solution to dovecot. I came across references that dovecot (to my pleasant surprise) added imapdir support in 1.1. However, in trying 2.0.13 (from an OpenBSD package) things start okay, but I see in the logs: "Initialization failed: Initializing mail storage from mail_location setting failed: Unknown mail storage driver imapdir" Poking around in the sources, I still see lots of references to imapdir, but see very little in the documentation. Is IMAPdir still supported in 2.0.x (or even 2.1.x)? I'd prefer not to have to migrate users via renaming, especially since they like the IMAPdir layout for their own searching. --Kurt

2 2

[Dovecot] Connection queue full on dovecot 2.0.13
by Giovanni Mancuso 03 Apr '12

03 Apr '12

Hi, i have a problem with dovecot 2.0.13. I have one dovecot in Front-end that has only: passdb { driver = static args = proxy=y host=10.0.0.6 nopassword=y } In Back-end i have one dovecot that does auth and exports imap/pop3 ports. In dovecot's log of Front-end i see: /Apr 02 14:33:34 imap-login: Info: proxy(//user(a)example.com/ <mailto:amministrazionevendite@pec.gmatica.it>/): started proxying to 10.0.0.6:143: user=<//user(a)example.com/ <mailto:amministrazionevendite@pec.gmatica.it>/>, method=PLAIN, rip=//xx.xx.xx.xx//, lip=xx.xx.xx.xx, TLS Apr 02 14:34:36 imap-login: Info: Disconnected: *Connection queue full *(auth failed, 1 attempts): user=<//user(a)example.com/ <mailto:amministrazionevendite@pec.gmatica.it>/>, method=PLAIN, rip=//xx.xx.xx.xx//, lip=//xx.xx.xx.xx//, TLS/ I see this wiki page: http://wiki2.dovecot.org/LoginProcess but i read: It works by using a number of long running login processes, each handling a number of connections. This loses much of the security benefits of the login process design, because in case of a security hole (in Dovecot or SSL library) the attacker is now able to see other users logging in and steal their passwords, read their mails, etc. Is there another way? Thanks

2 1

[Dovecot] Per-user flags/indexes for shared mailboxes
by Timo Sirainen 03 Apr '12

03 Apr '12

The attached patch adds support for doing e.g.: namespace { type = public prefix = Public/ location = mdbox:/var/lib/public/mdbox:INDEXPVT=~/mdbox/public list = yes } So the private flags are stored in indexes under ~/mdbox/public/, while the shared flags are stored under /var/lib/public/mdbox/. The patch currently hardcodes the shared flags as only MAIL_SEEN. I'm not really sure what would be the best place to configure which flags are private. Perhaps a per-namespace default, but how to configure it per-mailbox? Also per-user keywords aren't currently supported. And it's a little bit annoying that each private flag update must increase the shared modseq for the message, but that can't really be helped. (Alternative would be for each user to have their own private modseqs, which could get difficult.) I'll probably commit this to v2.1 after some more testing.

1 0

[Dovecot] dsync redesign
by Timo Sirainen 03 Apr '12

03 Apr '12

In case anyone is interested in reading (and maybe helping!) with a dsync redesign that's intended to fix all of its current problems, here are some possibly incoherent ramblings about it: http://dovecot.org/tmp/dsync-redesign.txt and even if you don't understand that, here's another document disguising as an algorithm class problem :) If anyone has thoughts on how to solve it, would be great: http://dovecot.org/tmp/dsync-redesign-problem.txt It only deals with saving new messages, not expunges/flag changes/etc, but those should be much simpler.

9 17

[Dovecot] Dovecot 1.2.9. next_uid was lowered
by Müller Lukas 03 Apr '12

03 Apr '12

Hi There A while ago I posted here about a crash of dovecot, that had to do with nfs and was quite certainly due to bad luck. But still one problem persists: We have a Mailbox, that is accessed from multiple users using IMAP. Occasionally all the Emails in the mailbox seem to be missing, when accessing the Mailbox through IMAP, although they're still there on the server. This seems to happen, if the users are accessing the Mailbox on Server1 and at the same time an email gets delivered to the mailbox on server2. Since it happens quite seldom, there must be other conditions or circumstances that have to be met for the problem to occur. Unfortunately I don't know which. Shortly after the mail gets delivered on server2, I get the following errors on server1: mail01 dovecot: IMAP(akzidenz(a)triner.ch): fdatasync(/data/vmail/example.com/user/dovecot-uidlist) failed: Input/output error mail01 dovecot: IMAP(akzidenz(a)triner.ch): /data/vmail/example.com/user/dovecot-uidlist: next_uid was lowered (2143 -> 2142, hdr=2142) The new mail is than missing in the uidlist and as long as no new mail arrives all folders of the mailbox appear to be empty. If a new mail arrives, it will get the uid that should have been given to the pervious mail (the one that caused the error). The previous mail still won't be listed in the uidlist, but everything works as expected. Best regards Lukas Müller Systems Engineer _______________________________________________ NEWMEDIA Südostschweiz Newmedia AG http://www.newmedia.ch<http://www.newmedia.ch/> _______________________________________________ TYPO3 & Drupal - Wir wissen wie. Ihre professionelle Web Agentur in Chur, Ilanz, Glarus und Zürich.

2 1

[Dovecot] setting up ldap for sasl
by jeff donovan 03 Apr '12

03 Apr '12

Greetings im new to the list dovecot --version 2.0.13 ubuntu 11.10 i want to use dovecot to authenticate my ldap users. My local users can authenticate and send email. Using postfix sasl/tls dovecot pam. I have read many docs/tutorials, which all have a plethora of options and information. my file structure is different than most of the documentation. I have ../etc/dovecot.conf which points to. !include_try /usr/share/dovecot/protocols.d/*.protocol !include conf.d/*.conf !include_try local.conf which leads me to /etc/dovecot/conf.d, which is full of config files. All were traditionally located in dovecot.conf in previous versions. im using PAM to authenticate my local system users. I have read that could adjust PAM, to use LDAP. How do I configure dovecot to keep using pam for local users and ldap for remote ? Do i just add the passdb lines dovecot.conf: passdb ldap { args = /etc/dovecot-ldap.conf } userdb prefetch { } # The userdb below is used only by deliver. userdb ldap { args = /etc/dovecot-ldap.conf } dovecot-ldap.conf: pass_attrs = uid=user,userPassword=password, homeDirectory=userdb_home,uidNumber=userdb_uid,gidNumber=userdb_gid # For deliver: user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid any assistance would be helpful. -j

1 2

[Dovecot] Dsync automation
by Jitendra Bhaskar 03 Apr '12

03 Apr '12

Hi, I am using dovecot-2.1.3 on centos 5.7. Its running fine. I have two systems for mail server one is for backup. Currently I am running rsync daily. But I want to use dsync. I went through all the http://wiki2.dovecot.org/Tools/Dsync and http://blog.dovecot.org/2012/02/dovecot-clustering-with-dsync-based.htmlbut I couldn't understood how to automatize dsync. Can anybody give me any idea ho to do it ? -- * Thanks & Regards * *Jitendra Kumar Bhaskar* Cell:- +91 7306311531 +91 8102997821

2 1

Re: [Dovecot] Mail migration troubles
by Spyros Tsiolis 02 Apr '12

02 Apr '12

I have a suspicion that, as usual, no one is going to answer my message. Because of the fact that this is a call for help and no-one ever bothers, I 'll just have to re-phrase my question : Here's what I found on the dovecot wiki : imapsync Here's an example of how to run imapsync for a single user: imapsync --syncinternaldates \ --host1 192.168.1.57 --authmech1 LOGIN --user1 leah(a)example.com --password1 secret \ --host2 127.0.0.1 --authmech2 LOGIN --user2 leah(a)example.com --password2 secret It is quite easy to script this for a number of users, assuming you have their passwords. Even if you do not, imapsync also supports logging in as an admin user that has the ability to copy message for sub users, and a variety of other authentication options. Is the above what I need if I migrate mailboxes FROM dovecot TO dovecot ? E.g. in my example, I only copy mailboxes from an old "user(a)domainA.gr" to "user(a)domainB.gr". Is the above all I need ? Is there a native dovecot tool for this or should I just use imapsync ? Thank you again, s. ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis ----- Original Message ----- > From: Spyros Tsiolis <stsiol(a)yahoo.co.uk> > To: Spyros Tsiolis <stsiol(a)yahoo.co.uk> > Cc: > Sent: Monday, 2 April 2012, 11:24 > Subject: Re: [Dovecot] Mail migration troubles > > Hello again, > > Well, it seems I have trouble with the migration after all. > After the migration and eventhough all folders and messages > are on their respective places, any new mail users get > inside their mailbox cannot be dragged-and-dropped to > their respective folders. > > So, if a user has a folder with my name on it and I send > him an e-mail, the user will try to drag-and-drop that > message to the folder with my name, but the message won't > move. > > Any gurus out there on this ? > Any help would be greatly appreciated. > > spyros > > > > ---- > "I merely function as a channel that filters > music through the chaos of noise" > - Vangelis >

4 9

[Dovecot] strike my last
by Spyros Tsiolis 02 Apr '12

02 Apr '12

strike my last, looks like its a thunderbird issue Apologies... s. ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis

1 0

[Dovecot] Problem compiling dovecot-antispam on Ubuntu 11.10 using Doveot 2.0.13
by Guillaume Hilt 31 Mar '12

31 Mar '12

Hello, Last dovecot available version on Ubuntu 11.10 AMD64 is dovecot 2.0.13. dovecot-antispam package is compiled for dovecot 2.0.15. So, i'm trying to compile a new dovecot antispam plugin. I followed dovecot wiki but i'm running into this error : Successfully compiled dspam.c (plugin). mailbox.c: In function 'antispam_save_begin': mailbox.c:138:12: error: 'struct mail_save_context' has no member named 'copying_via_save' mailbox.c: In function 'antispam_save_finish': mailbox.c:174:12: error: 'struct mail_save_context' has no member named 'copying_via_save' Failed to compile mailbox.c (plugin)! Any hint please ? Regards, -- Guillaume Hilt

2 2

[Dovecot] Problem managing mbox
by PSTM 31 Mar '12

31 Mar '12

Hello, I have a problem with dovecot. seems that do not erase mail that mail client request to be erased. And I have this errors: > Error: Next message unexpectedly corrupted in mbox file Info: > dovecot-2.1.1-2.0.cf.fc16.i686 > root 5979 0.0 0.1 3208 1260 ? Ss 20:18 0:00 > /usr/sbin/dovecot -F > dovenull 5985 0.0 0.2 7060 2280 ? S 20:18 0:00 > dovecot/imap-login > vmail 5988 0.0 0.1 7888 1848 ? S 20:18 0:00 > dovecot/imap permissions on mail dir: > total 4 > drwxr-xr-x 9 vmail mail 4096 ene 21 21:43 vmail Any suggestion? Regards, -- -- http://www.0pc.eu/

3 2

[Dovecot] Proxying Authentication on both sides
by Andy Dills 30 Mar '12

30 Mar '12

I've recently set up a director proxy environment on my test servers, with the intention of deploying on our cluster soon. One thing I found confusing in the proxying documentation [1] was the first bit about their being two ways to do the authentication...either you have the proxy forward the auth to the real server for authentication, or you have the proxy authenticate it and then login to the real server with a master password. Well, we use /bin/checkpassword authentication which hooks into a variety of subsytems for various specific customer needs, and sometimes we need to know the username AND password of the user in order to determine their home directory information. So, using a master password (which requires the back-end server not getting the user password) is out. However, when we have the front-end server do a static director proxy, the problem is that authentication failures are logged on the back-end server with a source IP of the proxy, and no authentication failure with the client IP address is logged on the proxy. So, fail2ban (which is a MUST these days, at least for us) will not be able to properly filter out the brute force attackers. My solution was an alternative: I authenticate with our /bin/checkpassword on the proxy, which authenticates the user and only at that point returns the proxy=y nopassword=y switch to proxy the connection and forward the authentication. As a result, we get logs on the proxy for failed attempts, and the full username and password is supplied to the back-end server for proper processing. Food for thought in case anybody else is implementing this. Thanks, Andy [1] http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy --- Andy Dills Xecunet, Inc. www.xecu.net 301-682-9972 ---

2 3

[Dovecot] Multiple instances
by Timo Sirainen 30 Mar '12

30 Mar '12

v2.1 now saves the base_dir and instance_name to /var/lib/dovecot/instances when starting up. If you have for example two instances with names "backend" and "proxy", you can then use: doveadm -i proxy proxy list instead of something like: doveadm -c /etc/dovecot-proxy/dovecot.conf proxy list The same -i parameter works for all dovecot programs. I also added a couple of new doveadm commands: # doveadm instance list path name last used running /var/run/dovecot proxy 2012-02-06 21:41:39 yes # doveadm instance remove proxy It would be possible to add commands to start/shutdown some/all instances using doveadm, but is it all that useful? I'd guess people would have their own init.d scripts anyway doing that. Anything else that could be useful related to this?

2 2

[Dovecot] IMAP to Maildir Migration preserving UIDs?
by Gedalya 30 Mar '12

30 Mar '12

Hello all, I'm facing the need to migrate from a proprietary IMAP server to Dovecot. The migration must be as smooth and transparent as possible. The mailbox format I would want to use is Maildir++. The storage format used by the current server is unknown, and I don't look forward to trying to reverse-engineer it. This leaves me with the option of reading the mailboxes using IMAP. There are tools like offlineimap or mbsync, and they do store the UID and UIDVALIDITY info. The last piece of the puzzle is a process to properly create the dovecot-uidlist and dovecot-uidvalidity files. So far I wasn't able to find anything on this. Are there any tips? Are there any tools available to do this job, or part of it? In either case I need this done, and I'll have to create whatever I can't find available. If there isn't anything out there that I'm yet to become aware of, then I'm looking at creating something like an offlineimap post-processing routine? Any help would be much appreciated. Gedalya

7 33

[Dovecot] Dovecot migration from any IMAP/POP3 server
by Timo Sirainen 30 Mar '12

30 Mar '12

With the latest hg version / upcoming v2.1.4 you can do a perfect migration to Maildir using imapc/pop3c backends: http://wiki2.dovecot.org/Migration/Dsync The main new feature here is the pop3-migration plugin that matches messages from IMAP and POP3 servers together, so that when dsync needs to request POP3 UIDL for some IMAP message it's actually looked up from the POP3 server.

2 1

[Dovecot] newbie: keep getting same emails in mail client
by neuronetv 30 Mar '12

30 Mar '12

dovecot-2.0.9-2.el6_1.1.i686 I've just set up dovecot in centos 6.2 (server install) and finally got it working (kind of). I set up a unix user (not a virtual user) sent a test email to this user but in my mail client I keep getting this test email over and over again. I don't think the fault is with the email client because other emails work fine and never duplicate and I've tweaked the account settings too, so it must be something I've done wrong in the dovecot setup. Here is my dovecot.conf file: # Dovecot configuration file protocols = pop3 imap disable_plaintext_auth = no mail_location = mbox:~/mail:INBOX=/var/spool/mail/unix-username ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem passdb { driver = pam } userdb { driver = passwd } thanks for any pointers. -- View this message in context: http://old.nabble.com/newbie%3A-keep-getting-same-emails-in-mail-client-tp3… Sent from the Dovecot mailing list archive at Nabble.com.

1 0

[Dovecot] SIS and restoring from backups
by Charles Marcus 29 Mar '12

29 Mar '12

On 2012-03-24 7:49 AM, Timo Sirainen <tss(a)iki.fi> wrote: > This is already optionally done in v2.0+dbox. MIME attachments can be > stored in plain binary form if they can be reconstructed back into > their original form. It doesn't break any signed stuff. Hey Timo, Splitting this off into a separate thread... On the question of the existing SIS capability for attachments... have you given any thought as to how to solve the problem of restoring from backups when SIS is used? I was planning on using it initially, until I read on list that restoring from (normal disk-to-disk) backups would not work when SIS was enabled - this is obviously a deal breaker for anyone who relies on backups - which I would think would be almost everyone? Or maybe I misunderstood the problem? -- Best regards, Charles

2 6

[Dovecot] Sieve fileinto and year/month folders.
by Xavier Beaudouin 29 Mar '12

29 Mar '12

Hi there, I am trying to move from lmtpd (lmtpd.sf.net) to dovecot sieve. One thing used by some of powerusers are archiving mail automatically with autocreated folders based on year + month. Is there any good way to make that with sieve... One example require "fileinto"; if address :is ["From", "To"] "dovecot(a)dovecot.org" { fileinto "INBOX.mls.%Y.%m.dovecot"; } This will fill any mails into INBOX.mls.2012.03.dovecot uppon receiving... I don't know if some sieve guru can tell me how to do that... ? Kind regards, Xavier

4 5

[Dovecot] Problem about dovecot Panic
by FABIO FERRARI 29 Mar '12

29 Mar '12

Good morning, we have 2 Redhat Enterprise 5.7 machines, they are a cluster with some mail services in it (postfix and dovecot 2). The version of dovecot is dovecot-2.0.1-1_118.el5 (installed via rpm). >From last week we have this dovecot problem: suddenly dovecot doesn't accept any new connections, the dovecot.log file reports lines like these Mar 15 12:38:54 secchia dovecot: imap: Panic: epoll_ctl(add, 5) failed: Invalid argument Mar 15 12:38:54 secchia dovecot: imap: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x36ea436de0] -> /usr/lib64/dovecot/libdovecot.so.0 [0x36ea436e3a] -> /usr/lib64/dovecot/ libdovecot.so.0 [0x36ea4362e8] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handle_add+0x118) [0x36ea441498] -> /usr/lib64/dovecot/libdovecot.so.0(io_add+0x8f) [0x36ea440b7f] -> /usr/li b64/dovecot/libdovecot.so.0(master_service_init_finish+0x1c6) [0x36ea430c16] -> dovecot/imap(main+0x10a) [0x41773a] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x36ea01d994] -> dovecot/ imap [0x408179] Mar 15 12:38:54 secchia dovecot: master: Error: service(imap): child 14514 killed with signal 6 (core dumps disabled) Mar 15 12:38:54 secchia dovecot: master: Error: service(imap): command startup failed, throttling Mar 15 12:39:50 secchia dovecot: imap-login: Error: master(imap): Auth request timed out (received 0/12 bytes) Mar 15 12:39:51 secchia dovecot: imap-login: Error: master(imap): Auth request timed out (received 0/12 bytes) Mar 15 12:39:51 secchia dovecot: imap-login: Error: master(imap): Auth request timed out (received 0/12 bytes) Mar 15 12:39:52 secchia dovecot: imap-login: Error: net_connect_unix(imap) failed: Resource temporarily unavailable Mar 15 12:39:52 secchia dovecot: imap-login: Error: net_connect_unix(imap) failed: Resource temporarily unavailable Mar 15 12:39:52 secchia dovecot: imap-login: Error: master(imap): Auth request timed out (received 0/12 bytes) Mar 15 12:39:53 secchia dovecot: imap-login: Error: net_connect_unix(imap) failed: Resource temporarily unavailable Mar 15 12:39:53 secchia dovecot: imap-login: Error: net_connect_unix(imap) failed: Resource temporarily unavailable Mar 15 12:39:54 secchia dovecot: imap-login: Error: net_connect_unix(imap) failed: Resource temporarily unavailable Mar 15 12:39:54 secchia dovecot: imap: Error: Login client disconnected too early Mar 15 12:39:54 secchia dovecot: imap: Error: Login client disconnected too early Mar 15 12:39:54 secchia dovecot: imap: Error: Login client disconnected too early Mar 15 12:39:54 secchia dovecot: imap: Error: Login client disconnected too early Mar 15 12:39:55 secchia dovecot: imap: Panic: epoll_ctl(add, 5) failed: Invalid argument and the kern.log file reports Mar 15 12:38:52 secchia kernel: dlm: closing connection to node 1 Mar 15 12:39:04 secchia kernel: lpfc 0000:83:00.0: 1:(0):2753 PLOGI failure DID:010400 Status:x9/x32900 Mar 15 12:39:04 secchia kernel: lpfc 0000:03:00.0: 0:(0):2753 PLOGI failure DID:010400 Status:x9/x32900 Mar 15 12:41:14 secchia kernel: lpfc 0000:03:00.0: 0:(0):2753 PLOGI failure DID:010400 Status:x9/x32900 Mar 15 12:41:15 secchia kernel: lpfc 0000:83:00.0: 1:(0):2753 PLOGI failure DID:010400 Status:x9/x32900 Mar 15 12:42:11 secchia kernel: dlm: got connection from 1 can you help us? thanks in advance Fabio Ferrari

2 1

[Dovecot] dsync is SLOW compared to rsync
by Jeff Gustafson 29 Mar '12

29 Mar '12

Hi all, We are currently using snapshots and rsync to backup a large mail server to a backup mail server. I have been looking into using dsync to replace rsync in hopes that it would make backups more efficient. I decided to test the performance using a single mailbox. Unfortunately dsync seems to run much slower than rsync. Rsync was able to sync the mailbox in 2 seconds. dsync took over a minute. The test was run so that the source and destination are on the same filesystem. We would like to using the new replication system, but that doesn't seem likely since the performance of the underlying dsync is so much slower than rsync. Even with the extra work that dsync is doing I can't believe the difference in performance would be that great. I realize that dsync is actively being worked on and I hope bringing attention to performance issue will provoke some ideas on how to improve it. Here is the output of the tests using dovecot 2.1.3: [root@n24 bu]# du -hs /home/10.0.1.101/1009/users/testuser% domain.com/Maildir/ 517M /home/10.0.1.101/1009/users/testuser%domain.com/Maildir/ [root@n24 bu]# time rsync -va /home/10.0.1.101/1009/users/testuser% domain.com/Maildir/ . sending incremental file list Maildir/ Maildir/dovecot-uidlist [ ... deleted cruft ... ] Maildir/cur/1332387577.M381054P27635.n24,S=14215502,W=14448554:2, Maildir/new/ Maildir/tmp/ sent 540927820 bytes received 1222 bytes 216371616.80 bytes/sec total size is 540855755 speedup is 1.00 real 0m2.677s user 0m3.184s sys 0m1.513s [root@n24 bu]# time dsync backup -u testuser(a)domain.com \ mdbox:/home/bu/testuser real 1m9.519s user 1m7.592s sys 0m1.126s [root@n24 bu]# time dsync backup -u testuser(a)domain.com \ sdbox:/home/bu/testuser2 real 1m2.164s user 1m0.882s sys 0m0.993s [root@n24 bu]#

7 15

[Dovecot] Dovecot 1.2.9 Crash, NFS
by Müller Lukas 29 Mar '12

29 Mar '12

Hi, I'm stuck with a problem we have with dovecot. My suspicion is, that it has to do with accessing the same mailbox/mail stored on a NFS-share from two machines at the same time. setup We have to mail servers running, both run a Ubuntu 10.04, Postfix 2.70 and Dovecot 1.2.9. The mailboxes are stored in maildir format on a NFS-Share. In front of those to mail servers we have a load balancer. Unfortunately it can't be set up to use the same server for each domain, but it uses the same server for the same source-ip for at least 1 hour. Here is the output of dovecot -n: # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-33-server x86_64 Ubuntu 10.04.3 LTS nfs log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s ssl_ca_file: /etc/ssl/ca-bundle/SSL123_CA_Bundle.pem ssl_cert_file: /etc/ssl/mail.newmedia.ch/mail.newmedia.ch.crt ssl_key_file: /etc/ssl/mail.newmedia.ch/mail.newmedia.ch.key ssl_verify_client_cert: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_max_userip_connections: 25 mail_privileged_group: mail mail_location: maildir:/data/vmail/%d/%n:INDEX=/data/vmail/%d/%n/indexes mmap_disable: yes dotlock_use_excl: no mail_nfs_storage: yes mail_nfs_index: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): auth default: passdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf plugin: quota: maildir:storage=409600 sieve_global_path: /data/vmail/globalsieverc dict: quotadict: mysql:/etc/dovecot-dict-quota.conf problem the problem happens with a client's mailbox that is used by multiple users. >From time to time he cannot see any Emails in the mailbox, neither with his mail clients (Apple Mail) nor with in the webmail (Roundcube). Around this time I get the following entries in the log files: Mar 6 08:26:31 mail02 dovecot: IMAP(user(a)example.com): fdatasync(/data/vmail/example.com/user/dovecot-uidlist) failed: Input/output error Mar 6 08:42:29 mail02 dovecot: IMAP(user(a)example.com): Maildir /data/vmail/example.com/user: Expunged message reappeared, giving a new UID (old uid=1522, file=1326961561.V15I4d8562M567017.mail02:2,Sad) Mar 6 08:42:29 mail02 dovecot: IMAP(user(a)example.com): Maildir /data/vmail/example.com/user: Expunged message reappeared, giving a new UID (old uid=1523, file=1326705103.V15I90105M613353.mail01:2,Sad) Mar 6 08:42:29 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 4: 1326961561.V15I4d8562M567017.mail02:2,Sad (uid 1522 -> 1598) Mar 6 08:42:29 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 5: 1326705103.V15I90105M613353.mail01:2,Sad (uid 1523 -> 1599) Mar 6 08:42:30 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 4: 1326961561.V15I4d8562M567017.mail02:2,Sad (uid 1522 -> 1598) Mar 6 08:42:30 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 5: 1326705103.V15I90105M613353.mail01:2,Sad (uid 1523 -> 1599) Mar 6 08:42:30 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 4: 1326961561.V15I4d8562M567017.mail02:2,Sad (uid 1522 -> 1598) Mar 6 08:42:30 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 5: 1326705103.V15I90105M613353.mail01:2,Sad (uid 1523 -> 1599) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): Maildir /data/vmail/example.com/user: Expunged message reappeared, giving a new UID (old uid=1524, file=1327500903.V15I5722c8M210039.mail01:2,Se) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 6: 1327500903.V15I5722c8M210039.mail01:2,Se (uid 1524 -> 1600) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): Panic: file maildir-uidlist.c: line 403 (maildir_uidlist_records_array_delete): assertion failed: (pos != NULL) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): Raw backtrace: imap(+0xaeb5a) [0x7f37602b8b5a] -> imap(+0xaebc7) [0x7f37602b8bc7] -> imap(+0xae238) [0x7f37602b8238] -> imap(+0x497d7) [0x7f37602537d7] -> imap(maildir_uidlist_refresh+0x6f2) [0x7f37602545c2] -> imap(+0x4bb06) [0x7f3760255b06] -> imap(maildir_uidlist_sync_init+0x4d) [0x7f376025652d] -> imap(+0x46ed4) [0x7f3760250ed4] -> imap(maildir_storage_sync_init+0x147) [0x7f3760251557] -> imap(imap_sync_init+0x70) [0x7f376023b190] -> imap(+0x2411e) [0x7f376022e11e] -> imap(io_loop_handle_timeouts+0xcc) [0x7f37602c069c] -> imap(io_loop_handler_run+0x60) [0x7f37602c1000] -> imap(io_loop_run+0x18) [0x7f37602c0448] -> imap(main+0x58e) [0x7f376023bc5e] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f375f877c4d] -> imap(+0x21979) [0x7f376022b979] Mar 6 08:42:31 mail02 dovecot: dovecot: child 16934 (imap) killed with signal 6 (core dumps disabled) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 6: 1327500903.V15I5722c8M210039.mail01:2,Se (uid 1524 -> 1600) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): Panic: file maildir-uidlist.c: line 403 (maildir_uidlist_records_array_delete): assertion failed: (pos != NULL) Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): Raw backtrace: imap(+0xaeb5a) [0x7ff81b415b5a] -> imap(+0xaebc7) [0x7ff81b415bc7] -> imap(+0xae238) [0x7ff81b415238] -> imap(+0x497d7) [0x7ff81b3b07d7] -> imap(maildir_uidlist_refresh+0x6f2) [0x7ff81b3b15c2] -> imap(maildir_uidlist_sync_init+0x105) [0x7ff81b3b35e5] -> imap(+0x46ed4) [0x7ff81b3aded4] -> imap(maildir_storage_sync_force+0x52) [0x7ff81b3ae392] -> imap(maildir_file_do+0x99) [0x7ff81b3b3cb9] -> imap(+0x4d944) [0x7ff81b3b4944] -> imap(index_mail_set_seq+0x148) [0x7ff81b3c8ed8] -> imap(index_storage_search_next_nonblock+0x162) [0x7ff81b3cd622] -> imap(mailbox_search_next_nonblock+0x20) [0x7ff81b3db2c0] -> imap(mailbox_search_next+0x26) [0x7ff81b3db316] -> imap(imap_fetch_more+0x2bf) [0x7ff81b39295f] -> imap(cmd_fetch+0x36c) [0x7ff81b38a9ec] -> imap(+0x28fad) [0x7ff81b38ffad] -> imap(+0x2908d) [0x7ff81b39008d] -> imap(client_handle_input+0x135) [0x7ff81b3902c5] -> imap(client_input+0x5f) [0x7ff81b390baf] -> imap(io_loop_handler_run+0xbd) [0x7ff81b41e05d] -> imap(io_loop_run+0x18) [0x7ff81b41d448] -> Mar 6 08:42:31 mail02 dovecot: IMAP(user(a)example.com): imap(main+0x58e) [0x7ff81b398c5e] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7ff81a9d4c4d] -> imap(+0x21979) [0x7ff81b388979] Mar 6 08:42:31 mail02 dovecot: dovecot: child 13712 (imap) killed with signal 6 (core dumps disabled) Mar 6 08:42:31 mail01 dovecot: IMAP(user(a)example.com): /data/vmail/example.com/user/dovecot-uidlist: Duplicate file entry at line 4: 1326961561.V15I4d8562M567017.mail02:2,Sad (uid 1522 -> 1598) Mar 6 08:42:31 mail01 dovecot: IMAP(user(a)example.com): Panic: file maildir-uidlist.c: line 403 (maildir_uidlist_records_array_delete): assertion failed: (pos != NULL) Mar 6 08:42:31 mail01 dovecot: IMAP(user(a)example.com): Raw backtrace: imap(+0xaeb5a) [0x7f4a311fcb5a] -> imap(+0xaebc7) [0x7f4a311fcbc7] -> imap(+0xae238) [0x7f4a311fc238] -> imap(+0x497d7) [0x7f4a311977d7] -> imap(maildir_uidlist_refresh+0x6f2) [0x7f4a311985c2] -> imap(+0x47023) [0x7f4a31195023] -> imap(maildir_storage_sync_init+0x147) [0x7f4a31195557] -> imap(imap_sync_init+0x70) [0x7f4a3117f190] -> imap(+0x2411e) [0x7f4a3117211e] -> imap(+0x64c0e) [0x7f4a311b2c0e] -> imap(io_loop_handle_timeouts+0xcc) [0x7f4a3120469c] -> imap(io_loop_handler_run+0x60) [0x7f4a31205000] -> imap(io_loop_run+0x18) [0x7f4a31204448] -> imap(main+0x58e) [0x7f4a3117fc5e] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f4a307bbc4d] -> imap(+0x21979) [0x7f4a3116f979] Mar 6 08:42:31 mail01 dovecot: dovecot: child 24257 (imap) killed with signal 6 (core dumps disabled) Note: the first part is on a mail server, while the smaller second part is on the other one. Unfortunately I'm not able to reproduce this error. My suspicion/speculation what happens is the following: Multiple users are accessing the Mailbox from their offices (all on the same server), one (or more) uses the Webmail or accesses the Mailbox from a different IP. Somehow this leads to problems with Locks on NFS, which leads to the crash. I have no idea how to solve this problem and any help is greatly appreciated. If you need further information, please say so. Mit freundlichen Grüssen Lukas Müller Systems Engineer _______________________________________________ NEWMEDIA Südostschweiz Newmedia AG Kasernenstrasse 1 Postfach 508, CH-7007 Chur http://www.newmedia.ch<http://www.newmedia.ch/> _______________________________________________ TYPO3 & Drupal - Wir wissen wie. Ihre professionelle Web Agentur in Chur, Ilanz, Glarus und Zürich.

2 3

Re: [Dovecot] Many messages clustered around the same date.saved value
by Joseph Tam 29 Mar '12

29 Mar '12

Timo Sirainen wrote: >> However, I noticed a strange thing: querying what would have been >> deleted >> >> doveadm -ftab fetch -A "date.saved" mailbox Trash savedbefore 7d >> >> showed many date.saved values are clustered around the same timestamp, >> even among different user's Trash mailbox. >> ... >> I can't explain why many different users would have messages with the >> same (or closeby) date.saved value. > > Which mailbox format? With Maildir the date.saved is taken from > dovecot.index.cache file, and in some cases that might get dropped. If > it does, then it fallbacks to using the file's ctime. mbox. A further look into this reveals that the clustered date.saved values are the earliest values for every mailbox in the system. This timestamp is close to the time I was testing "doveadm ... -A", so the likely explanation is that I accidentally deleted/updated these values using some variation of doveadm, even though I remember confining my testing to query/search/fetch. This appears to be a case of PEBKAC. These "wrong" values shouldn't cause problems with expunge queries since they err on the side of safety. Thanks for the insight though. Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] doveadm purge on clusterfs
by Jan-Frode Myklebust 29 Mar '12

29 Mar '12

Since doveadm service proxying apparently doesn't work with dovecot v2.0, we need to find a way to safely run doveadm purge on the host the user is logged into. Would it be OK to run purge in the pop/imap postlogin scripts? We already do a conditional: test /var/log/activemailaccounts/imap/$USER -ot /var/log/activemailaccounts/today then touch /var/log/activemailaccounts/imap/$USER fi so adding a: doveadm purge -u $USER in this section would make it run once every day the users that log in. Does that sound like an OK solution? -jf

2 1

[Dovecot] Dovecot / IMAP / New Mails are not shown unless you open the folder in Outlook
by stonegate 29 Mar '12

29 Mar '12

Hi, i use dovecot 2.1.3 on a gentoo system. Before i installed my new imap server box, everything worked. Now with Dovecot it does not. Problem: When i receive a new email, it does not appear in my Outlook unless i have the IMAP Inbox Folder open (highlighted selection). Sometimes i have new mail in my inbox for over 15 Minutes and i dont realize it unless i click on the inbox folder. Before that problem occured on my old system ( i think it was dovecot as well ) the inbox folder refreshed automatically and i instantly knew when i had new emails. It was kind of like with my exchange account. Does anyone have a clue what might be wrong ? Since i did not re-install outlook or something it cannot be a client thing since no settings changed on the client side. Maybe i have to do something with dovecots config file? I think it should keep the connection to the server open or something. I´d appreciate any kind of help. Thanks alot Stoney Dovecot is capable of the following things: telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. Thats my dovecot.conf: # 2.1.3: /etc/dovecot/dovecot.conf # OS: Linux 3.2.1-gentoo-r2 x86_64 Gentoo Base System release 2.0.3 auth_mechanisms = plain login listen = * disable_plaintext_auth = no mail_location = maildir:~/.maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } #passdb { # args = * # driver = pam #} #passdb { # args = /etc/dovecot/dovecot-sql.conf.ext # driver = sql #} passdb { driver = shadow } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } ssl_cert = </etc/ssl/dovecot/servercert.pem ssl_key = </etc/ssl/dovecot/serverkey.pem userdb { driver = passwd } #userdb { # args = /etc/dovecot/dovecot-sql.conf.ext # driver = sql #} userdb { driver = passwd -- View this message in context: http://old.nabble.com/Dovecot---IMAP---New-Mails-are-not-shown-unless-you-o… Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] zlib_save per namespace/mailbox?
by Lutz Preßler 29 Mar '12

29 Mar '12

Hi, the zlib_save question reminds me of a wish: I think it's not possible to set zlib_save parameter per namespace (or even mailbox). Per namespace would be something for the wish list to get rid of the cron job method to compress archival mailboxes. And maybe an option to add a "Z" flag to compressed maildir message files as recommended in the wiki regarding compress crob job. Lutz

3 2

[Dovecot] Shared mailboxes with dovecot problem service=lib-storage
by Tomislav Mihalicek 29 Mar '12

29 Mar '12

Hi Could someone explain what this strings mean in dovecot 2.1.3 debug log? Mar 27 11:18:11 cartman dovecot: auth: Debug: master in: USER 1 test1(a)example.net service=lib-storage Mar 27 11:18:11 cartman dovecot: auth: Debug: master in: USER 2 test2(a)example.net service=lib-storage -- View this message in context: http://old.nabble.com/Shared-mailboxes-with-dovecot-problem-service%3Dlib-s… Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] Namespace, prefix questions
by Steve Campbell 29 Mar '12

29 Mar '12

We've got some users who are using Outlook Express version 6. The client allows me to specify the root folder, but not a prefix or namespace. I'm still struggling with some users on our new server that have crazy imap folder layouts, so I've got a few questions. When I specify the root folder, does that bypass any namespace/prefix definitions on the imap server? On some clients, like Thunderbird, I have the option of specifying namespace OR prefix. How do these differ? I thought that the prefix was the "name" of the namespace. It appears that I have to delete and re-create the account on these OE 6 clients to make the list of folders show properly. Does that sound right? This all came about because one of these OE 6 users was not able to use their imap folders (server errors). Turns out it was one of the users that had their folders directly under ~. So I moved them to ~/mail, created a .subscriptions file from their .mailboxlist file and tried everything in the world to get the folders to list properly. Only after specifying the root folder as ~/mail after recreating the account and restarting OE did it show properly and the folders remained listed. My default config has this setup as the "mail_location" parm, but blanks as the root folder don't seem to work in this situation. I'm also wondering where I specify the "list", "hidden" and other parms that are usually set in namespace blocks. dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-220.4.1.el6.x86_64 x86_64 CentOS release 6.2 (Final) disable_plaintext_auth = no listen = * mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u mbox_write_locks = fcntl namespace { hidden = yes inbox = yes list = yes location = mbox:~/mail:INBOX=/var/spool/mail/%u prefix = separator = / type = private } namespace { hidden = yes list = no location = mbox:~/mail:INBOX=/var/spool/mail/%u prefix = "#mbox/" separator = / type = private } namespace { hidden = yes list = no location = prefix = mail/ separator = / type = private } namespace { hidden = yes list = yes location = mbox:~/mail:INBOX=/var/spool/mail/%u prefix = ~/mail/ separator = / type = private } namespace { hidden = yes list = no location = prefix = ~%u/mail/ separator = / type = private } passdb { driver = pam } protocols = pop3 imap ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } Thanks steve campbell Thanks steve campbell

2 2

[Dovecot] fts-solr not indexing body content
by Bård Johannessen 29 Mar '12

29 Mar '12

This could easily be me missing something, but I can't seem to get the fts-solr plugin to index message bodies. Tcpdump shows me the following being sent from Dovecot to Solr as a messages is indexed: <add><doc><field name="uid">6549</field><field name="box">fde08816e80d6b4f26650000b5f0b4b2</field><field name="user">user</field><field name="id">6549/fde08816e80d6b4f26650000b5f0b4b2/user</field><field name="body"> </field><field name="hdr">Return-path: ... As you can see, the <field name="body"/>-node contains just an empty line. The above is just a snippet to illustrate the problem. A full dump can be found at the following URL: http://db.org/temp/solr.xml.txt Full text search is configures such: plugin { fts = solr fts_solr = break-imap-search url=http://127.0.0.1:8080/solr/ } So; am I missing something, or is this a Dovecot problem? dovecot.conf: http://db.org/temp/dovecot.conf Regards, Bård Johannessen

2 4