- dovecot - dovecot.org

[Dovecot] Use Replication plugin to do a backup (one-direction sync)
by Francesco Barresi 09 Dec '13

09 Dec '13

Hello, I have a setup where I need to have Server A (dovecot 2.1.7) replicated on a Server B (dovecot 2.1.7). I know that I can do a per user backup with: doveadm -D backup -u %u remote:mailmirror@serverB I would like to use Notify/Replication to backup only when there's something new. I don't understad if the Replication plugin can be used to do a backup server, or it's only of for two-way sync? My question is: It's possible to use Replication to do a backup (one-direction sync)? Thanks Francesco

1 0

[Dovecot] backup mdbox best strategy
by Claus 09 Dec '13

09 Dec '13

Hello, i have to backup (tape library) a mailsystem with about 300.000 Mailboxes on 2 backends. Summary of all mailboxes are 2 TByte. The mailstore is mdbox. Is it save to do a simple filesystem backup (full and incremental) with backupsoftware? What is the prefered strategy to do a backup for desaster recovery (mailsystem crash) and restoring single usermailboxes? Regards, Claus

5 9

[Dovecot] Expire plugin - empty expires table
by Peter Šori 09 Dec '13

09 Dec '13

Hello, Dovecot does not fill expires table when moving messages to Trash or Junk folder. I looked all over mailing list and googled around and cannot find what could be wrong - pleas help :) Dict works for quota, so I presume connection to mysql is not a problem - mailuser has Select,Insert,Update,Delete privileges over quota and expires table (log below for deleting message) dovecot log does not show any problems, not even with mail_debug. doveadm -A works ____________________________________________________________________________ ________________________ dovecot -n # 2.2.6: /etc/dovecot/dovecot.conf # OS: Linux 3.10.17-gentoo x86_64 Gentoo Base System release 2.2 xfs auth_mechanisms = plain login dict { expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } hostname = ****(a)****.**** listen = ************* login_greeting = ***** ready. mail_access_groups = vmail mail_attachment_dir = /data/vmail/attachments mail_attachment_fs = sis-queue /data/vmail/attachments/queue:posix mail_attachment_hash = %{sha256} mail_location = mdbox:/data/vmail/storage/%d/%n/:ALT=/data/vmail/altstorage/%d/%n/:INDEX=/da ta/vmail/indexes/%d/%n/ mail_plugins = " expire quota zlib mail_log notify" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_preallocate_space = yes mdbox_rotate_interval = 1 days namespace Unwanted { hidden = no inbox = no list = yes location = maildir:/data/vmail/unwanted/%d/%n/ mailbox Ham { auto = subscribe } mailbox Spam { auto = subscribe } prefix = Unwanted. separator = . subscriptions = yes type = private } namespace inbox { hidden = no inbox = yes list = yes location = mdbox:/data/vmail/storage/%d/%n/:ALT=/data/vmail/altstorage/%d/%n/:INDEX=/da ta/vmail/indexes/%d/%n/ mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Folders { auto = subscribe } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { expire = Trash 1 Trash.* 1 Junk 2 expire_dict = proxy::expire mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid from subject, size, vsize, flags quota = dict:User quota::proxy::quota quota_exceeded_message = Quota exceeded (mailbox is full) quota_grace = 10%% quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_rule3 = Junk:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=85%% quota-warning 85 %u quota_warning3 = storage=70%% quota-warning 70 %u sieve = /data/vmail/sieve/%d/%n/.dovecot.sieve sieve_before = /data/vmail/sieve/before.sieve sieve_default = /data/vmail/sieve/default.sieve sieve_dir = /data/vmail/sieve/%d/%n/sieve sieve_global_dir = /data/vmail/sieve/ zlib_save = bz2 zlib_save_level = 9 } postmaster_address = postmaster(a)fingerprints.si protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service dict { unix_listener dict { group = vmail mode = 0660 } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/bin/dovecot-quota-warning.sh unix_listener quota-warning { mode = 0666 user = vmail } user = vmail } ssl_cert = </etc/ssl/certs/san_*****.****-2048.crt ssl_key = </etc/ssl/private/san_*****.****-2048.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = expire sieve zlib } protocol imap { mail_plugins = " expire quota zlib mail_log notify expire imap_quota quota" } protocol sieve { managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } ____________________________________________________________________________ ________________________ dovecot-dict-sql.conf.ext connect = host=127.0.0.1 dbname=mailserver user=mailuser password=************************* map { pattern = priv/quota/storage table = quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } } ____________________________________________________________________________ ________________________ dovecot-sql.conf.ext driver = mysql connect = host=127.0.0.1 dbname=mailserver user=mailuser password=************************* default_pass_scheme = PLAIN-MD5 iterate_query = SELECT email AS user FROM virtual_users password_query = SELECT email AS user, password, \ uid AS userdb_uid, gid AS userdb_gid, \ concat('*:bytes=', quota_bytes) AS userdb_quota_rule \ FROM virtual_users WHERE email = '%u' user_query = SELECT uid, gid, \ CONCAT('/data/vmail/storage/',CONCAT(SUBSTRING_INDEX(email,'@',-1),'/',SUBST RING_INDEX(email,'@',1))) AS home, \ CONCAT('*:bytes=', quota_bytes) AS quota_rule \ FROM virtual_users WHERE email = '%u' ____________________________________________________________________________ ________________________ MYSQL: +-----------+------------+-------------+------------+----------------+------ ---------------+------------------------------------------------------------ ----------------------------------+-------------+ | Host | Db | User | Table_name | Grantor | Timestamp | Table_priv | Column_priv | +-----------+------------+-------------+------------+----------------+------ ---------------+------------------------------------------------------------ ----------------------------------+-------------+ | 127.0.0.1 | mailserver | mailuser | quota | root@localhost | 2013-12-06 02:14:57 | Select,Insert,Update,Delete | | | 127.0.0.1 | mailserver | mailuser | expires | root@localhost | 2013-12-08 05:49:42 | Select,Insert,Update,Delete | | +-----------+------------+-------------+------------+----------------+------ ---------------+------------------------------------------------------------ ----------------------------------+-------------+ mysql> describe expires; +--------------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +--------------+--------------+------+-----+---------+-------+ | username | varchar(75) | NO | PRI | NULL | | | mailbox | varchar(255) | NO | PRI | NULL | | | expire_stamp | int(11) | NO | | NULL | | +--------------+--------------+------+-----+---------+-------+ mysql> select * from expires; Empty set (0.00 sec) MYSQL LOG: 1 Query SELECT email AS user, password, uid AS userdb_uid, gid AS userdb_gid, concat('*:bytes=', quota_bytes) AS userdb_quota_rule FROM virtual_users WHERE email = '*********************' 2 Connect mailuser@************* on mailserver 2 Query BEGIN 1 Query SELECT uid, gid, CONCAT('/data/vmail/storage/',CONCAT(SUBSTRING_INDEX(email,'@',-1),'/',SUBST RING_INDEX(email,'@',1))) AS home, CONCAT('*:bytes=', quota_bytes) AS quota_rule FROM virtual_users WHERE email = '*********************' 2 Query UPDATE quota SET bytes=bytes-15989,messages=messages-1 WHERE username = '*********************' 2 Query COMMIT 2 Query SELECT bytes FROM quota WHERE username = '*********************' 2 Query SELECT messages FROM quota WHERE username = '*********************' 2 Query SELECT bytes FROM quota WHERE username = '*********************' 2 Query BEGIN 2 Query UPDATE quota SET bytes=bytes+16025,messages=messages+1 WHERE username = '*********************' 2 Query COMMIT 2 Query SELECT bytes FROM quota WHERE username = '*********************' 2 Query SELECT messages FROM quota WHERE username = '*********************'

2 2

[Dovecot] [PATCH] lib-sql/driver-mysql.c - Add support for enabling MYSQL_OPT_SSL_VERIFY_SERVER_CERT
by Gareth Palmer 09 Dec '13

09 Dec '13

Hello, The following patch adds support for enabling MYSQL_OPT_SSL_VERIFY_SERVER_CERT. It makes the mysql client library check that the commonName in the server's SSL certificate matches the host name provided to mysql_real_connect() and aborts the connection if the name doesn't match. An example connect string would look something like: connect = ... ssl-ca=/path/to/ca.cert ssl-verify-server-cert=yes By default the mysql client library does not perform this check.

3 7

[Dovecot] dovecot.index-Errors with multiple IMAP client access in Dovecot 2.2
by Martin Rabl 08 Dec '13

08 Dec '13

Hello list, I hope you can help me! My self-compiled dovecot 2.2.6 (and the two minor versions before, too) throws that errors: Nov 28 18:29:00 mailserv dovecot: imap(martin(a)example.com): Error: Transaction log /srv/vmail/example.com/martin/Maildir/dovecot.index.log: duplicate transaction log sequence (25) Nov 28 18:29:00 mailserv dovecot: imap(martin(a)example.com): Error: /srv/vmail/example.com/martin/Maildir/dovecot.index log position went backwards (24,40 < 25,10028) ... and so on ... duplicate transaction log sequences and backwards gone log positions, and this always, when I use at least two IMAP clients at the same time (better: the two clients are online and logged in at the same time). That happens only with one user (me ;-) ), the other about 15 users on this server are having no problems. What I see: the clients are bothering each other, but I don't know, why. I thought about the used reiserfs filesystem on the server, but there were no problems with 1.2 on the same server. Some words about my client setup: I use Thunderbird and iPhone at the same time, and as a third client on the same Server there is a Thunderbird instance at my company, which runs parallel to the other two. Seems to be weired, but isn't really (IMHO ;-) ). Sometimes there are two TBs at the same mailbox, sometimes only the iPhone and a TB, sometimes all three. This runs quite good for long time with dovecot 1.2 and 2.1.x (the last one at my company in a similary setup with more users and several clients at the same time). Maybe there is an error by using "my" build configurations (I think, not)? ---- configures ------------------- ./configure \ --prefix=/usr/local \ --with-sql \ --with-ssl \ --with-mysql ----------------------------------- Here are my dovecot.conf (only the changes of defaults) - maybe there is a misconfiguration? ---- dovecot.conf ----------------- # 2.2.6: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-028stab101.1 x86_64 Ubuntu 10.04.4 LTS reiserfs auth_master_user_separator = * auth_mechanisms = plain login auth_socket_path = /usr/local/var/run/dovecot/auth-master default_internal_user = vmail default_login_user = vmail dict { acl = mysql:/etc/dovecot/dovecot-dict-acl-sql.conf.ext } disable_plaintext_auth = no imap_capability = +NAMESPACE imap_client_workarounds = delay-newmail tb-lsub-flags tb-lsub-flags tb-extra-mailbox-sep listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c mail_access_groups = vmail mail_location = maildir:/srv/vmail/%d/%n/Maildir mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify namespace { list = yes location = maildir:%%Lh/Maildir/:INDEX=%%Lh/shared-idx/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { hidden = no list = yes location = maildir:/srv/vmail/public prefix = public/ separator = / subscriptions = no type = public } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Spam autosubscribe3 = Sent autosubscribe4 = Drafts sieve = ~/.dovecot.sieve sieve_after = /srv/vmail/sieve/after.sieve sieve_before = /srv/vmail/sieve/before.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_dir = /srv/vmail/sieve sieve_global_path = /srv/vmail/sieve/globalsieverc } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh postmaster_address = postmaster@%d protocols = imap pop3 quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service imap { process_limit = 2048 vsz_limit = 256 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = " sieve" } protocol imap { mail_plugins = acl imap_acl } protocol sieve { managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags } local 1.2.3.4 { ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem } ----------------------------------- Thank you very much for your time and help! Greetings, Martin

2 1

[Dovecot] shared folder - ACL
by Héctor Moreno Blanco 08 Dec '13

08 Dec '13

Hello everyone, I've trying to configure shared folders in dovecot 2.1.6 without success. My configuration is: mail_plugins = quota autocreate mail_log notify acl ... plugin { ... acl_shared_dict = file:/etc/dovecot/shared-mailboxes.db ... } Protocol imap { ... mail_plugins = imap_quota imap_acl ... } When I try to set acl to a folder: a02 setacl inbox.test1 user1 lr a02 BAD Error in IMAP command SETACL: ACLs disabled. In the logs, I can see: dovecot: imap(testing_ddfr): Debug: acl: No acl setting - ACLs are disabled What am I missing? Thank you very much in advanced. Kind regards. Héctor Moreno Blanco. P Please consider the environment before printing this e-mail. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________

3 3

[Dovecot] imap list response has an extra field on some mailboxes.
by Kui Zhang 08 Dec '13

08 Dec '13

Hello, per rfc3501 7.2.2. LIST Response Contents: name attributes hierarchy delimiter name Dovecot: 2.1.16 /usr/lib/dovecot/imap -u user(a)domain.tld list "" "*" Most responses are correct. But some appears to not be. """ * LIST (\HasNoChildren) "/" {117} path/to/"part_mailbox_name" other_parts * LIST (\HasNoChildren) "/" {10} "test" box """ char after {117} appears to be \n. All affected mailboxes appears to have ' " ' in mailbox name. And the number between '{' '}' appears to be the length of the path. Anyone ran into this issues before? If so, how to fix it? Is it a bug? Other rfc I should read? Thanks Kui.Z

2 1

[Dovecot] Panic in indexer-worker
by Michael Kliewe 08 Dec '13

08 Dec '13

Hi, I did a fresh installation of 2.2.9 in my test environment and enabled fts_autoindex=yes. I'm using a solr-server for FTS. I got this error, just once until now: _=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_= ==> dovecot-lmtp-errors.log <== Dec 03 16:15:06 lmtp(30601, username(a)domain.de) Error: Timeout (29s) while waiting for lock for transaction log file /maildata/domain.de/username/maildir/dovecot.list.index.log ==> dovecot-lmtp.log <== Dec 03 16:15:06 lmtp(30601, username(a)domain.de) Info: h2jGC1j1nVKJdwAAwaC1kQ: sieve: msgid=<20131203151436.962C06B6E9(a)monitoring01.domain.de>: stored mail into mailbox 'Trash' Dec 03 16:15:06 lmtp(30601): Info: Disconnect from 10.0.0.3: Successful quit ==> dovecot.log <== Dec 03 16:15:06 indexer-worker(username(a)domain.de): Panic: file http-client-request.c: line 521 (http_client_request_send_more): assertion failed: (req->payload_input != NULL) Dec 03 16:15:06 indexer-worker(username(a)domain.de): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x66ab1) [0x7fc60fe2eab1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x66b8e) [0x7fc60fe2eb8e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fc60fdea3ce] -> /usr/local/lib/dovecot/libdovecot.so.0(http_client_request_send_more+0x2ed) [0x7fc60fe0406d] -> /usr/local/lib/dovecot/libdovecot.so.0(http_client_request_send+0x1e1) [0x7fc60fe042a1] -> /usr/local/lib/dovecot/libdovecot.so.0(http_client_connection_next_request+0x120) [0x7fc60fe06720] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3f6b7) [0x7fc60fe076b7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xbf) [0x7fc60fe3e9af] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x94) [0x7fc60fe3f7d4] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fc60fe3e628] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3bb3f) [0x7fc60fe03b3f] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_end+0x61) [0x7fc60f1d5421] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x4388) [0x7fc60f1d2388] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_deinit+0x29) [0x7fc60f3dfd29] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xbb7c) [0x7fc60f3e4b7c] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc982) [0x7fc60f3e5982] -> /usr/local/lib/dovecot/lib10_quota_plugin.so(+0xb584) [0x7fc60f5f6584] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x90927) [0x7fc61012a927] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x3f) [0x7fc6101162cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+0xe) [0x7fc61011636e] -> dovecot/indexer-worker [username(a)domain.de Trash]() [0x4024f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7fc60fe3ea87] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7fc60fe3f817] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fc60fe3e628] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fc60fdef5c3] -> dovecot/indexer-worker [username(a)domain.de Trash](main+0xe3) [0x401f03] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fc60fa21de5] -> dovecot/indexer-worker [username(a)domain.de Trash]() [0x401fc2] Dec 03 16:15:13 indexer: Error: Indexer worker disconnected, discarding 1 requests for username(a)domain.de Dec 03 16:15:13 indexer-worker(username(a)domain.de): Fatal: master: service(indexer-worker): child 30611 killed with signal 6 (core dumped) _=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_= This happend when LMTP received a mail, and because of fts_autoindex=yes it should be sent to the solr server. Is this normal when waiting for lock on transaction log file times out, or should there be something more graceful, maybe just skip it or so? I already tried to reproduce, but I cannot. I will check the logfiles if it happens again. Regards Michael

2 1

[Dovecot] Multi-master Replication?
by Pizza Napoletana 08 Dec '13

08 Dec '13

Will the replication method described at http://wiki2.dovecot.org/Replication support a master/master/master configuration to keep three replicas in sync? Thanks

2 1

[Dovecot] file descriptor errors
by Christian Rößner 08 Dec '13

08 Dec '13

Hi, I use dovecot 2.2.9 on Gentoo Linux and I get lots of these erors in my log file: Dec 4 08:53:37 mx dovecot: auth: Error: close failed in file object destructor: Dec 4 08:53:37 mx dovecot: auth: Error: IOError: [Errno 9] Bad file descriptor What could cause these error messages? My mailboxes are stored on an ext4 filesystem: /dev/vdb1 on /srv/mail type ext4 (rw,noatime) doveconf -n: # OS: Linux 3.11.2-hardened x86_64 Gentoo Base System release 2.2 ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_access_groups = mail mail_attachment_dir = /srv/mail/copymail/attachments mail_gid = mail mail_location = maildir:/srv/mail/virtual/%d/%n mail_plugins = quota acl zlib mail_log notify mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk-E-Mail { auto = subscribe special_use = \Junk } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. } passdb { args = /usr/local/sbin/ispcp-decrypt.py driver = checkpassword } plugin { acl = vfile acl_shared_dict = file:/srv/mail/virtual/shared-mailboxes.db quota = dict:User quota::file:/srv/mail/virtual/%d/%n/dovecot-quota quota_rule = *:storage=300M:messages=20000 quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster(a)deltaweb.de protocols = imap pop3 lmtp sieve service auth-worker { extra_groups = ssl-cert unix_listener auth-worker { mode = 0600 user = vmail } user = vmail } service auth { extra_groups = ssl-cert unix_listener /var/spool/postfix.relay/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0660 user = vmail } user = vmail } service config { unix_listener config { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = ::1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = </etc/ssl/certs/mx_deltaweb_de.crt ssl_key = </etc/ssl/private/mx_deltaweb_de.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = quota acl zlib mail_log notify sieve } protocol lda { mail_plugins = quota acl zlib mail_log notify sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = quota acl zlib mail_log notify imap_quota imap_acl imap_zlib } Thanks in advance -Christian Rößner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

3 4

[Dovecot] Dovecot readable compressed mail archive
by Dave Hall 08 Dec '13

08 Dec '13

Hello. Is Dovecot able to create and/or read any sort of compressed mail archive? We have a large installation with a few users who need to keep a large amount of email available. With maildir this means a large number of individual files, leading to additional load on our backup process. Even using a compressed mbox file as an archive would help, but only if Dovecot is able to interact with this file seamlessly while keeping current email in the maildir format. Please pardon if this is old business, but I haven't been able to find any reference to it by searching. Thanks. -Dave -- Dave Hall System Administrator Computer Science Binghamton University davehall(a)cs.binghamton.edu 607-760-2328 (Cell) 607-777-4641 (Office)

3 2

[Dovecot] imap crash 2.2.9 hg
by Oli Schacher 08 Dec '13

08 Dec '13

Hi Timo With dovecot built from the latest 2.2.9 hg (342f6962390e) we get imap crashes. This only affects one account which is used by multiple clients. The first few logins seem to work ok, but after a few seconds the log is flooded with Dec 5 13:43:10 team dovecot: imap-login: Login: user=<sales(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=5.6.7.8, mpid=27923, TLS, session=<GeNN38jsHgBNbZEi> Dec 5 13:43:10 team dovecot: imap(sales(a)example.com): Fatal: master: service(imap): child 27923 killed with signal 11 (core dumped) Dec 5 13:43:11 team dovecot: imap-login: Login: user=<sales(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=5.6.7.8, mpid=27925, TLS, session=<NNVS38jsnwBNbZEi> Dec 5 13:43:11 team dovecot: imap(sales(a)example.com): Fatal: master: service(imap): child 27925 killed with signal 11 (core dumped) Dec 5 13:43:11 team dovecot: imap-login: Login: user=<sales(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=5.6.7.8, mpid=27927, TLS, session=<8LxX38jsAgBNbZEi> Dec 5 13:43:11 team dovecot: imap(sales(a)example.com): Fatal: master: service(imap): child 27927 killed with signal 11 (core dumped) [...] messagelog meanwile gets floods of: imap[29173]: segfault at 60 ip 00007f104c160f40 sp 00007fff935a0f58 error 4 in libdovecot-storage.so.0.0.0[7f104c095000+10d000] imap[29175]: segfault at 60 ip 00007fb7247eff40 sp 00007fff8a949578 error 4 in libdovecot-storage.so.0.0.0[7fb724724000+10d000] imap[29177]: segfault at 60 ip 00007f59e4f5df40 sp 00007fff70e884b8 error 4 in libdovecot-storage.so.0.0.0[7f59e4e92000+10d000] imap[29179]: segfault at 60 ip 00007fdda0e68f40 sp 00007fffd3576498 error 4 in libdovecot-storage.so.0.0.0[7fdda0d9d000+10d000] imap[29181]: segfault at 60 ip 00007f60d774af40 sp 00007fffc249aee8 error 4 in libdovecot-storage.so.0.0.0[7f60d767f000+10d000] imap[29183]: segfault at 60 ip 00007fce0da4ff40 sp 00007fff33ff92f8 error 4 in libdovecot-storage.so.0.0.0[7fce0d984000+10d000] imap[29185]: segfault at 60 ip 00007f2e4414ef40 sp 00007fff5888ab28 error 4 in libdovecot-storage.so.0.0.0[7f2e44083000+10d000] imap[29187]: segfault at 60 ip 00007fb0e6d3ef40 sp 00007fff0ed60c58 error 4 in libdovecot-storage.so.0.0.0[7fb0e6c73000+10d000] imap[29189]: segfault at 60 ip 00007f77c8292f40 sp 00007fff4d14bc08 error 4 in libdovecot-storage.so.0.0.0[7f77c81c7000+10d000] imap[29197]: segfault at 60 ip 00007f8366108f40 sp 00007fffd2e060a8 error 4 in libdovecot-storage.so.0.0.0[7f836603d000+10d000] [...] The user with the client on ip 1.2.3.4 tells me he doesn't see any errors in his outlook client, so maybe this crash only affects additional background connections. OS: Centos 6.5, 64 bit (gdb) bt full #0 0x00007f6fdcb9ef40 in mail_index_view_is_inconsistent () from /usr/lib64/dovecot/libdovecot-storage.so.0 No symbol table info available. #1 0x00007f6fdcb4f73b in mailbox_is_inconsistent () from /usr/lib64/dovecot/libdovecot-storage.so.0 No symbol table info available. #2 0x00000000004176dc in client_send_box_error () No symbol table info available. #3 0x0000000000411c46 in cmd_select_full () No symbol table info available. #4 0x0000000000416d6d in command_exec () No symbol table info available. #5 0x0000000000415e90 in ?? () No symbol table info available. #6 0x0000000000415f7d in ?? () No symbol table info available. #7 0x00000000004161fd in client_handle_input () No symbol table info available. #8 0x000000000041656f in client_input () No symbol table info available. #9 0x00007f6fdc87a0c6 in io_loop_call_io () from /usr/lib64/dovecot/libdovecot.so.0 No symbol table info available. #10 0x00007f6fdc87b187 in io_loop_handler_run () from /usr/lib64/dovecot/libdovecot.so.0 No symbol table info available. #11 0x00007f6fdc87a038 in io_loop_run () from /usr/lib64/dovecot/libdovecot.so.0 No symbol table info available. #12 0x00007f6fdc828e43 in master_service_run () from /usr/lib64/dovecot/libdovecot.so.0 No symbol table info available. #13 0x000000000041fd58 in main () No symbol table info available. Possibly related to recent change 9946079253c4/"imap: If SELECT fails with "mailbox is inconsistent", disconnect client. (Plus related cleanups.)" ? Is this "mailbox_is_inconsistent" call something I need to worry about? Reverting back to 2.2.7 doesn't show any errors for the affected account. Thanks Oli -- message transmitted on 100% recycled electrons

2 1

Re: [Dovecot] zlib config questions
by Richard Platel 08 Dec '13

08 Dec '13

You only need to add the zlib plugin to mail_plugins once. As far as I know, there's no indication in the logs that mail is being compressed, and the filename isn't modified to indicate that it's compressed, but, of course, the files are zlib data on disk. One gotcha if you're using maildir is, if you're planning to compress old mail, make sure that the S= and W= sizes in the filenames are correct, otherwise dovecot errors and closes the client session, and it can't repair the filename on it's own. On Dec 6, 2013, at 12:51 AM, dovecot-request(a)dovecot.org wrote: > Message: 6 > Date: Thu, 5 Dec 2013 13:55:40 -0800 > From: Terry Barnum <terry(a)dop.com> > To: Dovecot Mailing List <dovecot(a)dovecot.org> > Subject: [Dovecot] zlib config questions > Message-ID: <EF7F46D0-DE03-4B11-85ED-D669DE78D931(a)dop.com> > Content-Type: text/plain; charset=us-ascii > > After nearly running out of space I swapped in larger disks and then saw the recent threads about zlib compression. Unfortunately I'm still confused after reading <http://wiki2.dovecot.org/Plugins/Zlib>. > > In order to compress new email being stored do I only need to change > > 10-mail.conf to this: > mail_plugins = $mail_plugins zlib > > and 90-plugin.conf to this: > plugin { > zlib_save_level = 6 > zlib_save = gz > ... > > Or do I need to instead (or also?) add it to the list of plugins in 20-imap.conf? > > A simple 'sudo doveadm reload' to enable? > > Once enabled, is there an indication in the logs that compression is taking place? > > Do new mail files have a suffix like .Z to indicate they've been compressed? > > Any gotchas to be aware of? > > I'm running macports dovecot 2.2.5. > > Thanks for any help. > > -Terry > > Terry Barnum > digital OutPost > http://www.dop.com

6 7

[Dovecot] No Dovecot 2.2.9 on OpenBSD 5.4 amd64
by Philippe Lelédy 08 Dec '13

08 Dec '13

Hi, First I have this warning when configuring: configure: WARNING: sys/ucred.h: present but cannot be compiled configure: WARNING: sys/ucred.h: check for missing prerequisite headers? configure: WARNING: sys/ucred.h: see the Autoconf documentation configure: WARNING: sys/ucred.h: section "Present But Cannot Be Compiled" configure: WARNING: sys/ucred.h: proceeding with the compiler's result configure: WARNING: ## ---------------------------------- ## configure: WARNING: ## Report this to dovecot(a)dovecot.org ## configure: WARNING: ## ---------------------------------- ## So I do ! Second, make builds fine, but doveconf not: doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf doveconf: Fatal: pool_system_realloc(536870912): Out of memory Because I can't run doveconf, I give the only information I can get dovecot --version 2.2.9 and dovecot --build-options Build options: ioloop=kqueue notify=kqueue ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL drivers: Passdb: bsdauth checkpassword passwd passwd-file Userdb: checkpassword passwd prefetch passwd-file Install prefix . : /usr/local File offsets ... : 64bit I/O polling .... : kqueue I/O notifys .... : kqueue SSL ............ : yes (OpenSSL) GSSAPI ......... : no passdbs ........ : static passwd passwd-file checkpassword bsdauth : -shadow -pam -sia -ldap -sql -vpopmail userdbs ........ : static prefetch passwd passwd-file checkpassword : -ldap -sql -vpopmail -nss SQL drivers .... : : -pgsql -mysql -sqlite Full text search : squat : -lucene -solr Ph. Le.

2 1

[Dovecot] bug report: doveadm assertion failure "mail_index_map_lookup_seq_range"
by email-from-bobby 08 Dec '13

08 Dec '13

A negated subject search on an empty folder causes an assertion failure in doveadm. To reproduce: bash-3.2# doveadm mailbox create -u ephraim "Freshly Empty" bash-3.2# doveadm search -u ephraim mailbox "Freshly Empty" NOT subject '***JUNK MAIL***' doveadm(ephraim): Panic: file mail-index-map.c: line 548 (mail_index_map_lookup_seq_range): assertion failed: (first_uid <= last_uid\ ) doveadm(ephraim): Error: Raw backtrace: 2 libdovecot.0.dylib 0x0000000100347463 default_fatal_handler + 486 -> 3 \ libdovecot.0.dylib 0x00000001003472c0 default_fatal_handler + 67 -> 4 libdovecot.0.dylib 0x000\ 0000100347705 i_fatal + 0 -> 5 libdovecot-storage.0.dylib 0x00000001002a799f mail_index_map_lookup_seq_range + 309 -> 6 \ libdovecot-storage.0.dylib 0x00000001002b6d4f mail_index_lookup_seq_range + 12 -> 7 lib20_fts_plugin.so \ 0x00000001003fe325 fts_search_lookup + 3307 -> 8 lib20_fts_plugin.so 0x00000001003fddfb fts_search_lookup + 1985 -\ > 9 lib20_fts_plugin.so 0x00000001003fd6e2 fts_search_lookup + 168 -> 10 lib20_fts_plugin.so 0x00\ 000001003ff148 fts_mailbox_allocated + 1139 -> 11 doveadm 0x00000001001dd3d2 doveadm_mail_iter_init + 1\ 99 -> 12 doveadm 0x00000001001df3ce cmd_search_run + 138 -> 13 doveadm 0x0\ 0000001001d94f9 doveadm_mail_next_user + 196 -> 14 doveadm 0x00000001001d9ad1 doveadm_mail_try_run + 77\ 6 -> 15 doveadm 0x00000001001e1a09 main + 1150 -> 16 libdyld.dylib 0x00007fff915\ ba5fd start + 1 -> 17 ??? 0x0000000000000009 0x0 + 9 Abort trap: 6 bash-3.2# A positive search is no problem: bash-3.2# doveadm search -u ephraim mailbox "Freshly Empty" subject '***JUNK MAIL***' bash-3.2# Version and configuration info: bash-3.2# /Applications/Server.app/Contents/ServerRoot/usr/sbin/dovecotd --version 2.2.5 bash-3.2# /Applications/Server.app/Contents/ServerRoot/usr/sbin/dovecotd -n # 2.2.5: /Library/Server/Mail/Config/dovecot/dovecot.conf # OS: Darwin 13.0.0 x86_64 hfs auth_mechanisms = cram-md5 login apop plain digest-md5 auth_realms = mail.vishniac.com auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %n debug_log_path = /Library/Logs/Mail/mail-debug.log default_internal_user = _dovecot default_login_user = _dovenull disable_plaintext_auth = no first_valid_gid = 6 first_valid_uid = 6 hostname = mail.vishniac.com imap_id_log = * imap_id_send = "name" * "version" * imap_urlauth_submit_user = submit info_log_path = /Library/Logs/Mail/mail-info.log log_path = /Library/Logs/Mail/mail-err.log login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_access_groups = mail mail_attribute_dict = file:/Library/Server/Mail/Data/attributes/attributes.dict mail_location = maildir:/Library/Server/Mail/Data/mail/users/%u mail_log_prefix = "%s(pid %p user %u): " mail_plugins = quota zlib acl fts fts_sk managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational \ regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_size = 200 M namespace acl-mailboxes { list = children location = maildir:/Library/Server/Mail/Data/mail/users/%%u:INDEX=/Library/Server/Mail/Data/mail/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } namespace list-archives { list = children location = maildir:/Library/Server/Mail/Data/listserver/messages/archive/lists/%%u:INDEX=/Library/Server/Mail/Data/listserver/mess\ ages/archive/shared/%%u prefix = archives.%%u. separator = . subscriptions = no type = shared } passdb { driver = od } passdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file } plugin { acl = vfile:/Library/Server/Mail/Config/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/Library/Server/Mail/Data/shared/shared-mailboxes fts = sk quota = maildir:User quota quota_warning = storage=100%% quota-exceeded %u sieve = /Library/Server/Mail/Data/rules/%u/dovecot.sieve sieve_dir = /Library/Server/Mail/Data/rules/%u stats_refresh = 30 secs stats_track_cmds = yes } postmaster_address = postmaster(a)vishniac.com protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { extra_groups = _keytabusers idle_kill = 15 mins unix_listener auth-userdb { user = _dovecot } } service dict { unix_listener dict { user = _dovecot } } service dns_client { unix_listener dns-client { mode = 0600 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } service_count = 0 } service imap { client_limit = 5 process_limit = 20 service_count = 0 } service indexer-worker { user = _dovecot } service lmtp { unix_listener lmtp { mode = 0600 } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { client_limit = 5 process_limit = 200 service_count = 0 } service quota-exceeded { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-exceeded.sh unix_listener quota-exceeded { group = mail mode = 0660 user = _dovecot } user = _dovecot } service quota-warning { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-warning.sh unix_listener quota-warning { group = mail mode = 0660 user = _dovecot } user = _dovecot } service stats { fifo_listener stats-mail { mode = 0600 user = _dovecot } } ssl_ca = </etc/certificates/mail.vishniac.com.6BC35F87D55C160F0933F54763846F6CC1EB5A81.chain.pem ssl_cert = </etc/certificates/mail.vishniac.com.6BC35F87D55C160F0933F54763846F6CC1EB5A81.cert.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!ADH:!eNULL ssl_key = </etc/certificates/mail.vishniac.com.6BC35F87D55C160F0933F54763846F6CC1EB5A81.key.pem ssl_key_path = /etc/certificates/mail.vishniac.com.6BC35F87D55C160F0933F54763846F6CC1EB5A81.key.pem userdb { args = partition=/Library/Server/Mail/Config/dovecot/partition_map.conf enforce_quotas=no driver = od } userdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file } verbose_proctitle = yes protocol lmtp { mail_plugins = quota zlib acl fts fts_sk sieve } protocol lda { mail_plugins = quota zlib acl fts fts_sk sieve } protocol imap { mail_max_userip_connections = 20 mail_plugins = quota zlib acl fts fts_sk imap_acl imap_quota imap_zlib } protocol pop3 { mail_max_userip_connections = 6 } bash-3.2#

3 2

[Dovecot] delete message with specified id
by Костырев Александр Алексеевич 08 Dec '13

08 Dec '13

Good day, everyone! Could someone help me to find a way to delete message with certain id from all users's mailboxes? What seems to be a problem: I have configured exim + dovecot lmtp I got a long list of aliases in BD in form of: +----------+-------------------------------------+ |alias_name recipients | (for example) -----------|-------------------------------------+ | list_a | user1@example.org,user2@example.org | +----------|-------------------------------------+ When I send a message to that list_a, user1 and user2 get the mail and I see this in log: Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, user1(a)example.org) copy from INBOX: box=INBOX, uid=1, msgid=<E1VojxY-0004Gl-Gu@beta-mail>, size=570 Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, user1(a)example.org) oCOXKmAkoVIjQAAA635u4w: msgid=<E1VojxY-0004Gl-Gu@beta-mail>: from=root@beta-mail: subj=: saved mail to INBOX Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, user2(a)example.org) copy from INBOX: box=INBOX, uid=1, msgid=<E1VojxY-0004Gl-Gu@beta-mail>, size=570 Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, user2(a)example.org) oCOXKmAkoVIjQAAA635u4w: msgid=<E1VojxY-0004Gl-Gu@beta-mail>: from=root@beta-mail: subj=: saved mail to INBOX Is it possible to delete these letters with known msgid=<E1VojxY-0004Gl-Gu@beta-mail> from all users mailboxes with couple of simple commands ? How do I do it currently: in exim's log I get mailaddress of a user, get into his mailbox (wich cd), find the letter I need, with ls -i I get inode, search (with find) through all users mails and delete all files with that inode, then I have to rebuild dovecot indexes with doveadm mailbox status -A -t all INBOX -- С уважением, Костырев Александр администратор Linux-систем

2 2

[Dovecot] pigeonhole openssl s_client
by LEVAI Daniel 08 Dec '13

08 Dec '13

Hi! I'm trying to get information about a server certificate from a pigeonhole sieve server. Various connection attempts show only "wrong version number" or "unknown protocol" errors from openssl: $ openssl s_client -connect example.com:4190 { -tls1, -tls1_1, -tls1_2 } [ -starttls { imap, pop3 } ] None of these work. I'm trying to see who signed the server cert. How could I do this? Thanks, Daniel -- LÉVAI Dániel PGP key ID = 0x83B63A8F Key fingerprint = DBEC C66B A47A DFA2 792D 650C C69B BE4C 83B6 3A8F

2 1

[Dovecot] Replication via sneakernet
by David Bishop 07 Dec '13

07 Dec '13

Is there a way to get a running transaction log from a Dovecot instance to synchronize (and I use that word very, very loosely) multiple instances that don't share a network? Why I would want to do such a thing: I have a couple way stations along a long, winding road through very hilly country, and at each of these stations, I have a few people (and many, many more at one end of the road). Which people are where varies from hour to hour (but they're all members of a known, larger, group of people with accounts). It would be helpful to get communication (however limited) along this road (and establishing direct communication, either through radio or landline, is not feasible within the budget constraints I have), and it is possible to store a complete copy of the mail spool to a small box at each station (the total mail spool over the period I care about is in the tens of megs). There are trams shuttling back and forth along this road (stopping at each station), and adding a small box (such as a weatherproofed Raspberry Pi with a wifi dongle) to transport files up and down the road is pretty simple. Doing incremental copies of the mail spool is also simple, keeping track of files that get moved or deleted is a bit harder (but still not that bad), but I have no idea how hard it is to track what messages have been seen, especially for the shared folders (which we use instead of mailing lists). I realize this is not a "normal" use of Dovecot, but given this, does anyone who knows the software (and how it keeps track of messages) better have suggestions on how to approach the problem?

4 6

[Dovecot] Easy migration from Dovecot 1.2.16 ppc maildir to 2.1.17 amd64 mdbox
by Philippe Lelédy 07 Dec '13

07 Dec '13

Hi After http://retrospekt.dk/2011/08/migrating-maildir-to-dovecot-2-0-dbox/ I used a two phases process. The first, transfering over the network, is done by this shell function, on the *new* server. The argument is the <user> fetchOldServer () { rsync -poazuHK --exclude="**/dovecot.index*" \ -e ssh root@oldServer:/var/mail/Maildirs/$1 /var/mail/oldServer/ } I had to add --exclude="**/dovecot.index*" because of a change of endianness (ppc -> amd64). the second, having dovecot import the folder, is done by this second fonction dsync () { doveadm backup -R -u $1(a)mondomaine.fr maildir:/var/mail/oldServer/$1 } this one is really fast. Both in one function doveImport() { fetchOldServer $1 && dsync $1 } I tried for initial load to empty mailbox. I am not sure it will works on a non empty mailbox. But would be nice, as it would allow a fast last minute sync before switch, minimizing downtime. Ph. Le

2 1

Re: [Dovecot] Dovecot readable compressed mail archive
by Dave Hall 06 Dec '13

06 Dec '13

Alan, My goal is to reduce the file count in my backups. Based on the information at the link you sent it looks like for a Maildir setup the file count remains the same. Do you know if it's possible to have a mixed config with Dovecot where for a given user the Inbox is a maildir, but the archives are compressed mbox files? Thanks. -Dave On 12/04/2013 02:06 PM, Alan McGinlay wrote: > http://wiki2.dovecot.org/Plugins/Zlib try this.. Excuse the lack of quoted text, im on my phone

1 0

[Dovecot] Authentification Dovecot + Samba4
by dago＠quantentunnel.de 06 Dec '13

06 Dec '13

Hello list, I am struggling with setting up dovecot 2.1.7 with samba 4.1.2 on debian wheezy. Dovecot should authenticate via LDAP, but I cannot get it to work reliably. Sometimes auth works, sometimes not. Referals are already activated in ldap.conf … LDAP-authentication works fine with other clients (Apache Directory Studio, …) Has somebody got a similar setup running? I would love some hints on how to debug this issue … Thank you! Regards dovecot-ldap.conf hosts = 192.168.188.156:389 dn = CN=Administrator,CN=Users,DC=DOMAIN,DC=LOCAL dnpass = Test123 auth_bind = yes ldap_version = 3 base = DC=DOMAIN,DC=LOCAL tls = no debug_level = -1 ldap_version = 3 scope = subtree user_attrs = uidNumber=uid,gidNumber=gid user_filter = (&(&(objectClass=Person)(sAMAccountName=%u))) pass_attrs = sAMAccountName=user,userPassword=password pass_filter = (&(&(objectClass=Person)(sAMAccountName=%u))) logs: srv1 dovecot: auth: Debug: auth client connected (pid=0) srv1 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=doveadm#011resp=<hidden> srv1 dovecot: auth: Debug: ldap(john): bind search: base=DC=DOMAIN,DC=LOCAL filter=(&(&(objectClass=Person)(sAMAccountName=john))) srv1 dovecot: auth: Error: ldap_search srv1 dovecot: auth: Error: put_filter: "(&(&(objectClass=Person)(sAMAccountName=john)))" srv1 dovecot: auth: Error: put_filter: AND srv1 dovecot: auth: Error: put_filter_list "(&(objectClass=Person)(sAMAccountName=john))" srv1 dovecot: auth: Error: put_filter: "(&(objectClass=Person)(sAMAccountName=john))" srv1 dovecot: auth: Error: put_filter: AND srv1 dovecot: auth: Error: put_filter_list "(objectClass=Person)(sAMAccountName=john)" srv1 dovecot: auth: Error: put_filter: "(objectClass=Person)" srv1 dovecot: auth: Error: put_filter: simple srv1 dovecot: auth: Error: put_simple_filter: "objectClass=Person" srv1 dovecot: auth: Error: put_filter: "(sAMAccountName=john)" srv1 dovecot: auth: Error: put_filter: simple srv1 dovecot: auth: Error: put_simple_filter: "sAMAccountName=john" srv1 dovecot: auth: Error: ldap_build_search_req ATTRS: sAMAccountName srv1 dovecot: auth: Error: ldap_send_initial_request srv1 dovecot: auth: Error: ldap_send_server_request srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid -1 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid -1 (timeout 0 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: DOMAIN.local port: 0 srv1 dovecot: auth: Error: refcnt: 1 status: Connected srv1 dovecot: auth: Error: last used: Fri Dec 6 19:08:49 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: * msgid 35, origid 33, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 1 srv1 dovecot: auth: Error: * msgid 33, origid 33, status RequestCompleted srv1 dovecot: auth: Error: outstanding referrals 1, parent count 1 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 3 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 35 message type search-result srv1 dovecot: auth: Error: ldap_chase_referrals srv1 dovecot: auth: Error: read1msg: V2 referral chased, mark request completed, id = 35 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 0 new referrals srv1 dovecot: auth: Error: read1msg: mark request completed, ld 0x7fef48794580 msgid 35 srv1 dovecot: auth: Error: merged parent (id 33) error info: result errno 1, error <00002020: Operation unavailable without authentication>, matched <> srv1 dovecot: auth: Error: request done: ld 0x7fef48794580 msgid 33 srv1 dovecot: auth: Error: res_errno: 1, res_error: <00002020: Operation unavailable without authentication>, res_matched: <> srv1 dovecot: auth: Error: ldap_free_request (origid 33, msgid 33) srv1 dovecot: auth: Error: ldap_free_request (origid 33, msgid 35) srv1 dovecot: auth: Error: ldap_free_connection 0 1 srv1 dovecot: auth: Error: ldap_send_unbind srv1 dovecot: auth: Error: ldap_free_connection: actually freed srv1 dovecot: auth: Error: ldap_parse_result srv1 dovecot: auth: Error: ldap_err2string srv1 dovecot: auth: Error: ldap(john): ldap_search(base=DC=DOMAIN,DC=LOCAL filter=(&(&(objectClass=Person)(sAMAccountName=john)))) failed: Operations error srv1 dovecot: auth: Error: ldap_msgfree srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid -1 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid -1 (timeout 0 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 1 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 37 message type search-entry srv1 dovecot: auth: Error: ldap_first_attribute srv1 dovecot: auth: Error: ldap_get_values srv1 dovecot: auth: Error: ldap_next_attribute srv1 dovecot: auth: Debug: auth(john): username changed john -> john srv1 dovecot: auth: Debug: ldap(john): result: sAMAccountName=john srv1 dovecot: auth: Error: ldap_get_dn srv1 dovecot: auth: Error: ldap_msgfree srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid -1 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid -1 (timeout 0 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 1 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 37 message type search-reference srv1 dovecot: auth: Error: ldap_chase_v3referrals srv1 dovecot: auth: Error: ldap_url_parse_ext(ldap://DOMAIN.local/CN=Configuration,DC=DOMAIN,DC=local) srv1 dovecot: auth: Error: re_encode_request: new msgid 39, new dn <CN=Configuration,DC=DOMAIN,DC=local> srv1 dovecot: auth: Error: re_encode_request new request is: srv1 dovecot: auth: Error: ber_dump: buf=0x7fef4879d8d0 ptr=0x7fef4879d956 end=0x7fef4879e8ac len=134 srv1 dovecot: auth: Error: 0000: 61 6d 65 4e 61 6d 65 00 00 00 00 00 00 00 00 00 ameName......... srv1 dovecot: auth: Error: 0010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0080: 00 00 00 00 00 00 ...... srv1 dovecot: auth: Error: ldap_chase_v3referral: msgid 37, url "ldap://DOMAIN.local/CN=Configuration,DC=DOMAIN,DC=local" srv1 dovecot: auth: Error: ldap_send_server_request srv1 dovecot: auth: Error: ldap_new_connection 0 1 1 srv1 dovecot: auth: Error: ldap_int_open_connection srv1 dovecot: auth: Error: ldap_connect_to_host: TCP DOMAIN.local:389 srv1 dovecot: auth: Error: ldap_new_socket: 19 srv1 dovecot: auth: Error: ldap_prepare_socket: 19 srv1 dovecot: auth: Error: ldap_connect_to_host: Trying 192.168.188.156:389 srv1 dovecot: auth: Error: ldap_pvt_connect: fd: 19 tm: -1 async: 0 srv1 dovecot: auth: Error: anonymous rebind via ldap_sasl_bind("") srv1 dovecot: auth: Error: ldap_sasl_bind srv1 dovecot: auth: Error: ldap_send_initial_request srv1 dovecot: auth: Error: ldap_send_server_request srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid 40 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid 40 (timeout 100000 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: DOMAIN.local port: 0 srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: rebind in progress srv1 dovecot: auth: Error: queue is empty srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 3 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 40, origid 40, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 1, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 2 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 37 message type search-result srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 0 new referrals srv1 dovecot: auth: Error: read1msg: mark request completed, ld 0x7fef48794580 msgid 37 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 0 s 99976 us to go srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: DOMAIN.local port: 0 srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: rebind in progress srv1 dovecot: auth: Error: queue is empty srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 40, origid 40, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: * msgid 37, origid 37, status RequestCompleted srv1 dovecot: auth: Error: outstanding referrals 1, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 2 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL dovecot -n: # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_debug = yes auth_verbose = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = vmail mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } } ssl = no userdb { driver = passwd }

2 1

[Dovecot] SQL as a storage backend
by Zachary Sturgeon 06 Dec '13

06 Dec '13

Hello, I am researching using dovecot with an SQL database as the storage backend. From what I've read, dovecot only supports mbox style file storage, but I'd like to investigate the possibility of using a database instead. According to http://dovecot.org/pipermail/dovecot/2006-June/013818.html, this possibility has been explored before and has generally been accepted that Dovecot is not optimized to handle this. Any suggestions? - Zachary Sturgeon

4 3

[Dovecot] UIDL and namespaces after qmail-pop3d and BincIMAP
by Adrian C. 06 Dec '13

06 Dec '13

Hello, I migrated qmail-pop3d and BincIMAP to Dovecot in the past, and I could always tweak the settings a little to match what old services used to provide, namely namespaces (separator /, prefix INBOX/) and pop3_uidl_format (%f). This time I'm migrating to a large mail system which has its configuration set differently and there's no changing it. pop3_uidl_format = %08Xu%08Xv namespace private {prefix = INBOX. separator = . inbox = yes} Am I corrent in thinking dsync plugin is the only chance I have of getting this mail migrated right? Unfortunately Debian's Dovecot is much much older than required v2.1.4... so I could use some advice from Dovecot experts. Thanks. -- Adrian C. (anrxc) | anrxc..sysphere.org | PGP ID: D20A0618 PGP FP: 02A5 628A D8EE 2A93 996E 929F D5CB 31B7 D20A 0618

1 0

[Dovecot] Design details of high performance dovecot cluster
by JEHERUL 06 Dec '13

06 Dec '13

Dear All, Currently we are running a mail system for 10000 users each 2GB mailbox. At present we have 5 mail servers where users mailboxes are distributed almost uniformly. We have a HP SAN Storage (HP EVA 6400) where mailboxes are stored. We partition the storage into five vg and each is mounted on the 5 servers. We are using postfix and dovecot. The system was running fine but currently we notices high IO load due to IMAP connection. So we are planning to build a dovecot cluster. Please suggest some design for the dovecot cluster keeping in mind to our scenario. (If needed we can buy additional hardware like load balancer). With Thanks and Regards -- Jeherul Islam India

2 3

[Dovecot] SOLR quick and dirty how to - needs review/testing
by Christian Rößner 06 Dec '13

06 Dec '13

Hi, I just wrote a quick and dirty how to. But not sure, if that is done the way it should. So any kind of feedback is welcome. http://www.roessner-network-solutions.com/?p=1127 At least the stuff does not break things here :-) Kind regards -Christian Rößner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 0