- dovecot - dovecot.org

Problem with BINARY extension (Invalid data in MIME part)
by Pavel M. 27 Aug '14

27 Aug '14

1 0

crash with "The specified message set is invalid."
by Ralf Hildebrandt 27 Aug '14

27 Aug '14

We're using dovecot as a proxy between the user and an exchange server. All over a sudden we're getting: Aug 27 13:16:07 mproxy dovecot: imap(username): Fatal: master: service(imap): child 18376 killed with signal 6 (core dumps disabled) Aug 27 13:16:09 mproxy dovecot: imap(username): Error: imapc(email.charite.de:993): Command '12 UID FETCH 0 (BODY.PEEK[])' failed with BAD: 12 The specified message set is invalid. Aug 27 13:16:09 mproxy dovecot: imap(username): Error: imapc: Mail FETCH failed: The specified message set is invalid. Aug 27 13:16:09 mproxy dovecot: imap(username): Panic: file mail-index-map.c: line 547 (mail_index_map_lookup_seq_range): assertion failed: (first_uid > 0) Aug 27 13:16:09 mproxy dovecot: imap(username): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5f770) [0x7f76ad2d9770] -> /usr/lib/dovecot/libdovecot.so.0(+0x5f84e) [0x7f76ad2d984e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f76ad293f2e] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xac44e) [0x7f76ad5f044e] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_lookup_seq+0x12) [0x7f76ad601372] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5ad94) [0x7f76ad59ed94] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5af02) [0x7f76ad59ef02] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_hdr_stream+0x34) [0x7f76ad5adb44] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_header_stream+0x107) [0x7f76ad5d7247] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5ab09) [0x7f76ad59eb09] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x5ab95) [0x7f76ad59eb95] -> /usr/lib/dovecot/modules/lib20_mail_log_plugin.so(+0x1a0c) [0x7f76ac8a9a0c] -> /usr/lib/dovecot/modules/lib20_mail_log_plugin.so(+0x2159) [0x7f76ac8aa159] -> /usr/lib/dovecot/modules/lib15_notify_plugin.so(notify_contexts_mail_copy+0x5c) [0x7f76acaad18c] -> /usr/lib/dovecot/modules/lib15_notify_plugin.so(+0x22c6) [0x7f76acaae2c6] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x6d) [0x7f76ad5b5fdd] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x15) [0x7f76ad5b60b5] -> dovecot/imap [username 91.22.142.109 UID move]() [0x40ca95] -> dovecot/imap [username 91.22.142.109 UID move](command_exec+0x3c) [0x416cfc] -> dovecot/imap [username 91.22.142.109 UID move]() [0x415d5f] -> dovecot/imap [username 91.22.142.109 UID move]() [0x415e15] -> dovecot/imap [username 91.22.142.109 UID move](client_handle_input+0x115) [0x416115] -> dovecot/imap [username 91.22.142.109 UID move](client_input+0x72) [0x4164a2] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x3f) [0x7f76ad2e9e6f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xd7) [0x7f76ad2ead77] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f76ad2e9ed9] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f76ad2e9f58] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f76ad299133] -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 0

LMTP during dsync migration
by Jogi Hofmüller 27 Aug '14

27 Aug '14

Hi all, Another question regarding migration. While migrating a mailbox with dsync is it safe to deliver mail via LMTP to the new (target) mailbox or is it wiser to deactivate LMTP delivery to this mailbox until it's fully migrated? And what methods could I use to stop delivery to a mailbox during migration? Our user data is stored on an LDAP server. Cheers, -- j.hofmüller http://thesix.mur.at/

8 18

Special-Use Mailboxes ?
by Per Jessen 27 Aug '14

27 Aug '14

Lots of people must have had this issue before me - users using different devices&software (pc, smartphone, tablet, thunderbird, outlook, webmail) and languages (e.g. English on the PC, German on the iPhone), some folders end of with different names - e.g. "Sent" and "Gesendete Elemente" - meaning the same thing, namely "sent mails". How do you map these to just one folder such that it shows up correctly independently of what the user happens to be using? It sounds like something for the mailbox "Sent" { special_use = \Drafts } config directive? Is that what it might be used for? mailbox "Sent" { special_use = \Sent } mailbox "Gesendete Elemente" { special_use = \Sent } -- Per Jessen, Zürich (12.9°C) http://www.dns24.ch/ - free dynamic DNS, made in Switzerland.

5 15

Object storage
by List 26 Aug '14

26 Aug '14

Timo, We are contemplating building an S3 compatible cluster of storage servers using Pithos <https://github.com/exoscale/pithos> and Cassandra to get multi data center redundancy and availability. Would it be possible to have multiple Dovecot servers in disparate geographical locations all talking to the same object storage, assuming it's consistent between sites? From what I remember about obox the dovecot servers all keep a copy of the index locally and merge it with a file in the object storage at intervals, is this an issue with our concept? Also does your team have any performance analysis data on the obox plugin, or data on it's use in production?

1 0

Running dsync results in Panic: file mbox-lock.c: line 799 (mbox_lock)
by Piotr Paczynski 26 Aug '14

26 Aug '14

Hello, I'm converting our system to use dovecot. As part of the migration we need to convert existing mbox'es to Maildir format. I'm using latest Dovecot2 available as FreeBSD pkg - 2.2.13. I'm trying to use dsync, which results in: ./dsync -vfu ppaczyn -o mail_location=mbox:~/mail:INBOX=/var/mail/ppaczyn mirror maildir:~/Maildir dsync(ppaczyn): Panic: file mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) Abort trap (core dumped) gdb ./dsync doveadm.core (gdb) bt #0 0x00000008014aae1a in kill () from /lib/libc.so.7 #1 0x00000008014a9ac9 in abort () from /lib/libc.so.7 #2 0x00000008010f0b52 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:193 #3 0x00000008010f0962 in default_fatal_handler (ctx=0x7fffffffd158, format=0x800e14112 "file %s: line %d (%s): assertion failed: (%s)", args=0x7fffffffd140) at failures.c:207 #4 0x00000008010f1190 in i_panic (format=0x800e14112 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 #5 0x0000000800d421ea in mbox_lock (mbox=0x801ce5c40, lock_type=3, lock_id_r=0x801c24af4) at mbox-lock.c:799 #6 0x0000000800d46251 in mbox_save_init_file (ctx=0x801c1a780, t=0x801c24a00, want_mail=true) at mbox-save.c:294 #7 0x0000000800d45cc9 in mbox_save_begin (_ctx=0x801c1a780, input=0x801ca4c30) at mbox-save.c:466 #8 0x0000000800d83670 in mailbox_save_begin (ctx=0x7fffffffd330, input=0x801ca4c30) at mail-storage.c:2034 #9 0x0000000800d74f8c in mail_storage_try_copy (_ctx=0x7fffffffd330, mail=0x801c55840) at mail-copy.c:76 #10 0x0000000800d74e6c in mail_storage_copy (ctx=0x801c1a780, mail=0x801c55840) at mail-copy.c:101 #11 0x0000000800d83b4d in mailbox_copy (_ctx=0x7fffffffd3e8, mail=0x801c55840) at mail-storage.c:2149 #12 0x0000000000447eda in dsync_mailbox_save_body (importer=0x801d1f040, mail=0x801c47410, newmail=0x801d1f2b8, all_newmails_forcopy=0x7fffffffd428) at dsync-mailbox-import.c:1950 #13 0x0000000000446bbb in dsync_mailbox_save_newmails (importer=0x801d1f040, mail=0x801c47410, all_newmails=0x801d1f2b8) at dsync-mailbox-import.c:2027 #14 0x0000000000446b3d in dsync_mailbox_import_mail (importer=0x801d1f040, mail=0x801c47410) at dsync-mailbox-import.c:2069 #15 0x00000000004437c5 in dsync_brain_recv_mail (brain=0x801ca9040) at dsync-brain-mails.c:249 #16 0x0000000000442eb9 in dsync_brain_sync_mails (brain=0x801ca9040) at dsync-brain-mails.c:339 #17 0x000000000043d109 in dsync_brain_run_real (brain=0x801ca9040, changed_r=0x7fffffffd5c5) at dsync-brain.c:575 #18 0x000000000043cf0b in dsync_brain_run (brain=0x801ca9040, changed_r=0x7fffffffd5c5) at dsync-brain.c:610 #19 0x000000000043a75a in cmd_dsync_run_local (ctx=0x801c2d840, user=0x801c40040, brain=0x801ca9040, ibc2=0x801c47480, changes_during_sync_r=0x7fffffffd67a) at doveadm-dsync.c:383 #20 0x0000000000439d07 in cmd_dsync_run (_ctx=0x801c2d840, user=0x801c40040) at doveadm-dsync.c:596 #21 0x0000000000413735 in doveadm_mail_next_user (ctx=0x801c2d840, input=0x7fffffffd7d8, error_r=0x7fffffffd848) at doveadm-mail.c:314 #22 0x0000000000413541 in doveadm_mail_single_user (ctx=0x801c2d840, input=0x7fffffffd7d8, error_r=0x7fffffffd848) at doveadm-mail.c:337 #23 0x0000000000414100 in doveadm_mail_cmd (cmd=0x801c72528, argc=5, argv=0x7fffffffd9b8) at doveadm-mail.c:525 #24 0x0000000000413c75 in doveadm_mail_try_run (cmd_name=0x7fffffffdc56 "sync", argc=5, argv=0x7fffffffd998) at doveadm-mail.c:617 #25 0x00000000004219f9 in main (argc=5, argv=0x7fffffffd998) at doveadm.c:398 Here's my config: doveconf -n # 2.2.13: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-RELEASE-p7 amd64 mail_location = maildir:~/Maildir mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { driver = pam } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } Any suggestions how to proceed? Piotr

1 0

Re: TCP Cluster replication headache
by FUSTE Emmanuel 26 Aug '14

26 Aug '14

Le 07/05/2014 17:38, Emmanuel Fusté a écrit : > Hello, > > After going crazy building a dovecot cluster, I finally see the light ;-)) > But some things are "strange" and could probably be fixed/enhanced. > > First : > I follow the wiki doc, setting global doveadm_port. > Things did not work, I've got: > > dovecot: doveadm(X1234567): Error: sync: /var/run/dovecot/auth-userdb: Configured passdbs don't support crentials lookups (to see if user is proxied, because doveadm_port is set) > > Same kind of error too when trying to use doveadm on the command line to > get the replica status. > My user/auth db is LDAP with "auth_bind = yes", but I don't understand > the message in these context and did'nt know how to fix this. > I tried to hardcode proxy/proxy_maybe property in the passdb declaration > etc... > Finally, I remove the global "doveadm_port 12345" and add ":12345" at > the end of my "mail_replica =" line and all began to work ! > Is it a wanted and expected error/fix ? Ok, this first point should be fixed by http://hg.dovecot.org/dovecot-2.2/rev/a2e0e89bc27d Need to test it. Thank you. Emmanuel. > > Secondly: > Now all is working and "doveadm replicator status '*' " correctly list > all my users and the status, but after a few seconds (after replication > kick in), I see all user listed twice. > One time, as declared in the userdb with letters in uppercase : "X1234567" > One time, in lowercase : "x1234567" > On disk, all is OK, with only one replica in an uppercase directory. > I initially think that it was a mismatch between userdb and passdb users > return, but it was in fact the default value of auth_username_format > that was the culprit. After going from the default %Lu to %u doveadm > replicator status show only one entry per user as expected. > Is it wanted and expected too? why auth_username_format is used/interact > with/in the replication process and/or the replicator status command ? > > Not all is functionally tested, I go back to work. > My is conf at the end of this message. > > Thanks Simo for this great piece of software. > > Emmanuel > > # 2.2.12.7 (f7731356530e+): /etc/dovecot/dovecot.conf > # OS: Linux 3.11.0-19-generic x86_64 Ubuntu 12.04.4 LTS > auth_master_user_separator = * > auth_username_format = %u > doveadm_password = xxxxxxxxxxx > lda_mailbox_autocreate = yes > listen = * > mail_gid = vmail > mail_location = maildir:~/Maildir > mail_plugins = quota notify replication > mail_uid = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = > separator = / > subscriptions = yes > type = private > } > namespace { > hidden = no > inbox = no > list = children > location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u > prefix = shared/%%u/ > separator = / > subscriptions = no > type = shared > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > acl = vfile > acl_anyone = allow > > acl_shared_dict =file:/appli/vmail/shared-mailboxes > mail_replica = tcp:thsmytmbx02p.online.corp.thales:12345 > quota = dict:userquota::file:/appli/vmail/local_userquota/%%h/dovecot-quota > quota_rule = *:storage=100M > quota_rule2 = INBOX:storage=+20%% > quota_rule3 = Trash:storage=+10%% > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > protocols = imap sieve > service aggregator { > fifo_listener replication-notify-fifo { > user = vmail > } > unix_listener replication-notify { > user = vmail > } > } > service auth { > unix_listener auth-userdb { > group = vmail > mode = 0660 > } > } > service doveadm { > inet_listener { > port = 12345 > } > user = vmail > } > service replicator { > process_min_avail = 1 > unix_listener replicator-doveadm { > mode = 0666 > } > } > ssl = no > userdb { > args = /etc/dovecot/dovecot-users-ldap.conf.ext > driver = ldap > } > protocol lda { > mail_plugins = quota sieve > } > protocol imap { > mail_plugins = quota imap_quota > } > > > > dovecot-users-ldap.conf.ext: > dovecot-ldap.conf.ext: > > uris = ldapi:/// > dn = uid=dovecot,dc=mydomain,dc=com > dnpass = xxxxxxxxxxxx > auth_bind = yes > ldap_version = 3 > base = ou=users,dc=mydomain,dc=com > user_attrs = =home=/appli/vmail/%{ldap:uid} > user_filter = (&(objectClass=inetOrgPerson)(|(uid=%u)(mail=%u))) > pass_attrs = =user=%{ldap:uid} > pass_filter = (&(objectClass=inetOrgPerson)(uid=%u)(!(pwdReset=TRUE))) > iterate_attrs = uid=user > iterate_filter = (objectClass=inetOrgPerson) >

1 0

centos 6.x/7.x repos ?
by Spyros Tsiolis 25 Aug '14

25 Aug '14

Hello all, I believe someone has rpms for centos v6.x/7.x ? I remember a link to a site somewhere ? Are packages available for both i386 and 64-bit os's ?? tia, s.

2 1

OS X 10.6 Server - Dovecot Issue
by Ian Baker 25 Aug '14

25 Aug '14

I've just taken over support for an OS X Server (v10.6.8) box, and am a bit new at Postfix & Dovecot. We're having an problem where, intermittently, dovecot seems to be bouncing messages inbound for some of my existing users. Here is the mail.log entry for a successful delivery: Aug 21 16:58:45 mail postfix/pipe[64094]: D68783AE0F75: to=<sblondin(a)eem.ca>, relay=dovecot, delay=0.08, delays=0/0.01/0/0.07, dsn=2.0.0, status=sent (delivered via dovecot service) And here is what a bounce looks like Aug 22 07:29:28 mail postfix/local[93916]: error: od[getpwnam_ext]: No record for user sblondin Aug 22 07:29:28 mail postfix/pipe[93944]: 852C43AE7ACC: to=<sblondin(a)eem.ca>, relay=dovecot, delay=15, delays=0.14/0.05/0/15, dsn=5.1.1, status=bounced (user unknown) And a bit later another succcessful delivery. Aug 22 07:56:37 mail postfix/pipe[95021]: 14AF73AE82F0: to=<sblondin(a)eem.ca>, relay=dovecot, delay=0.5, delays=0.08/0.02/0/0.4, dsn=2.0.0, status=sent (delivered via dovecot service) No changes to this user's account were made during this time period. I'm flummoxed. Anythoughts as to what might be going on here, and/or how to debug this further? Thanks in advance... Ian /usr/sbin/dovecotd --version 1.1.20apple0.5 sh-3.2# /usr/sbin/dovecotd -n # 1.1.20apple0.5: /private/etc/dovecot/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 456). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: Darwin 10.8.0 x86_64 hfs base_dir: /var/run/dovecot syslog_facility: local6 protocols: managesieve imaps imap listen(default): * listen(imap): * listen(managesieve): *:2000 ssl_ca_file: /etc/certificates/mail.eem.ca.98CEBC1921A5C908068A7CB64F0364C1D5DEF795.chain.pem ssl_cert_file: /etc/certificates/mail.eem.ca.98CEBC1921A5C908068A7CB64F0364C1D5DEF795.cert.pem ssl_key_file: /etc/certificates/mail.eem.ca.98CEBC1921A5C908068A7CB64F0364C1D5DEF795.key.pem ssl_cipher_list: ALL:!LOW:!SSLv2:!aNULL:!ADH:!eNULL disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login login_user: _dovecot login_process_per_connection: no max_mail_processes: 200 mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(managesieve): 10 verbose_proctitle: yes first_valid_uid: 6 first_valid_gid: 6 mail_access_groups: mail mail_location: maildir:/var/spool/imap/dovecot/mail/%u mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_process_sharing(default): full mail_process_sharing(imap): full mail_process_sharing(managesieve): none mail_max_connections(default): 5 mail_max_connections(imap): 5 mail_max_connections(managesieve): 20 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/managesieve sieve_storage(default): sieve_storage(imap): sieve_storage(managesieve): /var/spool/imap/dovecot/sieve-scripts/%u sieve(default): sieve(imap): sieve(managesieve): /var/spool/imap/dovecot/sieve-scripts/%u/dovecot.sieve lda: postmaster_address: postmaster(a)example.com hostname: mail.eem.ca mail_plugins: push_notify cmusieve quota quota_full_tempfail: yes sendmail_path: /usr/sbin/sendmail auth_socket_path: /var/run/dovecot/auth-master log_path: /var/log/mailaccess.log info_log_path: /var/log/mailaccess.log auth default: mechanisms: plain login gssapi cram-md5 verbose: yes passdb: driver: od userdb: driver: od args: partition=/etc/dovecot/partition_map.conf enforce_quotas=no socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: _dovecot group: mail plugin: quota_warning: storage=100%% /usr/libexec/dovecot/quota-exceeded.sh quota: maildir:User quota sieve: /var/spool/imap/dovecot/sieve-scripts/%u/dovecot.sieve

2 1

IMAP Proxying to an Exchange Server
by Ralf Hildebrandt 25 Aug '14

25 Aug '14

We're proxying IMAP to an Exchange server. One of my colleagues is getting this when trying to save a message as "Draft" OR as "Sent items": Aug 25 13:45:41 mproxy dovecot: imap(froemmel): Error: imapc(exchange-imap.charite.de:993): Command '7 APPEND "Entw&APw-rfe" (\Draft) {232572}' timed out, disconnecting Aug 25 13:45:41 mproxy dovecot: imap(froemmel): Debug: imapc(exchange-imap.charite.de:993): Disconnected Aug 25 13:45:42 mproxy dovecot: imap(froemmel): Error: imapc: COPY failed: Disconnected from server Aug 25 13:45:42 mproxy dovecot: imap(froemmel): Disconnected: IMAP session state is inconsistent, please relogin. in=232719 out=826 Aug 25 13:46:07 mproxy dovecot: imap(froemmel): Error: imapc(exchange-imap.charite.de:993): Command '7 APPEND "Entw&APw-rfe" (\Draft) {232572}' timed out, disconnecting Aug 25 13:46:07 mproxy dovecot: imap(froemmel): Debug: imapc(exchange-imap.charite.de:993): Disconnected Aug 25 13:46:07 mproxy dovecot: imap(froemmel): Error: imapc: COPY failed: Disconnected from server Aug 25 13:46:07 mproxy dovecot: imap(froemmel): Disconnected: IMAP session state is inconsistent, please relogin. in=232719 out=826 How can I debug this further? I cannot see which commands are sent by Thunderbird... -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 0