- dovecot - dovecot.org

LMTP during dsync migration
by Jogi Hofmüller 27 Aug '14

27 Aug '14

Hi all, Another question regarding migration. While migrating a mailbox with dsync is it safe to deliver mail via LMTP to the new (target) mailbox or is it wiser to deactivate LMTP delivery to this mailbox until it's fully migrated? And what methods could I use to stop delivery to a mailbox during migration? Our user data is stored on an LDAP server. Cheers, -- j.hofmüller http://thesix.mur.at/

8 18

Special-Use Mailboxes ?
by Per Jessen 27 Aug '14

27 Aug '14

Lots of people must have had this issue before me - users using different devices&software (pc, smartphone, tablet, thunderbird, outlook, webmail) and languages (e.g. English on the PC, German on the iPhone), some folders end of with different names - e.g. "Sent" and "Gesendete Elemente" - meaning the same thing, namely "sent mails". How do you map these to just one folder such that it shows up correctly independently of what the user happens to be using? It sounds like something for the mailbox "Sent" { special_use = \Drafts } config directive? Is that what it might be used for? mailbox "Sent" { special_use = \Sent } mailbox "Gesendete Elemente" { special_use = \Sent } -- Per Jessen, Zürich (12.9°C) http://www.dns24.ch/ - free dynamic DNS, made in Switzerland.

5 15

Object storage
by List 26 Aug '14

26 Aug '14

Timo, We are contemplating building an S3 compatible cluster of storage servers using Pithos <https://github.com/exoscale/pithos> and Cassandra to get multi data center redundancy and availability. Would it be possible to have multiple Dovecot servers in disparate geographical locations all talking to the same object storage, assuming it's consistent between sites? From what I remember about obox the dovecot servers all keep a copy of the index locally and merge it with a file in the object storage at intervals, is this an issue with our concept? Also does your team have any performance analysis data on the obox plugin, or data on it's use in production?

1 0

Running dsync results in Panic: file mbox-lock.c: line 799 (mbox_lock)
by Piotr Paczynski 26 Aug '14

26 Aug '14

Hello, I'm converting our system to use dovecot. As part of the migration we need to convert existing mbox'es to Maildir format. I'm using latest Dovecot2 available as FreeBSD pkg - 2.2.13. I'm trying to use dsync, which results in: ./dsync -vfu ppaczyn -o mail_location=mbox:~/mail:INBOX=/var/mail/ppaczyn mirror maildir:~/Maildir dsync(ppaczyn): Panic: file mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) Abort trap (core dumped) gdb ./dsync doveadm.core (gdb) bt #0 0x00000008014aae1a in kill () from /lib/libc.so.7 #1 0x00000008014a9ac9 in abort () from /lib/libc.so.7 #2 0x00000008010f0b52 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:193 #3 0x00000008010f0962 in default_fatal_handler (ctx=0x7fffffffd158, format=0x800e14112 "file %s: line %d (%s): assertion failed: (%s)", args=0x7fffffffd140) at failures.c:207 #4 0x00000008010f1190 in i_panic (format=0x800e14112 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:267 #5 0x0000000800d421ea in mbox_lock (mbox=0x801ce5c40, lock_type=3, lock_id_r=0x801c24af4) at mbox-lock.c:799 #6 0x0000000800d46251 in mbox_save_init_file (ctx=0x801c1a780, t=0x801c24a00, want_mail=true) at mbox-save.c:294 #7 0x0000000800d45cc9 in mbox_save_begin (_ctx=0x801c1a780, input=0x801ca4c30) at mbox-save.c:466 #8 0x0000000800d83670 in mailbox_save_begin (ctx=0x7fffffffd330, input=0x801ca4c30) at mail-storage.c:2034 #9 0x0000000800d74f8c in mail_storage_try_copy (_ctx=0x7fffffffd330, mail=0x801c55840) at mail-copy.c:76 #10 0x0000000800d74e6c in mail_storage_copy (ctx=0x801c1a780, mail=0x801c55840) at mail-copy.c:101 #11 0x0000000800d83b4d in mailbox_copy (_ctx=0x7fffffffd3e8, mail=0x801c55840) at mail-storage.c:2149 #12 0x0000000000447eda in dsync_mailbox_save_body (importer=0x801d1f040, mail=0x801c47410, newmail=0x801d1f2b8, all_newmails_forcopy=0x7fffffffd428) at dsync-mailbox-import.c:1950 #13 0x0000000000446bbb in dsync_mailbox_save_newmails (importer=0x801d1f040, mail=0x801c47410, all_newmails=0x801d1f2b8) at dsync-mailbox-import.c:2027 #14 0x0000000000446b3d in dsync_mailbox_import_mail (importer=0x801d1f040, mail=0x801c47410) at dsync-mailbox-import.c:2069 #15 0x00000000004437c5 in dsync_brain_recv_mail (brain=0x801ca9040) at dsync-brain-mails.c:249 #16 0x0000000000442eb9 in dsync_brain_sync_mails (brain=0x801ca9040) at dsync-brain-mails.c:339 #17 0x000000000043d109 in dsync_brain_run_real (brain=0x801ca9040, changed_r=0x7fffffffd5c5) at dsync-brain.c:575 #18 0x000000000043cf0b in dsync_brain_run (brain=0x801ca9040, changed_r=0x7fffffffd5c5) at dsync-brain.c:610 #19 0x000000000043a75a in cmd_dsync_run_local (ctx=0x801c2d840, user=0x801c40040, brain=0x801ca9040, ibc2=0x801c47480, changes_during_sync_r=0x7fffffffd67a) at doveadm-dsync.c:383 #20 0x0000000000439d07 in cmd_dsync_run (_ctx=0x801c2d840, user=0x801c40040) at doveadm-dsync.c:596 #21 0x0000000000413735 in doveadm_mail_next_user (ctx=0x801c2d840, input=0x7fffffffd7d8, error_r=0x7fffffffd848) at doveadm-mail.c:314 #22 0x0000000000413541 in doveadm_mail_single_user (ctx=0x801c2d840, input=0x7fffffffd7d8, error_r=0x7fffffffd848) at doveadm-mail.c:337 #23 0x0000000000414100 in doveadm_mail_cmd (cmd=0x801c72528, argc=5, argv=0x7fffffffd9b8) at doveadm-mail.c:525 #24 0x0000000000413c75 in doveadm_mail_try_run (cmd_name=0x7fffffffdc56 "sync", argc=5, argv=0x7fffffffd998) at doveadm-mail.c:617 #25 0x00000000004219f9 in main (argc=5, argv=0x7fffffffd998) at doveadm.c:398 Here's my config: doveconf -n # 2.2.13: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-RELEASE-p7 amd64 mail_location = maildir:~/Maildir mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { driver = pam } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } Any suggestions how to proceed? Piotr

1 0

Re: TCP Cluster replication headache
by FUSTE Emmanuel 26 Aug '14

26 Aug '14

Le 07/05/2014 17:38, Emmanuel Fusté a écrit : > Hello, > > After going crazy building a dovecot cluster, I finally see the light ;-)) > But some things are "strange" and could probably be fixed/enhanced. > > First : > I follow the wiki doc, setting global doveadm_port. > Things did not work, I've got: > > dovecot: doveadm(X1234567): Error: sync: /var/run/dovecot/auth-userdb: Configured passdbs don't support crentials lookups (to see if user is proxied, because doveadm_port is set) > > Same kind of error too when trying to use doveadm on the command line to > get the replica status. > My user/auth db is LDAP with "auth_bind = yes", but I don't understand > the message in these context and did'nt know how to fix this. > I tried to hardcode proxy/proxy_maybe property in the passdb declaration > etc... > Finally, I remove the global "doveadm_port 12345" and add ":12345" at > the end of my "mail_replica =" line and all began to work ! > Is it a wanted and expected error/fix ? Ok, this first point should be fixed by http://hg.dovecot.org/dovecot-2.2/rev/a2e0e89bc27d Need to test it. Thank you. Emmanuel. > > Secondly: > Now all is working and "doveadm replicator status '*' " correctly list > all my users and the status, but after a few seconds (after replication > kick in), I see all user listed twice. > One time, as declared in the userdb with letters in uppercase : "X1234567" > One time, in lowercase : "x1234567" > On disk, all is OK, with only one replica in an uppercase directory. > I initially think that it was a mismatch between userdb and passdb users > return, but it was in fact the default value of auth_username_format > that was the culprit. After going from the default %Lu to %u doveadm > replicator status show only one entry per user as expected. > Is it wanted and expected too? why auth_username_format is used/interact > with/in the replication process and/or the replicator status command ? > > Not all is functionally tested, I go back to work. > My is conf at the end of this message. > > Thanks Simo for this great piece of software. > > Emmanuel > > # 2.2.12.7 (f7731356530e+): /etc/dovecot/dovecot.conf > # OS: Linux 3.11.0-19-generic x86_64 Ubuntu 12.04.4 LTS > auth_master_user_separator = * > auth_username_format = %u > doveadm_password = xxxxxxxxxxx > lda_mailbox_autocreate = yes > listen = * > mail_gid = vmail > mail_location = maildir:~/Maildir > mail_plugins = quota notify replication > mail_uid = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave > namespace { > hidden = no > inbox = yes > list = yes > location = > prefix = > separator = / > subscriptions = yes > type = private > } > namespace { > hidden = no > inbox = no > list = children > location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u > prefix = shared/%%u/ > separator = / > subscriptions = no > type = shared > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > acl = vfile > acl_anyone = allow > > acl_shared_dict =file:/appli/vmail/shared-mailboxes > mail_replica = tcp:thsmytmbx02p.online.corp.thales:12345 > quota = dict:userquota::file:/appli/vmail/local_userquota/%%h/dovecot-quota > quota_rule = *:storage=100M > quota_rule2 = INBOX:storage=+20%% > quota_rule3 = Trash:storage=+10%% > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > protocols = imap sieve > service aggregator { > fifo_listener replication-notify-fifo { > user = vmail > } > unix_listener replication-notify { > user = vmail > } > } > service auth { > unix_listener auth-userdb { > group = vmail > mode = 0660 > } > } > service doveadm { > inet_listener { > port = 12345 > } > user = vmail > } > service replicator { > process_min_avail = 1 > unix_listener replicator-doveadm { > mode = 0666 > } > } > ssl = no > userdb { > args = /etc/dovecot/dovecot-users-ldap.conf.ext > driver = ldap > } > protocol lda { > mail_plugins = quota sieve > } > protocol imap { > mail_plugins = quota imap_quota > } > > > > dovecot-users-ldap.conf.ext: > dovecot-ldap.conf.ext: > > uris = ldapi:/// > dn = uid=dovecot,dc=mydomain,dc=com > dnpass = xxxxxxxxxxxx > auth_bind = yes > ldap_version = 3 > base = ou=users,dc=mydomain,dc=com > user_attrs = =home=/appli/vmail/%{ldap:uid} > user_filter = (&(objectClass=inetOrgPerson)(|(uid=%u)(mail=%u))) > pass_attrs = =user=%{ldap:uid} > pass_filter = (&(objectClass=inetOrgPerson)(uid=%u)(!(pwdReset=TRUE))) > iterate_attrs = uid=user > iterate_filter = (objectClass=inetOrgPerson) >

1 0

centos 6.x/7.x repos ?
by Spyros Tsiolis 25 Aug '14

25 Aug '14

Hello all, I believe someone has rpms for centos v6.x/7.x ? I remember a link to a site somewhere ? Are packages available for both i386 and 64-bit os's ?? tia, s.

2 1

OS X 10.6 Server - Dovecot Issue
by Ian Baker 25 Aug '14

25 Aug '14

I've just taken over support for an OS X Server (v10.6.8) box, and am a bit new at Postfix & Dovecot. We're having an problem where, intermittently, dovecot seems to be bouncing messages inbound for some of my existing users. Here is the mail.log entry for a successful delivery: Aug 21 16:58:45 mail postfix/pipe[64094]: D68783AE0F75: to=<sblondin(a)eem.ca>, relay=dovecot, delay=0.08, delays=0/0.01/0/0.07, dsn=2.0.0, status=sent (delivered via dovecot service) And here is what a bounce looks like Aug 22 07:29:28 mail postfix/local[93916]: error: od[getpwnam_ext]: No record for user sblondin Aug 22 07:29:28 mail postfix/pipe[93944]: 852C43AE7ACC: to=<sblondin(a)eem.ca>, relay=dovecot, delay=15, delays=0.14/0.05/0/15, dsn=5.1.1, status=bounced (user unknown) And a bit later another succcessful delivery. Aug 22 07:56:37 mail postfix/pipe[95021]: 14AF73AE82F0: to=<sblondin(a)eem.ca>, relay=dovecot, delay=0.5, delays=0.08/0.02/0/0.4, dsn=2.0.0, status=sent (delivered via dovecot service) No changes to this user's account were made during this time period. I'm flummoxed. Anythoughts as to what might be going on here, and/or how to debug this further? Thanks in advance... Ian /usr/sbin/dovecotd --version 1.1.20apple0.5 sh-3.2# /usr/sbin/dovecotd -n # 1.1.20apple0.5: /private/etc/dovecot/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 456). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: Darwin 10.8.0 x86_64 hfs base_dir: /var/run/dovecot syslog_facility: local6 protocols: managesieve imaps imap listen(default): * listen(imap): * listen(managesieve): *:2000 ssl_ca_file: /etc/certificates/mail.eem.ca.98CEBC1921A5C908068A7CB64F0364C1D5DEF795.chain.pem ssl_cert_file: /etc/certificates/mail.eem.ca.98CEBC1921A5C908068A7CB64F0364C1D5DEF795.cert.pem ssl_key_file: /etc/certificates/mail.eem.ca.98CEBC1921A5C908068A7CB64F0364C1D5DEF795.key.pem ssl_cipher_list: ALL:!LOW:!SSLv2:!aNULL:!ADH:!eNULL disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login login_user: _dovecot login_process_per_connection: no max_mail_processes: 200 mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(managesieve): 10 verbose_proctitle: yes first_valid_uid: 6 first_valid_gid: 6 mail_access_groups: mail mail_location: maildir:/var/spool/imap/dovecot/mail/%u mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_process_sharing(default): full mail_process_sharing(imap): full mail_process_sharing(managesieve): none mail_max_connections(default): 5 mail_max_connections(imap): 5 mail_max_connections(managesieve): 20 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/managesieve sieve_storage(default): sieve_storage(imap): sieve_storage(managesieve): /var/spool/imap/dovecot/sieve-scripts/%u sieve(default): sieve(imap): sieve(managesieve): /var/spool/imap/dovecot/sieve-scripts/%u/dovecot.sieve lda: postmaster_address: postmaster(a)example.com hostname: mail.eem.ca mail_plugins: push_notify cmusieve quota quota_full_tempfail: yes sendmail_path: /usr/sbin/sendmail auth_socket_path: /var/run/dovecot/auth-master log_path: /var/log/mailaccess.log info_log_path: /var/log/mailaccess.log auth default: mechanisms: plain login gssapi cram-md5 verbose: yes passdb: driver: od userdb: driver: od args: partition=/etc/dovecot/partition_map.conf enforce_quotas=no socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: _dovecot group: mail plugin: quota_warning: storage=100%% /usr/libexec/dovecot/quota-exceeded.sh quota: maildir:User quota sieve: /var/spool/imap/dovecot/sieve-scripts/%u/dovecot.sieve

2 1

IMAP Proxying to an Exchange Server
by Ralf Hildebrandt 25 Aug '14

25 Aug '14

We're proxying IMAP to an Exchange server. One of my colleagues is getting this when trying to save a message as "Draft" OR as "Sent items": Aug 25 13:45:41 mproxy dovecot: imap(froemmel): Error: imapc(exchange-imap.charite.de:993): Command '7 APPEND "Entw&APw-rfe" (\Draft) {232572}' timed out, disconnecting Aug 25 13:45:41 mproxy dovecot: imap(froemmel): Debug: imapc(exchange-imap.charite.de:993): Disconnected Aug 25 13:45:42 mproxy dovecot: imap(froemmel): Error: imapc: COPY failed: Disconnected from server Aug 25 13:45:42 mproxy dovecot: imap(froemmel): Disconnected: IMAP session state is inconsistent, please relogin. in=232719 out=826 Aug 25 13:46:07 mproxy dovecot: imap(froemmel): Error: imapc(exchange-imap.charite.de:993): Command '7 APPEND "Entw&APw-rfe" (\Draft) {232572}' timed out, disconnecting Aug 25 13:46:07 mproxy dovecot: imap(froemmel): Debug: imapc(exchange-imap.charite.de:993): Disconnected Aug 25 13:46:07 mproxy dovecot: imap(froemmel): Error: imapc: COPY failed: Disconnected from server Aug 25 13:46:07 mproxy dovecot: imap(froemmel): Disconnected: IMAP session state is inconsistent, please relogin. in=232719 out=826 How can I debug this further? I cannot see which commands are sent by Thunderbird... -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 0

Problem overriding default quota limit for LDAP users
by Rasim Kalimullin 25 Aug '14

25 Aug '14

Hi! I install dovecot from debian-backports: dovecot --version 2.2.9 Dovecot is configured to multiple authorization: /etc/dovecot# cat conf.d/10-auth.conf |grep include #!include auth-deny.conf.ext !include auth-master.conf.ext #include auth-system.conf.ext !include auth-sql.conf.ext !include auth-ldap.conf.ext #!include auth-passwdfile.conf.ext #!include auth-checkpassword.conf.ext #!include auth-vpopmail.conf.ext #!include auth-static.conf.ext /etc/dovecot# grep -v '^ *$#.*$\?$' dovecot-sql.conf.ext driver = mysql connect = host=127.0.0.1 dbname=postfixadmin user=postfixadmin password=***** default_pass_scheme = MD5-CRYPT password_query = \ SELECT username, domain, password \ FROM mailbox WHERE username = '%u' AND domain = '%d' user_query = \ SELECT CONCAT('/var/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid, CONCAT('*:bytes=', quota) AS quota_rule \ FROM mailbox WHERE username = '%u' AND domain = '%d' iterate_query = SELECT username AS user FROM mailbox /etc/dovecot# grep -v '^ *$#.*$\?$' dovecot-ldap.conf.ext hosts = ***.***.local ***.***.local dn = dovecot(a)***.local dnpass = ****** auth_bind = yes ldap_version = 3 base = ou=XXX,dc=***,dc=local deref = never scope = subtree user_attrs = \ =uid=5000, \ =gid=5000, \ =mail=maildir:/var/mail/%d/%{ldap:mail}, \ =home=/var/mail/%d/%u/, \ =quota_rule=*:bytes=%{ldap:quotaMail} user_filter = (&(mail=%u)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) pass_attrs = mail=user,userPassword=password pass_filter = (&(mail=%u)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) iterate_attrs = mail=user iterate_filter = (&(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) default_pass_scheme = CRYPT quotamail attribute was added to Active Directory. Enable quota: /etc/dovecot# grep -v '^ *$#.*$\?$' conf.d/90-quota.conf plugin { quota_rule = *:storage=2G quota_rule2 = Trash:storage=+100M quota_grace = 10%% } ... plugin { quota = maildir:User quota } Per-user quota from SQL works fine: doveadm quota get -u i.ivanov(a)***.ru Quota name Type Value Limit % User quota STORAGE 8 1000000 0 User quota MESSAGE 14 - 0 Per-user quota from LDAP works too: doveadm quota get -u testmail(a)***.ru Quota name Type Value Limit % User quota STORAGE 962 2000 48 User quota MESSAGE 6 - 0 But if you do not set the attribute quotaMail: doveadm quota get -u e.etc(a)***.ru Quota name Type Value Limit % User quota STORAGE 0 - 0 User quota MESSAGE 0 - 0 And quota is unlimited. For comparison: doveadm user e.etc(a)***.ru field value uid 5000 gid 5000 home /var/mail/***.ru/e.etc(a)***.ru/ mail maildir:/var/mail/***.ru/e.etc@***.ru quota_rule *:bytes= doveadm user testmail(a)***.ru field value uid 5000 gid 5000 home /var/mail/***.ru/testmail(a)***.ru/ mail maildir:/var/mail/****.ru/testmail@***.ru quota_rule *:bytes=2048576 Logs: Aug 25 16:15:40 mail dovecot: auth: Debug: master in: USER#0111#011e.etc@ ***.ru#011service=doveadm Aug 25 16:15:40 mail dovecot: auth-worker(15295): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 25 16:15:40 mail dovecot: auth-worker(15295): Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Aug 25 16:15:40 mail dovecot: auth-worker(15295): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 25 16:15:40 mail dovecot: auth-worker(15295): Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Aug 25 16:15:40 mail dovecot: auth-worker(15295): Debug: sql(e.etc(a)***.ru): SELECT CONCAT('/var/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid, CONCAT('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = 'e.etc(a)***.ru' AND domain = '***.ru' Aug 25 16:15:40 mail dovecot: auth-worker(15295): sql(e.etc(a)***.ru): unknown user Aug 25 16:15:40 mail dovecot: auth: Debug: ldap(e.etc(a)***.ru): user search: base=ou=XXX,dc=***,dc=local scope=subtree filter=(&(mail=e.etc@***.ru)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) fields=mail,quotaMail Aug 25 16:15:40 mail dovecot: auth: Debug: ldap(e.etc(a)***.ru): result: mail=e.etc(a)***.ru; mail unused Aug 25 16:15:40 mail dovecot: auth: Debug: ldap(e.etc(a)***.ru): result: mail=e.etc(a)***.ru; quotaMail missing Aug 25 16:15:40 mail dovecot: auth: Debug: userdb out: USER#0111#011e.etc@ ***.ru#011uid=5000#011gid=5000#011mail=maildir:/var/mail/***.ru/e.etc@ ***.ru#011home=/var/mail/***.ru/e.etc@***.ru/#011quota_rule=*:bytes= Aug 25 16:15:42 mail dovecot: auth: Debug: master in: USER#0111#011testmail@ ***.ru#011service=doveadm Aug 25 16:15:42 mail dovecot: auth-worker(15295): Debug: sql(testmail(a)***.ru): SELECT CONCAT('/var/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid, CONCAT('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = 'testmail(a)***.ru' AND domain = '***.ru' Aug 25 16:15:42 mail dovecot: auth-worker(15295): sql(testmail(a)***.ru): unknown user Aug 25 16:15:42 mail dovecot: auth: Debug: ldap(testmail(a)***.ru): user search: base=ou=XXX,dc=***,dc=local scope=subtree filter=(&(mail=testmail@***.ru)(objectClass=person)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) fields=mail,quotaMail Aug 25 16:15:42 mail dovecot: auth: Debug: ldap(testmail(a)***.ru): result: mail=testmail(a)***.ru quotaMail=2048576; mail,quotaMail unused Aug 25 16:15:42 mail dovecot: auth: Debug: ldap(testmail(a)***.ru): result: mail=testmail(a)***.ru quotaMail=2048576 Aug 25 16:15:42 mail dovecot: auth: Debug: userdb out: USER#0111#011testmail@ ***.ru#011uid=5000#011gid=5000#011mail=maildir:/var/mail/***.ru/testmail@ ***.ru#011home=/var/mail/***.ru/testmail@ ***.ru/#011quota_rule=*:bytes=2048576 Information from: http://dovecot.org/list/dovecot/2012-July/084859.html v2.1.7 2012-05-29 Timo Sirainen * LDAP: Compatibility fix for v2.0: ldap: If attributes contain ldapAttr=key=template%$ and ldapAttr *doesn't exist, skip the key* instead of using "template" value with empty %$ part for the key. OK, if quotaMail not set, shall apply root quota. Check LDAP: ldapsearch -x -h ***.***.local -D 'dovecot' -W -b 'OU=XXX,dc=***,dc=local' -s sub '(&(objectCategory=user)(objectClass=user)(mail=testmail(a)***.ru*))'|grep quotaMail Enter LDAP Password: quotaMail: 2048576 ldapsearch -x -h ***.***.local -D 'dovecot' -W -b 'OU=XXX,dc=***,dc=local' -s sub '(&(objectCategory=user)(objectClass=user)(mail=e.etc(a)***.ru*))'|grep quotaMail Enter LDAP Password: root@mail:/etc/dovecot# LDAP attribute *doesn't exist. * But Dovecot thinks that the quota is 0 and disables the quota. I can to set all the users quotaMail attribute, but a lot of them. Can I use root quota when the per-user quota is not set? Аnd change a per-user quota specific users only, if necessary? I apologize for my English. Thank you! -- Rasim Kalimullin

1 0

dict SQL : HA / RR load-balancing ?
by Florent Bautista 25 Aug '14

25 Aug '14

Hi everyone, I am using Dovecot 2.2 with dict SQL. My config is using : connect = host=10.111.5.1X host=10.111.5.1Y host=10.111.5.1Z dbname=mail user=quota_updater password=xxxxxxxx But when an SQL server is down, I have these messages in logs : dict: Error: mysql(10.111.5.1Y): Connect failed to database (mail): Can't connect to MySQL server on '10.111.5.1Y' (111) - waiting for 125 seconds before retry Does Dovecot support HA / RR load-balancing in dict SQL, as in passdb/userdb ? Thank you.

2 1

Director health checker
by Eduardo Ramos 24 Aug '14

24 Aug '14

Hi all. I'm writing a director health checker and ask you for suggestions. My project repository: https://github.com/duderamos/dovesitter Thanks.

2 1

does dovecot assume ~ = /home/userid ?
by Per Jessen 22 Aug '14

22 Aug '14

See $SUBJ - or is there a setting somewhere to control this? I have a userid = user(a)example.com with homedir (from /etc/shadow) = /home/example.com/user, but when dovecot wants to find e.g. ~/.dovecot.sieve , it looks in /home/user(a)example.com .... Doing "su - user(a)example.com" puts me in the correct directory. -- Per Jessen, Zürich (22.3°C) http://www.dns24.ch/ - your free DNS host, made in Switzerland.

2 2

Dovecot authentication LDAP SSL-TLS againts SAMBA4
by Lista de Dovecot 22 Aug '14

22 Aug '14

Hi, i would like to know if anybody have implemented the authentication of dovecot against samba4 via secure ldap (SSL/TLS). I made it but in plain text through dovecot´s offical page: http://wiki2.dovecot.org/AuthDatabase/LDAP/AuthBinds http://wiki2.dovecot.org/AuthDatabase/LDAP But when i try to do it in a secure way i can´t make it work. Samba4 is listening by port 636 and dovecot is speaking by 389 or 636, but they can´t comunicate themself. I´m wondering if any of you have done this before or have any clue that might help me. Thanks.

1 0

Avoid "451 4.4.0 Remote server not answering (timeout while waiting for reply to DATA reply)"
by Florent Bautista 22 Aug '14

22 Aug '14

Hi all, I have a Dovecot setup (2.1, I will switch to 2.2 soon) with one Director and 2 backend servers. When my MX server (Postfix) tries to deliver mail to Dovecot via LMTP, it often gets an error "451 4.4.0 Remote server not answering (timeout while waiting for reply to DATA reply)" from the Director. Service LMTP is configured with "client_limit = 1" on Director en backends (others limits are default ones). Postfix is using "lmtp_destination_recipient_limit = 1" and "lmtp_destination_concurrency_limit = 1". I want that incoming messages are stored one after one per recipient (have a queue per recipient). I does not seem to be done actually. I think Postfix is sending too many messages at a time to Director. How do you do to handle that ? I already applied the 3 patches available on the list for 2.1, but it does not seem to solve my problem... Thank you a lot. Florent

1 0

Folders don't show up
by Christian Hudon 22 Aug '14

22 Aug '14

Hello, I've upgraded to the new LTS version of Ubuntu. With that comes a new dovecot version. I think I've migrated my dovecot configuration correctly to the new version. Everything works, except that the mailboxes don't show up in the list of mailboxes in my mail clients. Trying to issue a LIST command, I see the following: CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot (Ubuntu) ready. 1 login USERNAME_HERE PASSWORD_HERE 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in 2 LIST "" "*" * LIST (\HasNoChildren) " * LIST (\HasNoChildren) " [SNIP... A bunch of other identical lines... roughly as many as I have mailboxes] * LIST (\HasNoChildren) " * LIST (\HasNoChildren) " * LIST (\HasChildren) " 2 OK List completed. I'm not an IMAP protocol expert, but those answers to the list command don't quite look like valid IMAP to me. My imapdir has a bunch of maildir directories in it, like a normal imapdir should. Everything worked fine with the previous version of dovecot (1.2?). Maybe a dovecot bug? At least I don't see how my config could cause this. Any help would be appreciated. The output of "dovecot -n" is included below. Thanks in advance, Christian ----cut here---- # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-34-generic i686 Ubuntu 14.04.1 LTS mail_location = maildir:~/IMAPdir:LAYOUT=imapdir mail_plugins = fts fts_squat passdb { args = scheme=SHA512-CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { fts = squat fts_squat = partial=4 full=10 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap { vsz_limit = 2 G } ssl_cert = </etc/ssl/certs/cert.pem ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!3DES:!MD5:!PSK ssl_dh_parameters_length = 2048 ssl_key = </etc/ssl/private/ssl.key ssl_prefer_server_ciphers = yes userdb { driver = passwd }

1 0

Thunderbird not able to edit sieve Message Filters
by Peter Bell 22 Aug '14

22 Aug '14

I'm not sure when this problem first occurred - it is many months since I last editted a sieve filter. I am certainly several versions of Thunderbird and, probably, a few versions of Dovecot on from when I last editted a sieve filter. However, I do know that I have done so in the past. I have just built Dovecot 2.2.13 and Pigeonhole 0.4.3, installed and running on Slackware 14.1 x64. I am running an up-to-date version of Thunderbird (31.0) on Arch Linux x64. The sieve filters are definitely being applied to incoming mail, and working perfectly well. However, when I attempt to edit the Sieve Filters (from Thunderbird Tools->Sieve Message Filters...), the Sieve Filters tab is displayed, but not populated (eg, the Server Sieve Capabilities are not displayed, and there is an endless 'hourglass' displayed in the main mailfilters pane. Does anyone recognise the symptoms and can advise how to resolve the problem, or suggest what logs I should examine/post in order to identify the cause? -- ------------------------------------------------------------------- Peter Bell Mob: +63 (0) 9287 340 343 Tagum City, Philippines. Tel: +63 (0) 84 216 9037 email/msn: peter(a)bellfamily.org.uk Tel: +63 (0) 84 308 0002

5 5

Assertion in istream.c::167 in POP3 mode when maildir content has wrong S value (using 2.2.13)
by Rolf Eike Beer 21 Aug '14

21 Aug '14

Hi, the affected machine is running 2.2.13 on Gentoo x86_64. For me it looks like the old size is still in some struct or whereever even after the file has been renamed. I see that there are many commits following 2.2.13, is that possibly already fixed or do I need to dig in the code? The original problem seems to be that maildrop uses the file size before piping the mail into spamassassin even if the mail is bigger afterwards. Not relevant here, but in case anyone wonders how this happens. Greetings, Eike Error: Cached message size smaller than expected (81118 < 81308) Error: Maildir filename has wrong S value, renamed the file from /var/vpopmail/domains/example.org/user/.maildir/cur/1408452738.16341.mail,S=81118:2, to /var/vpopmail/domains/example.org/user/.maildir/cur/1408452738.16341.mail,S=81308:2, Error: Corrupted index cache file /var/vpopmail/domains/example.org/user/.maildir/dovecot.index.cache: Broken physical size for mail UID 65 Panic: file istream.c: line 167 (i_stream_read): assertion failed: (old_size <= _stream->pos - _stream->skip) Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x6bbef) [0x7f50652a4bef] -> /usr/lib64/dovecot/libdovecot.so.0(+0x6bc4e) [0x7f50652a4c4e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f506525e2be] -> /usr/lib64/dovecot/libdovecot.so.0(i_stream_read+0x214) [0x7f50652ad904] -> /usr/lib64/dovecot/libdovecot.so.0(i_stream_read_data+0x3d) [0x7f50652adfed] -> /usr/lib64/dovecot/libdovecot.so.0(message_get_body_size+0x9d) [0x7f5065299b3d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_init_stream+0x200) [0x7f506556f700] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x2dd0f) [0x7f506553cd0f] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_get_stream+0x4b) [0x7f506554915b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x2dae7) [0x7f506553cae7] -> dovecot/pop3(client_create+0x56d) [0x40622d] -> dovecot/pop3() [0x404ea3] -> dovecot/pop3() [0x40508f] -> /usr/lib64/dovecot/libdovecot.so.0(+0x28346) [0x7f5065261346] -> /usr/lib64/dovecot/libdovecot.so.0(+0x28841) [0x7f5065261841] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x4e) [0x7f50652b58de] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xd7) [0x7f50652b68b7] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f50652b5969] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f50652b59e8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f50652635a3] -> dovecot/pop3(main+0x233) [0x404bf3] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f5064eb6db5] -> dovecot/pop3() [0x404d49]

1 1

About network throughput between Director and backends
by Listas＠Adminlinux 21 Aug '14

21 Aug '14

I plan to migrate my Dovecot IMAP servers to a clustered structure. I'm planning a cluster with high availability and load balancing. I know I need instances of Dovecot Proxy / Director. But these instances can be on another network? There is need for high network throughput between the Director and the backends? For me it would be cheaper to run Director in VM's at Amazon AWS for example. Thanks! -- Thiago Henrique

1 0

doveadm proxy list
by Claus 21 Aug '14

21 Aug '14

Hi, i have configured my dovecot-proxy with "shutdown_clients = no" and "service_count = 1" for a "default_process_limit = 5000" and "default_client_limit = 25000". I don't know if this is a prefered setup for so many users/concurrent sessions but so i can reload my dovecot without disconnecting all sessions. The main problem are pop3 sessions - if i kill them, the mailbox remains locked and the client gets an error. Back to my problem: If i reload dovecot the "doveadm proxy list" shows me the list of the new processes. Is there any possibility to see the stats of the old sessions (user,source,destination) ? greet's Claus PS.: Could someone explain me why i have to set default_client_limit to 5x default_process_limit?

2 2

rebuilding indexes for dovecot pop3
by Arkadiusz Miśkiewicz 21 Aug '14

21 Aug '14

Hi. doveadm -D fetch -u login \ 'imap.envelope imap.bodystructure size.virtual date.received' '*' according to mail archives allows to regenerate indexes and precache specified headers for imap usage. What headers are needed for dovecot pop3 daemon? I have one server where dovecot works for imap only. For pop3 there is different software being used. I want to migrate to dovecot pop3 but I need to precache and regenerate indexes for dovecot pop3. Note, some users used pop3 only, so dovecot imap had no chance to generate any indexes. Thanks, -- Arkadiusz Miśkiewicz, arekm / maven.pl

2 2

Re: Frequent error: unknown namespace Trash
by Michael Ludwig 21 Aug '14

21 Aug '14

Hi Gedalya, I am very sorry for not having replied on-list. That was not my intention! I am not used to this behaviour of mailing lists, normally there is a reply-to field which points to the mailing list mail address. So do I have to use MAILBOX.Trash in 90-quota.conf ?? Or INBOX.Trash ? Cheers, Michael 2014-08-12 19:33 GMT+02:00 Gedalya <gedalya(a)gedalya.net>: > On 08/12/2014 09:28 AM, Michael Ludwig wrote: > >> prefix = INBOX. >> separator = . >> > Maybe that's it? It's therefore MAILBOX.Trash, not just Trash. > > You're supposed to reply on-list! Don't reply to gedalya(a)gedalya.net, > reply to dovecot(a)dovecot.org. If you want you can also cc the message > author, some people do that. > >

3 3

Fatal: lazy_expunge: Unknown namespace: '.EXPUNGED/'
by Philipp Faeustlin 21 Aug '14

21 Aug '14

Hello List, with dovecot version 2.2.13.9, I actually have a problem using lazy_expunge and acl together. Shared/Public Folders work fine with lazy_expunge disabled. If lazy_expunge is enabled and userA got a shared folder form userB, then there is the error shown in subject. My test case to reproduce the error. doveadm mailbox list -u userA@domain --> Output Fine. doveadm acl set -u userB@domain INBOX user=userA@domain lookup read write write-seen write-deleted insert expunge create --> Fine. doveadm mailbox list -u userA@domain --> Some output and then: --> doveadm(userA@domain): Fatal: lazy_expunge: Unknown namespace: '.EXPUNGED/' I think this is a bug in dovecot, can someone of the dovecot developers or someone else confirm this? If it is not please show me the fault in my configuration. In May 2014 there was a thread with the same issue on this mailing list, but with no solution. http://dovecot.org/pipermail/dovecot/2014-May/096355.html Best regards Philipp Fäustlin --------------------------------------------- # 2.2.13.9 (19befd72d9d8): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.11.2.el6.x86_64 x86_64 Scientific Linux release 6.5 (Carbon) auth_debug = yes auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %Ln auth_verbose = yes listen = * mail_debug = yes mail_gid = vmail mail_location = maildir:~/maildir mail_plugins = " acl lazy_expunge mail_log notify zlib notify replication" mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace { hidden = no ignore_on_failure = no inbox = no list = children location = maildir:%%h/maildir:INDEX=%h/Shared/%%u:CONTROL=%h/Shared/%%u prefix = Shared/%%u/ separator = / subscriptions = yes type = shared } namespace { location = maildir:/vmail/%d/public:INDEXPVT=~/index/%d/public prefix = Groups/ separator = / subscriptions = no type = public } namespace { hidden = yes list = no location = maildir:~/expunged prefix = .EXPUNGED/ separator = / subscriptions = no type = private } namespace inbox { inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db lazy_expunge = .EXPUNGED/ lazy_expunge_only_last_instance = yes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcps:mailhost1.rz.uni-hohenheim.de:12345 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } protocols = imap pop3 lmtp sieve replication_dsync_parameters = -d -l 30 -U service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service doveadm { inet_listener { port = 12345 ssl = yes } } service imap-login { process_min_avail = 16 service_count = 0 } service imap-postlogin { executable = script-login /usr/local/bin/postlogin.sh user = $default_internal_user } service imap { executable = imap imap-postlogin process_limit = 8192 } service lmtp { unix_listener /var/spool/postfix/private/lmtp-dovecot { group = postfix user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { process_min_avail = 16 service_count = 0 } service pop3 { process_limit = 8192 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = vmail mode = 0660 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_client_ca_file = /etc/openldap/cacerts/chain.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lmtp { mail_plugins = " acl lazy_expunge mail_log notify zlib notify replication sieve" } protocol imap { mail_plugins = " acl lazy_expunge mail_log notify zlib notify replication imap_acl imap_zlib" }

1 1

New user mailbox permission
by Gionatan Danti 21 Aug '14

21 Aug '14

Hi all, I have a problem with my Dovecot installation. First, some informations: - OS: CentOS 6.5 x86_64 - Dovecot: dovecot-2.0.9-7.el6.x86_64 Config: mail_location = sdbox:~/dbox user_query = SELECT username, password, 'vmail' as uid, 'vmail' as gid, '/var/vmail/%d/%n' as home, CONCAT('*:storage=', (quota DIV 1000)) as quota_rule FROM mailbox WHERE username='%u' What I want to do is to create a backup user to rsync the mailstore to a remote location. If possible, I don't want to use the root user for this operation. I already added the backup user to "vmail" group. The problem is that when a new user is created, it's base directory permission are 0700 (vmail:vmail). From what I read here (http://wiki2.dovecot.org/SharedMailboxes/Permissions, "Permissions to new /domain/user directories"), simply using the setgid bit is not sufficient because I am not using an absolute path for mail_location. My questions are: 1) all I need to do is to switch to an absolute mail_location? 2) it is possibile to solve my problem _without_ altering mail_location? Thanks. -- Danti Gionatan Supporto Tecnico Assyoma S.r.l. - www.assyoma.it email: g.danti(a)assyoma.it - info(a)assyoma.it GPG public key ID: FF5F32A8

2 2

How to configure read-only access during a migration?
by Jeffrey Tunison 20 Aug '14

20 Aug '14

Hi. I would appreciate your advice about these TWO PROBLEMS: ======================================================= Find the simplest way to A) configure a Dovecot 2.2.10 IMAP server to access (existing) email users' (mbox-format) mail folders ****in read-only mode.**** B) Do the above while allowing a master_user to access mail on behalf of real users. (I've got master_user access working in read-write mode.) Simplest because while I'm proficient at UNIX systems administration, I'm under time pressure and dovecot has a lot of configuration flexibility. Identifying the right way to do this is proving time- consuming. Namespaces? ACL's? passdb's? I thought it was time to bring in the dovecot wizards. You! GOAL: ======================================================= Without knowing or changing users' passwords, migrate several hundred users of dovecot IMAP to MS Exchange using the commercial product Transend. I'm manging the dovecot side, someone else is doing the Transend/Exchange piece. Migration would occur in batches due to slowness of the Transend side when dealing with users with email collections over a few gigabytes. I have a production IMAP server (dovecot 1.0.13 on 32-bit RHEL 4.9). Let's call it PROD for short. Users INBOXes are stored locally on PROD. Their other mail folders are stored on a second machine and accessed via NFS. Those other folders contain the great majority of the email to be migrated. Let's call the NFS server MIGR for short. On MIGR, I've set up a migration IMAP server (dovecot 2.2.10 on 64-bit RHEL 5.10). MIGR is a dedicated NFS server with newer hardware than PROD. It has an unused Ethernet NIC I can tell Transend to use. Both PROD and MIGR use NIS for authentication. Therefore PAM is consulted for passdb information, normally. No SQL db's used. I set up the second server (MIGR) for several reasons: 1) there are some users mail folders larger than the 32-bit file size limit found on the PROD server. 2) the bulk of the email is stored locally on the MIGR server. 3) the version of dovecot is much newer and therefore more likely to have fewer bugs and more configuration options. 4) I don't want to modify the production environment except where really necessary. Pointing Transend at MIGR instead of PROD seems like it will be faster and better. Telling end-users to use MIGR instead of PROD would allow them to verify that their email came across okay (into MS Exchange) without being able to modify the original copy of email (in Dovecot). In the days and weeks after migration. I may need to re-enable write access on PROD for certain users if the migration does not succeed. Transend has been dying on a number of test users despite tweaking its parameters in consultation with the vendor. "Corrupt" messages seem to be the issue. Users (or sysadmins) might be required to identify and delete the offending messages before we retry their migration. (Which folders and which messages are causing problems will hopefully be discernible in Transend logs.) Ha! If you've read this far, then I'd also say that I welcome any advice on changes to increase performance on MIGR, such as whether trying to minimize indexing as I've done is useful. Current configurations of the two servers follow. =========================================================================== PRODUCTION: =========================================================================== # 1.0.13: /etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot.log protocols: imaps imap listen: *:143 ssl_listen: *:993 ssl_cert_file: /etc/pki/dovecot/certs/dovecot.pem ssl_key_file: /etc/pki/dovecot/private/dovecot.key login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login login_processes_count: 20 login_max_processes_count: 500 max_mail_processes: 1524 first_valid_uid: 100 mail_location: mbox:~/Mail:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot-indexes/%u/ mbox_read_locks: dotlock mbox_write_locks: dotlock mbox_dotlock_change_timeout: 60 mbox_min_index_size: 2048 namespace: type: private separator: / inbox: yes namespace: type: private separator: / prefix: Mail/ hidden: yes namespace: type: private separator: / prefix: ~/Mail/ hidden: yes namespace: type: private separator: / prefix: mail/ hidden: yes namespace: type: private separator: / prefix: ~/mail/ hidden: yes auth default: master_user_separator: * verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd-file args: /etc/dovecot.transend master: yes passdb: driver: shadow passdb: driver: pam userdb: driver: passwd =========================================================================== MIGRATION: =========================================================================== # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-348.18.1.el5 x86_64 Scientific Linux release 5.10 (Boron) auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_verbose = yes auth_verbose_passwords = plain first_valid_uid = 100 log_path = /var/log/dovecot.log mail_debug = yes mail_location = mbox:~/Mail:INBOX=/var/spool/concmail/%u:INDEX=MEMORY mbox_min_index_size = 50048 B mbox_write_locks = fcntl namespace four { hidden = yes location = prefix = ~/mail/ separator = / } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } namespace one { hidden = yes location = prefix = Mail/ separator = / } namespace three { hidden = yes location = prefix = mail/ separator = / } namespace two { hidden = yes location = prefix = ~/Mail/ separator = / } passdb { args = /etc/dovecot/dovecot.transend driver = passwd-file master = yes } passdb { driver = pam } protocols = imap service imap-login { process_min_avail = 15 service_count = 10 } service imap { process_limit = 2048 } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 1000 }

1 0

LMTP re-reading all messages
by Florent Bautista 20 Aug '14

20 Aug '14

Hi all, I have a little problem with Dovecot 2.1.17 and MailDir accounts. I was using a shared file system (MooseFS), and all was pretty stable. Now I'm switching to CephFS, and Dovecot LMTP have problem to deliver mails. Very often, on large accounts, LMTP processes are running for a few hours before delivering the message. When I strace it, I can see that they are reading (open and stat operations) ALL the messages of the account. I was thinking to an index problem, but I think that after hundreds of delivered mails, indexes are rebuilded and problem should be solved. But not. The same way, If user connects to IMAP, a lot of IMAP processes get stuck on "getquotaroot" command (multiple processes for a single account). The previous FS didn't support mmap, so I disabled it. The new one supports it, so I enabled it, but it does not solve the problem. Do you have an idea of why Dovecot (LMTP or IMAP) spend a lot of time on large accounts ? Thank you a lot. Florent

2 2