- dovecot - dovecot.org

[Dovecot] "Select Inbox" drops connection. IMAP troubleshooting help available?
by Thor Legvold 11 Dec '13

11 Dec '13

Newbie to the list here. I don’t know if this is Dovecot specific, but I can see that my IMAP server is running Dovecot. So far (as a client) I haven’t been able to figure out how to get it to tell me the version number. What I’m trying to get is more detailed info in order to debug an IMAP problem. I’ve been unable to retrieve email since the 27th of November on this specific account. Another user on the same domain/email receives and sends email just fine. Having tried both Apple Mail, Thunderbird, as well as a Telnet terminal connection, I see two problems, but am unaware of what to do from here to verify or fix the problem. First is that the SSL certificate is a self signed one from some local hosting service. Fair enough, I told OS X to trust it (for now), both in Mail and Thunderbird (and Safari). Second is that when logging in via the terminal, I can log in fine, navigate to any folder and read any email on the server - with the exception of the Inbox. Anytime I issue a “Select” or “Examine” command with the “Inbox” as argument, the connection is dropped. E.g.: after logging in, listing folders, navigating around, I do this: a select inbox closed Sonovo:~ Thunder$ and am back at the terminal prompt. If I do an “Email Trace” in CPanel on my server (hosting both my website and IMAP email accounts), I see a long list of emails accepted to my address and in the system, but I cannot seem to access them from any client. There may well be a better list/forum for discussing this kind of thing. I was actually on a mailing list years ago with Mark Crispin himself, but haven’t spoken with him in 10 years or more. I’m not sure where to go for more help/info. I’m not a complete (l)user, but nor am I a guru (tm). Any tips or help is greatly appreciated! Sonovo

2 2

[Dovecot] post-logout scripting
by Jouko Nikula 11 Dec '13

11 Dec '13

Hi all, I found this (http://www.dovecot.org/list/dovecot/2010-January/045717.html) describing how to do a post-logout script. But is this valid anymore? It seems I'm getting error when trying to execute imap process in post-logout script and post logout documentation does not talk about executing imap. I'm trying to umount (virtual) user home directory when user logs out. Thanks, - Jouko

2 2

[Dovecot] undoing a zlib test
by Terry Barnum 10 Dec '13

10 Dec '13

I'm trying to undo a dovecot zlib test and uncompress 6 emails in my Junk mailbox. There are about 25 total in different mailboxes but I thought I'd first start with those in my Junk. I ran: # dsync -v -u terry(a)dop.com -m Junk -o plugin/zlib_save= backup maildir:/path/to/temp/folder which returned without error and backed up my Junk mailbox but didn't uncompress the 6 emails. Am I calling dsync incorrectly to uncompress? zlib is currently not loaded as a plugin. Once I get them uncompressed is doveadm import the correct way to get them back into my Junk mailbox? Something like this? # doveadm -v import -u terry(a)dop.com maildir:/path/to/temp/folder "" mailbox Junk SENTON 2013-12-06 Thanks, -Terry # 2.2.9: /opt/local/etc/dovecot/dovecot.conf # OS: Darwin 11.4.2 x86_64 hfs auth_verbose = yes base_dir = /opt/local/var/run/dovecot/ default_internal_user = _dovecot default_login_user = _dovenull first_valid_uid = 102 last_valid_uid = 105 listen = * mail_gid = 102 mail_location = maildir:/Volumes/mail/vmail/%d/%u mail_uid = 102 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /opt/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_backend = dspam antispam_debug_target = syslog antispam_dspam_args = --user;%u;--deliver=;--source=error;--signature=%%s antispam_dspam_binary = /opt/local/bin/dspamc antispam_dspam_notspam = --class=innocent antispam_dspam_result_header = X-DSPAM-Result antispam_dspam_spam = --class=spam antispam_signature = X-DSPAM-Signature antispam_signature_missing = move antispam_spam_pattern_ignorecase = junk;spam;junk * antispam_trash_pattern_ignorecase = trash;deleted * mail_log_events = flag_change append delete undelete expunge copy sieve = ~/dovecot.sieve sieve_before = /Volumes/mail/vmail/%d/global/global.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve sendmail_path = /opt/local/sbin/sendmail service auth-worker { user = $default_internal_user } service auth { unix_listener /opt/local/var/spool/postfix/private/auth { group = _postfix mode = 0660 user = _postfix } unix_listener auth-userdb { mode = 0660 user = _vmail } } ssl_cert = </opt/local/etc/ssl/certs/dovecot.cert ssl_key = </opt/local/etc/ssl/private/dovecot.key userdb { args = /opt/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " sieve" } protocol lda { mail_plugins = " sieve" postmaster_address = postmaster(a)dop.com } protocol imap { mail_max_userip_connections = 50 mail_plugins = " antispam" } Terry Barnum digital OutPost http://www.dop.com

2 2

Re: [Dovecot] Index issue? - SOLVED
by IT geek 31 10 Dec '13

10 Dec '13

They were subscribed in Outlook, but there's no option to set that on the iPad. The solution was to edit the mail account settings on the iPad and specify a root folder "INBOX" (minus quotes). -Mark On 10 December 2013 13:15, Daniel Parthey <d.parthey(a)metaways.de> wrote: > Are all the subfolders subscribed? > > For example Thunderbird doesn't show unsubscribed folders by default. > > Regards > Daniel

1 0

[Dovecot] dsync verbosity, summary of transfer
by Alan McGinlay - SICS 10 Dec '13

10 Dec '13

Hi! I am playing with dsync and trying to fix an issue I have mentioned in another thread (subject: "Re: [Dovecot] Dsync error: Couldn't drop privileges: getgrnam") and feel that dsync could use some additional informational output. It would be particularly helpful while experimenting with a migration if it could output a transfer summary and / or log separately. A summary could be similar to that which imapsync outputs after completion, for example: ++++ Statistics Transfer started on : Thu Dec 5 20:30:05 2013 Transfer ended on : Thu Dec 5 20:32:00 2013 Transfer time : 114.3 sec Messages transferred : 7 Messages skipped : 766 Messages found duplicate on host1 : 0 Messages found duplicate on host2 : 0 Messages void (noheader) on host1 : 0 Messages void (noheader) on host2 : 0 Messages deleted on host1 : 0 Messages deleted on host2 : 9 Total bytes transferred : 71820 (70.137 KiB) Total bytes duplicate host1 : 0 (0.000 KiB) Total bytes duplicate host2 : 0 (0.000 KiB) Total bytes skipped : 10070561 (9.604 MiB) Total bytes error : 0 (0.000 KiB) Message rate : 0.1 messages/s Average bandwidth rate : 0.6 KiB/s Reconnections to host1 : 0 Reconnections to host2 : 0 Memory consumption : 90.5 MiB Biggest message : 39274 bytes Detected 0 errors

1 0

[Dovecot] Dovecot+LDAP lda problem
by Zeljko Culek 10 Dec '13

10 Dec '13

Hello everyone, I need some help with Dovecot+LDAP config and local delivery. We're using Dovecot 2.0.9 on Centos 6.4. Before, we used Qmail with the same LDAP. Our LDAP accounts have the attribute deliveryMode which we used for mailing lists (OK, they are in fact mailing groups rather than lists). When the attribute is set to deliveryMode = nolocal Qmail did not deliver mail to the list mailbox, only to the accounts on the list/group. Now with Dovecot(+postfix) I can't achieve the same behaviour. Can Dovecot be set up not to deliver the mail to the list mailbox if the list has the attribute deliveryMode = nolocal? This is my /etc/dovecot/conf.d/dovecot-ldap.conf.ext hosts = xxx.xxx.xxx.xxx auth_bind = yes dn = cn=admin,dc=nth,dc=ch dnpass = xxxxxxxxxx ldap_version = 3 base = dc=nth,dc=ch #deref = always scope = subtree user_attrs = mail=user user_filter = (|(&(objectclass=inetOrgPerson)(mail=%u))(|(mailAlternateAddress=%u))) pass_attrs = uid=user pass_filter = (&(objectclass=inetOrgPerson)(|(mail=%u)(mailAlternateAddress=%u))) default_pass_scheme = CRYPT Basicaly, I want to make check: if deliveryMode=nolocal > do not deliver to mail=some.mail(a)tld.com (only to mailForwardingAddress) else deliver normally :) Thnx, -- Zeljko Culek IT Department Samurai Digital d.o.o. NTH Group Office Osijek Ivana Gundulica 5 31000 Osijek, Croatia Mobile company: 00385 99 262 2661 [VPN 214] Skype: nthuser128 Email: zeljko.culek(a)nth.ch www.nth.ch

3 5

[Dovecot] Dovecot+LDAP lda problem
by Zeljko Culek 10 Dec '13

10 Dec '13

Hello everyone, I need some help with Dovecot+LDAP config and local delivery. We're using Dovecot 2.0.9 on Centos 6.4. Before, we used Qmail with the same LDAP. Our LDAP accounts have the attribute deliveryMode which we used for mailing lists (OK, they are in fact mailing groups rather than lists). When the attribute is set to deliveryMode = nolocal Qmail did not deliver mail to the list mailbox, only to the accounts on the list/group. Now with Dovecot(+postfix) I can't achieve the same behaviour. Can Dovecot be set up not to deliver the mail to the list mailbox if the list has the attribute deliveryMode = nolocal? This is my /etc/dovecot/conf.d/dovecot-ldap.conf.ext hosts = xxx.xxx.xxx.xxx auth_bind = yes dn = cn=admin,dc=nth,dc=ch dnpass = xxxxxxxxxx ldap_version = 3 base = dc=nth,dc=ch #deref = always scope = subtree user_attrs = mail=user user_filter = (|(&(objectclass=inetOrgPerson)(mail=%u))(|(mailAlternateAddress=%u))) pass_attrs = uid=user pass_filter = (&(objectclass=inetOrgPerson)(|(mail=%u)(mailAlternateAddress=%u))) default_pass_scheme = CRYPT Basicaly, I want to make check: if deliveryMode=nolocal > do not deliver to mail=some.mail(a)tld.com (only to mailForwardingAddress) else deliver normally :) Thnx, Zeljko

1 0

[Dovecot] Index issue?
by IT geek 31 10 Dec '13

10 Dec '13

I've just hastily migrated from Dovecot 1.2.9 to 2.2.9 due to a disk crash. When I say hastily, I literally copied the user's mail data files to the new server and then started the Dovecot service. The trouble is, I now have a user who can see all the subfolders of her inbox in Outlook, but not on her iPad. Do I need to re-index her mail folders? The data is there (as seen by Outlook 2013) and is good, but the iPad mail client only sees the top-level folder. Any thoughts? -Mark

3 2

[Dovecot] Problem with INDEXes and deleting shared folders
by Achim Gottinger 10 Dec '13

10 Dec '13

Hi, I use dovecot 2.1.7 on debian wheezy. I have a bunch of shared folders whom i configured to store the indexe's under the users mail_location/shared/%%u. I configured acl's for those shared folders in an way that all users should be able to add and delete folders (for example "group=buchhaltung keilrwtsx"). Creating folders works fine but if i try to delete such an folder i get the following error. Dec 10 12:03:41 logon-zor dovecot: imap(ag): Debug: Can't rename 'shared/buchhaltung/Test' to 'Trash/Test': one namespace has index dir and another doesn't Of course there is no dovecot.index file in /home/vmail/buchhaltung/mai/.Test but there is one in /home/ag/vmail/mail/shared/buchhaltung/.Test and in /home/ag/vmail/mail/.Trash. Seems dovecot does not honour the shared namespaces index settings when trying to rename that folder. Is there an fix for this issue in 2.1.7 or would upgrade to 2.2.5 (from debian unstable) help? Thanks in advance Achim Gottinger Here are my namespace mail_location etc. settings: mail_home = /home/vmail/%u mail_location = maildir:/home/vmail/%u/mail:INDEX=/home/vmail/%u/mail:INBOX=/home/vmail/%u/mail/.INBOX mail_uid = 998 mail_gid = 998 first_valid_uid = 998 first_valid_gid = 998 mail_shared_explicit_inbox = yes maildir_very_dirty_syncs = yes namespace { list = children location = maildir:/home/vmail/%%u/mail:INDEX=/home/vmail/%u/mail/shared/%%u:INBOX=/home/vmail/%%u/mail/.INBOX prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { inbox = yes location = maildir:/home/vmail/%u/mail:INDEX=/home/vmail/%u/mail:INBOX=/home/vmail/%u/mail/.INBOX prefix = separator = / type = private }

1 1

[Dovecot] Panic: file acl-cache.c
by Helga.Mayer＠uni-hohenheim.de 10 Dec '13

10 Dec '13

Hello, our dovecot mailservice was running smoothly for a long time. Since last week we get the following error message when connecting from the horde/imp webmailer to the public namespace: Panic: file acl-cache.c: line 294 (acl_cache_update): assertion failed: (obj_cache->my_current_rights != &negative_cache_entry) Dovecot and horde/imp are running on seperate hosts. There are no known recent configuration changes, neither on the webmailer nor on the dovecot host. Helga dovecot -n # 1.2.17: /etc/dovecot.conf # OS: Linux 2.6.18-238.9.1.el5 x86_64 Scientific Linux SL release 5.5 (Boron) listen(default): 192.168.0.104:143 127.0.0.1:143 144.41.4.87:143 listen(imap): 192.168.0.104:143 127.0.0.1:143 144.41.4.87:143 listen(pop3): *:110 ssl_listen(default): 144.41.4.28:993 ssl_listen(imap): 144.41.4.28:993 ssl_listen(pop3): 144.41.4.28:995 ssl_cert_file: /etc/ssl/certs/imapd.pem ssl_key_file: /etc/ssl/certs/imapd.pem disable_plaintext_auth(default): no disable_plaintext_auth(imap): no disable_plaintext_auth(pop3): yes login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_max_processes_count: 2048 max_mail_processes: 2048 first_valid_uid: 200 mail_drop_priv_before_exec(default): yes mail_drop_priv_before_exec(imap): yes mail_drop_priv_before_exec(pop3): no mail_executable(default): /afs/hoh/common/etc/mail/bin/acl-groups mail_executable(imap): /afs/hoh/common/etc/mail/bin/acl-groups mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_process_size: 1024 mail_plugins(default): acl imap_acl lazy_expunge metadata imap_annotatemore mail_log mail_plugins(imap): acl imap_acl lazy_expunge metadata imap_annotatemore mail_log mail_plugins(pop3): lazy_expunge mail_log mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 mail_log_max_lines_per_sec: 0 imap_client_workarounds(default): tb-extra-mailbox-sep imap_client_workarounds(imap): tb-extra-mailbox-sep imap_client_workarounds(pop3): namespace: type: private separator: / location: maildir:/maildir/%1n/%u:LAYOUT=fs inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: .EXPUNGED/ location: maildir:/maildir/expunged/%1n/%u:LAYOUT=fs hidden: yes list: no subscriptions: yes namespace: type: shared separator: / prefix: Shared/%%u/ location: maildir:/maildir/%%1n/%%u:LAYOUT=fs list: children namespace: type: public separator: / prefix: Groups/ location: maildir:/maildir/public:LAYOUT=fs list: children namespace: type: public separator: / prefix: .G-EXPUNGED/ location: maildir:/maildir/expunged/public:LAYOUT=fs hidden: yes list: no subscriptions: yes lda: postmaster_address: postmaster(a)uni-hohenheim.de mail_plugins: acl auth default: mechanisms: plain login verbose: yes debug: yes passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/spool/postfix/private/auth-master mode: 384 user: postfix group: postfix plugin: mail_log_events: delete undelete expunge copy mailbox_delete mailbox_rename mail_log_group_events: mail_log_fields: uid box msgid size acl: vfile acl_shared_dict: proxy::acl_dict lazy_expunge: .EXPUNGED/ metadata_dict: proxy:/var/run/dovecot/dict-server:metadata dict: acl_dict: mysql:/etc/dovecot-dict-sql.conf metadata: sqlite:/etc/metadata-dict.conf -- This smoke signal communication (and any attachment/s) is confidential and intended only for the individual(s) or entity named above and to others who have been specifically authorized to receive it. If you are not the intended recipient, please do not read, copy, use or disclose the contents of this communication to others. Please notify the sender that you have received this smoke signal in error, by calling the phone number indicated or by smoke signals, and stamp out the fire (including any attachment/s) subsequently. Thank you.

1 0

[Dovecot] Dovecot - solr - user unknown
by dvm＠rdyn.net 09 Dec '13

09 Dec '13

Hi all, I am running dovecot with solr on centos 6.5. In my dovecotlog i am getting the following error for any user : Dec 09 16:03:22 indexer-worker: Error: User me(a)mydomain.net lookup failed: Unknown user everything else works ok and no mail-issues. I have been searching and searching and really cant figure it out. Probably i overlooked something dumb, I hope someone can help me out here ? would be very appreciated. (if i posted anything wrong sorry this is my first time) Kind regards, Johan. my configs : (dovecot 2.2.9 - solr 4.6 standard install - centos 4.6) --------------- 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.el6.x86_64 x86_64 CentOS release 6.5 (Final) auth_master_user_separator = * auth_mechanisms = PLAIN LOGIN dict { acl = mysql:/etc/dovecot/dovecot-share-folder.conf quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf } first_valid_uid = 2000 last_valid_uid = 2000 listen = * log_path = /var/log/dovecot.log mail_gid = 2000 mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/ mail_plugins = quota fts fts_solr mail_uid = 2000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:/%%Lh/Maildir/:INDEX=/%%Lh/Maildir/Shared/%%u prefix = Shared/%%u/ separator = / subscriptions = yes type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/dovecot/dovecot-master-users-password driver = passwd-file master = yes } plugin { acl = vfile acl_shared_dict = proxy::acl auth_socket_path = /var/run/dovecot/auth-master autocreate = INBOX autocreate2 = Sent autocreate3 = Trash autocreate4 = Drafts autocreate5 = Junk autosubscribe = INBOX autosubscribe2 = Sent autosubscribe3 = Trash autosubscribe4 = Drafts autosubscribe5 = Junk fts = solr fts_autoindex = yes fts_solr = break-imap-search url=http://localhost:8983/solr/ quota = dict:user::proxy::quotadict quota_rule = *:storage=1G quota_warning = storage=85%% quota-warning 85 %u quota_warning2 = storage=90%% quota-warning 90 %u quota_warning3 = storage=95%% quota-warning 95 %u sieve = /%Lh/sieve/dovecot.sieve sieve_dir = /%Lh/sieve sieve_global_dir = /var/vmail/sieve sieve_global_path = /var/vmail/sieve/dovecot.sieve } protocols = pop3 imap sieve service auth { unix_listener /var/spool/postfix/dovecot-auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { group = vmail mode = 0666 user = vmail } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { process_limit = 500 service_count = 1 } service pop3-login { service_count = 1 } service quota-warning { executable = script /usr/local/bin/dovecot-quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } } ssl = required ssl_cert = </etc/pki/tls/certs/rmac.pem ssl_key = </etc/pki/tls/private/rmac.key userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocol lda { auth_socket_path = /var/run/dovecot/auth-master lda_mailbox_autocreate = yes log_path = /var/log/sieve.log mail_plugins = quota fts fts_solr sieve autocreate postmaster_address = root } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_plugins = quota fts fts_solr imap_quota } protocol pop3 { mail_plugins = quota fts fts_solr pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } ----- dovecot-ldap.conf hosts = 127.0.0.1:389 ldap_version = 3 auth_bind = yes dn = cn=vmail,dc=mydomain,dc=net dnpass = mypassword base = o=domains,dc=mydomain,dc=net scope = subtree deref = never # Below two are required by command 'doveadm mailbox ...' iterate_attrs = mail=user iterate_filter = (&(objectClass=mailUser)(accountStatus=active)(enabledService=mail)) user_filter = (&(objectClass=mailUser)(accountStatus=active)(enabledService=mail)(enabledService=%Ls%Lc)(|(mail=%u)(&(enabledService=shadowaddress)(shadowAddress=%u)))) user_attrs = mail=user,homeDirectory=home,=mail=maildir:~/Maildir/,mailQuota=quota_rule=*:bytes=%$ pass_filter = (&(objectClass=mailUser)(accountStatus=active)(enabledService=mail)(enabledService=%Ls%Lc)(|(mail=%u)(&(enabledService=shadowaddress)(shadowAddress=%u)))) pass_attrs = mail=user,userPassword=password default_pass_scheme = CRYPT ------------------- -- This email was Virus checked by UTM 9. http://www.astaro.com

1 0

[Dovecot] Question regarding quotas (is this a bug or intended behavior) ?
by Gilles Chauvin 09 Dec '13

09 Dec '13

Hi, I was wondering if this is a normal behavior (test was made using Dovecot v2.2.9). In my config, quotas are configured as follows: plugin { quota = dict:Userquota::file:%h/dovecot-quota quota_rule = *:storage=1G quota_rule2 = Trash:ignore } # doveadm mailbox status -u my_user "messages vsize" '*' Trash messages=4997 vsize=229535631 Drafts messages=0 vsize=0 Sent messages=0 vsize=0 Junk messages=0 vsize=0 INBOX messages=0 vsize=0 # doveadm -f flow quota get -u my_user Quota name=Userquota Type=STORAGE Value=0 Limit=1048576 %=0 Quota name=Userquota Type=MESSAGE Value=0 Limit=- %=0 The 4997 mails in the Trash mailbox are ignored as desired, but now, if I have the following case: # doveadm mailbox status -u my_user "messages vsize" '*' Trash messages=0 vsize=0 Trash/TEST messages=4997 vsize=229535631 Drafts messages=0 vsize=0 Sent messages=0 vsize=0 Junk messages=0 vsize=0 INBOX messages=0 vsize=0 (As you can see mails were moved to a Trash/TEST mailbox) # doveadm -f flow quota get -u my_user Quota name=Userquota Type=STORAGE Value=220918 Limit=1048576 %=21 Quota name=Userquota Type=MESSAGE Value=4997 Limit=- %=0 I tried to add the following quota_rule: quota_rule3 = Trash/*:ignore But this doesn't fix anything. Do you have any idea about why this is not working ? Thanks, Regards, Gilles.

2 5

[Dovecot] Use Replication plugin to do a backup (one-direction sync)
by Francesco Barresi 09 Dec '13

09 Dec '13

Hello, I have a setup where I need to have Server A (dovecot 2.1.7) replicated on a Server B (dovecot 2.1.7). I know that I can do a per user backup with: doveadm -D backup -u %u remote:mailmirror@serverB I would like to use Notify/Replication to backup only when there's something new. I don't understad if the Replication plugin can be used to do a backup server, or it's only of for two-way sync? My question is: It's possible to use Replication to do a backup (one-direction sync)? Thanks Francesco

1 0

[Dovecot] backup mdbox best strategy
by Claus 09 Dec '13

09 Dec '13

Hello, i have to backup (tape library) a mailsystem with about 300.000 Mailboxes on 2 backends. Summary of all mailboxes are 2 TByte. The mailstore is mdbox. Is it save to do a simple filesystem backup (full and incremental) with backupsoftware? What is the prefered strategy to do a backup for desaster recovery (mailsystem crash) and restoring single usermailboxes? Regards, Claus

5 9

[Dovecot] Expire plugin - empty expires table
by Peter Šori 09 Dec '13

09 Dec '13

Hello, Dovecot does not fill expires table when moving messages to Trash or Junk folder. I looked all over mailing list and googled around and cannot find what could be wrong - pleas help :) Dict works for quota, so I presume connection to mysql is not a problem - mailuser has Select,Insert,Update,Delete privileges over quota and expires table (log below for deleting message) dovecot log does not show any problems, not even with mail_debug. doveadm -A works ____________________________________________________________________________ ________________________ dovecot -n # 2.2.6: /etc/dovecot/dovecot.conf # OS: Linux 3.10.17-gentoo x86_64 Gentoo Base System release 2.2 xfs auth_mechanisms = plain login dict { expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } hostname = ****(a)****.**** listen = ************* login_greeting = ***** ready. mail_access_groups = vmail mail_attachment_dir = /data/vmail/attachments mail_attachment_fs = sis-queue /data/vmail/attachments/queue:posix mail_attachment_hash = %{sha256} mail_location = mdbox:/data/vmail/storage/%d/%n/:ALT=/data/vmail/altstorage/%d/%n/:INDEX=/da ta/vmail/indexes/%d/%n/ mail_plugins = " expire quota zlib mail_log notify" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_preallocate_space = yes mdbox_rotate_interval = 1 days namespace Unwanted { hidden = no inbox = no list = yes location = maildir:/data/vmail/unwanted/%d/%n/ mailbox Ham { auto = subscribe } mailbox Spam { auto = subscribe } prefix = Unwanted. separator = . subscriptions = yes type = private } namespace inbox { hidden = no inbox = yes list = yes location = mdbox:/data/vmail/storage/%d/%n/:ALT=/data/vmail/altstorage/%d/%n/:INDEX=/da ta/vmail/indexes/%d/%n/ mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Folders { auto = subscribe } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { expire = Trash 1 Trash.* 1 Junk 2 expire_dict = proxy::expire mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid from subject, size, vsize, flags quota = dict:User quota::proxy::quota quota_exceeded_message = Quota exceeded (mailbox is full) quota_grace = 10%% quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_rule3 = Junk:ignore quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=85%% quota-warning 85 %u quota_warning3 = storage=70%% quota-warning 70 %u sieve = /data/vmail/sieve/%d/%n/.dovecot.sieve sieve_before = /data/vmail/sieve/before.sieve sieve_default = /data/vmail/sieve/default.sieve sieve_dir = /data/vmail/sieve/%d/%n/sieve sieve_global_dir = /data/vmail/sieve/ zlib_save = bz2 zlib_save_level = 9 } postmaster_address = postmaster(a)fingerprints.si protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service dict { unix_listener dict { group = vmail mode = 0660 } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/bin/dovecot-quota-warning.sh unix_listener quota-warning { mode = 0666 user = vmail } user = vmail } ssl_cert = </etc/ssl/certs/san_*****.****-2048.crt ssl_key = </etc/ssl/private/san_*****.****-2048.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = expire sieve zlib } protocol imap { mail_plugins = " expire quota zlib mail_log notify expire imap_quota quota" } protocol sieve { managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date } ____________________________________________________________________________ ________________________ dovecot-dict-sql.conf.ext connect = host=127.0.0.1 dbname=mailserver user=mailuser password=************************* map { pattern = priv/quota/storage table = quota username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota username_field = username value_field = messages } map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } } ____________________________________________________________________________ ________________________ dovecot-sql.conf.ext driver = mysql connect = host=127.0.0.1 dbname=mailserver user=mailuser password=************************* default_pass_scheme = PLAIN-MD5 iterate_query = SELECT email AS user FROM virtual_users password_query = SELECT email AS user, password, \ uid AS userdb_uid, gid AS userdb_gid, \ concat('*:bytes=', quota_bytes) AS userdb_quota_rule \ FROM virtual_users WHERE email = '%u' user_query = SELECT uid, gid, \ CONCAT('/data/vmail/storage/',CONCAT(SUBSTRING_INDEX(email,'@',-1),'/',SUBST RING_INDEX(email,'@',1))) AS home, \ CONCAT('*:bytes=', quota_bytes) AS quota_rule \ FROM virtual_users WHERE email = '%u' ____________________________________________________________________________ ________________________ MYSQL: +-----------+------------+-------------+------------+----------------+------ ---------------+------------------------------------------------------------ ----------------------------------+-------------+ | Host | Db | User | Table_name | Grantor | Timestamp | Table_priv | Column_priv | +-----------+------------+-------------+------------+----------------+------ ---------------+------------------------------------------------------------ ----------------------------------+-------------+ | 127.0.0.1 | mailserver | mailuser | quota | root@localhost | 2013-12-06 02:14:57 | Select,Insert,Update,Delete | | | 127.0.0.1 | mailserver | mailuser | expires | root@localhost | 2013-12-08 05:49:42 | Select,Insert,Update,Delete | | +-----------+------------+-------------+------------+----------------+------ ---------------+------------------------------------------------------------ ----------------------------------+-------------+ mysql> describe expires; +--------------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +--------------+--------------+------+-----+---------+-------+ | username | varchar(75) | NO | PRI | NULL | | | mailbox | varchar(255) | NO | PRI | NULL | | | expire_stamp | int(11) | NO | | NULL | | +--------------+--------------+------+-----+---------+-------+ mysql> select * from expires; Empty set (0.00 sec) MYSQL LOG: 1 Query SELECT email AS user, password, uid AS userdb_uid, gid AS userdb_gid, concat('*:bytes=', quota_bytes) AS userdb_quota_rule FROM virtual_users WHERE email = '*********************' 2 Connect mailuser@************* on mailserver 2 Query BEGIN 1 Query SELECT uid, gid, CONCAT('/data/vmail/storage/',CONCAT(SUBSTRING_INDEX(email,'@',-1),'/',SUBST RING_INDEX(email,'@',1))) AS home, CONCAT('*:bytes=', quota_bytes) AS quota_rule FROM virtual_users WHERE email = '*********************' 2 Query UPDATE quota SET bytes=bytes-15989,messages=messages-1 WHERE username = '*********************' 2 Query COMMIT 2 Query SELECT bytes FROM quota WHERE username = '*********************' 2 Query SELECT messages FROM quota WHERE username = '*********************' 2 Query SELECT bytes FROM quota WHERE username = '*********************' 2 Query BEGIN 2 Query UPDATE quota SET bytes=bytes+16025,messages=messages+1 WHERE username = '*********************' 2 Query COMMIT 2 Query SELECT bytes FROM quota WHERE username = '*********************' 2 Query SELECT messages FROM quota WHERE username = '*********************'

2 2

[Dovecot] [PATCH] lib-sql/driver-mysql.c - Add support for enabling MYSQL_OPT_SSL_VERIFY_SERVER_CERT
by Gareth Palmer 08 Dec '13

08 Dec '13

Hello, The following patch adds support for enabling MYSQL_OPT_SSL_VERIFY_SERVER_CERT. It makes the mysql client library check that the commonName in the server's SSL certificate matches the host name provided to mysql_real_connect() and aborts the connection if the name doesn't match. An example connect string would look something like: connect = ... ssl-ca=/path/to/ca.cert ssl-verify-server-cert=yes By default the mysql client library does not perform this check.

3 7

[Dovecot] dovecot.index-Errors with multiple IMAP client access in Dovecot 2.2
by Martin Rabl 08 Dec '13

08 Dec '13

Hello list, I hope you can help me! My self-compiled dovecot 2.2.6 (and the two minor versions before, too) throws that errors: Nov 28 18:29:00 mailserv dovecot: imap(martin(a)example.com): Error: Transaction log /srv/vmail/example.com/martin/Maildir/dovecot.index.log: duplicate transaction log sequence (25) Nov 28 18:29:00 mailserv dovecot: imap(martin(a)example.com): Error: /srv/vmail/example.com/martin/Maildir/dovecot.index log position went backwards (24,40 < 25,10028) ... and so on ... duplicate transaction log sequences and backwards gone log positions, and this always, when I use at least two IMAP clients at the same time (better: the two clients are online and logged in at the same time). That happens only with one user (me ;-) ), the other about 15 users on this server are having no problems. What I see: the clients are bothering each other, but I don't know, why. I thought about the used reiserfs filesystem on the server, but there were no problems with 1.2 on the same server. Some words about my client setup: I use Thunderbird and iPhone at the same time, and as a third client on the same Server there is a Thunderbird instance at my company, which runs parallel to the other two. Seems to be weired, but isn't really (IMHO ;-) ). Sometimes there are two TBs at the same mailbox, sometimes only the iPhone and a TB, sometimes all three. This runs quite good for long time with dovecot 1.2 and 2.1.x (the last one at my company in a similary setup with more users and several clients at the same time). Maybe there is an error by using "my" build configurations (I think, not)? ---- configures ------------------- ./configure \ --prefix=/usr/local \ --with-sql \ --with-ssl \ --with-mysql ----------------------------------- Here are my dovecot.conf (only the changes of defaults) - maybe there is a misconfiguration? ---- dovecot.conf ----------------- # 2.2.6: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-028stab101.1 x86_64 Ubuntu 10.04.4 LTS reiserfs auth_master_user_separator = * auth_mechanisms = plain login auth_socket_path = /usr/local/var/run/dovecot/auth-master default_internal_user = vmail default_login_user = vmail dict { acl = mysql:/etc/dovecot/dovecot-dict-acl-sql.conf.ext } disable_plaintext_auth = no imap_capability = +NAMESPACE imap_client_workarounds = delay-newmail tb-lsub-flags tb-lsub-flags tb-extra-mailbox-sep listen = * log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c mail_access_groups = vmail mail_location = maildir:/srv/vmail/%d/%n/Maildir mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify namespace { list = yes location = maildir:%%Lh/Maildir/:INDEX=%%Lh/shared-idx/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { hidden = no list = yes location = maildir:/srv/vmail/public prefix = public/ separator = / subscriptions = no type = public } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl autocreate = Trash autocreate2 = Spam autocreate3 = Sent autocreate4 = Drafts autosubscribe = Trash autosubscribe2 = Spam autosubscribe3 = Sent autosubscribe4 = Drafts sieve = ~/.dovecot.sieve sieve_after = /srv/vmail/sieve/after.sieve sieve_before = /srv/vmail/sieve/before.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_dir = /srv/vmail/sieve sieve_global_path = /srv/vmail/sieve/globalsieverc } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh postmaster_address = postmaster@%d protocols = imap pop3 quota_full_tempfail = yes service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service imap { process_limit = 2048 vsz_limit = 256 M } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_cipher_list = ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = " sieve" } protocol imap { mail_plugins = acl imap_acl } protocol sieve { managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags } local 1.2.3.4 { ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem } ----------------------------------- Thank you very much for your time and help! Greetings, Martin

2 1

[Dovecot] shared folder - ACL
by Héctor Moreno Blanco 08 Dec '13

08 Dec '13

Hello everyone, I've trying to configure shared folders in dovecot 2.1.6 without success. My configuration is: mail_plugins = quota autocreate mail_log notify acl ... plugin { ... acl_shared_dict = file:/etc/dovecot/shared-mailboxes.db ... } Protocol imap { ... mail_plugins = imap_quota imap_acl ... } When I try to set acl to a folder: a02 setacl inbox.test1 user1 lr a02 BAD Error in IMAP command SETACL: ACLs disabled. In the logs, I can see: dovecot: imap(testing_ddfr): Debug: acl: No acl setting - ACLs are disabled What am I missing? Thank you very much in advanced. Kind regards. Héctor Moreno Blanco. P Please consider the environment before printing this e-mail. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________

3 3

[Dovecot] imap list response has an extra field on some mailboxes.
by Kui Zhang 08 Dec '13

08 Dec '13

Hello, per rfc3501 7.2.2. LIST Response Contents: name attributes hierarchy delimiter name Dovecot: 2.1.16 /usr/lib/dovecot/imap -u user(a)domain.tld list "" "*" Most responses are correct. But some appears to not be. """ * LIST (\HasNoChildren) "/" {117} path/to/"part_mailbox_name" other_parts * LIST (\HasNoChildren) "/" {10} "test" box """ char after {117} appears to be \n. All affected mailboxes appears to have ' " ' in mailbox name. And the number between '{' '}' appears to be the length of the path. Anyone ran into this issues before? If so, how to fix it? Is it a bug? Other rfc I should read? Thanks Kui.Z

2 1

[Dovecot] Panic in indexer-worker
by Michael Kliewe 08 Dec '13

08 Dec '13

Hi, I did a fresh installation of 2.2.9 in my test environment and enabled fts_autoindex=yes. I'm using a solr-server for FTS. I got this error, just once until now: _=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_= ==> dovecot-lmtp-errors.log <== Dec 03 16:15:06 lmtp(30601, username(a)domain.de) Error: Timeout (29s) while waiting for lock for transaction log file /maildata/domain.de/username/maildir/dovecot.list.index.log ==> dovecot-lmtp.log <== Dec 03 16:15:06 lmtp(30601, username(a)domain.de) Info: h2jGC1j1nVKJdwAAwaC1kQ: sieve: msgid=<20131203151436.962C06B6E9(a)monitoring01.domain.de>: stored mail into mailbox 'Trash' Dec 03 16:15:06 lmtp(30601): Info: Disconnect from 10.0.0.3: Successful quit ==> dovecot.log <== Dec 03 16:15:06 indexer-worker(username(a)domain.de): Panic: file http-client-request.c: line 521 (http_client_request_send_more): assertion failed: (req->payload_input != NULL) Dec 03 16:15:06 indexer-worker(username(a)domain.de): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x66ab1) [0x7fc60fe2eab1] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x66b8e) [0x7fc60fe2eb8e] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fc60fdea3ce] -> /usr/local/lib/dovecot/libdovecot.so.0(http_client_request_send_more+0x2ed) [0x7fc60fe0406d] -> /usr/local/lib/dovecot/libdovecot.so.0(http_client_request_send+0x1e1) [0x7fc60fe042a1] -> /usr/local/lib/dovecot/libdovecot.so.0(http_client_connection_next_request+0x120) [0x7fc60fe06720] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3f6b7) [0x7fc60fe076b7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0xbf) [0x7fc60fe3e9af] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x94) [0x7fc60fe3f7d4] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fc60fe3e628] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x3bb3f) [0x7fc60fe03b3f] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_end+0x61) [0x7fc60f1d5421] -> /usr/local/lib/dovecot/lib21_fts_solr_plugin.so(+0x4388) [0x7fc60f1d2388] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_backend_update_deinit+0x29) [0x7fc60f3dfd29] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xbb7c) [0x7fc60f3e4b7c] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xc982) [0x7fc60f3e5982] -> /usr/local/lib/dovecot/lib10_quota_plugin.so(+0xb584) [0x7fc60f5f6584] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x90927) [0x7fc61012a927] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x3f) [0x7fc6101162cf] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+0xe) [0x7fc61011636e] -> dovecot/indexer-worker [username(a)domain.de Trash]() [0x4024f6] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7fc60fe3ea87] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7fc60fe3f817] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fc60fe3e628] -> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fc60fdef5c3] -> dovecot/indexer-worker [username(a)domain.de Trash](main+0xe3) [0x401f03] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fc60fa21de5] -> dovecot/indexer-worker [username(a)domain.de Trash]() [0x401fc2] Dec 03 16:15:13 indexer: Error: Indexer worker disconnected, discarding 1 requests for username(a)domain.de Dec 03 16:15:13 indexer-worker(username(a)domain.de): Fatal: master: service(indexer-worker): child 30611 killed with signal 6 (core dumped) _=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_=_= This happend when LMTP received a mail, and because of fts_autoindex=yes it should be sent to the solr server. Is this normal when waiting for lock on transaction log file times out, or should there be something more graceful, maybe just skip it or so? I already tried to reproduce, but I cannot. I will check the logfiles if it happens again. Regards Michael

2 1

[Dovecot] Multi-master Replication?
by Pizza Napoletana 08 Dec '13

08 Dec '13

Will the replication method described at http://wiki2.dovecot.org/Replication support a master/master/master configuration to keep three replicas in sync? Thanks

2 1

[Dovecot] file descriptor errors
by Christian Rößner 08 Dec '13

08 Dec '13

Hi, I use dovecot 2.2.9 on Gentoo Linux and I get lots of these erors in my log file: Dec 4 08:53:37 mx dovecot: auth: Error: close failed in file object destructor: Dec 4 08:53:37 mx dovecot: auth: Error: IOError: [Errno 9] Bad file descriptor What could cause these error messages? My mailboxes are stored on an ext4 filesystem: /dev/vdb1 on /srv/mail type ext4 (rw,noatime) doveconf -n: # OS: Linux 3.11.2-hardened x86_64 Gentoo Base System release 2.2 ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_access_groups = mail mail_attachment_dir = /srv/mail/copymail/attachments mail_gid = mail mail_location = maildir:/srv/mail/virtual/%d/%n mail_plugins = quota acl zlib mail_log notify mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk-E-Mail { auto = subscribe special_use = \Junk } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. } passdb { args = /usr/local/sbin/ispcp-decrypt.py driver = checkpassword } plugin { acl = vfile acl_shared_dict = file:/srv/mail/virtual/shared-mailboxes.db quota = dict:User quota::file:/srv/mail/virtual/%d/%n/dovecot-quota quota_rule = *:storage=300M:messages=20000 quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster(a)deltaweb.de protocols = imap pop3 lmtp sieve service auth-worker { extra_groups = ssl-cert unix_listener auth-worker { mode = 0600 user = vmail } user = vmail } service auth { extra_groups = ssl-cert unix_listener /var/spool/postfix.relay/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0660 user = vmail } user = vmail } service config { unix_listener config { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = ::1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = </etc/ssl/certs/mx_deltaweb_de.crt ssl_key = </etc/ssl/private/mx_deltaweb_de.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = quota acl zlib mail_log notify sieve } protocol lda { mail_plugins = quota acl zlib mail_log notify sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = quota acl zlib mail_log notify imap_quota imap_acl imap_zlib } Thanks in advance -Christian Rößner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

3 4

[Dovecot] Dovecot readable compressed mail archive
by Dave Hall 08 Dec '13

08 Dec '13

Hello. Is Dovecot able to create and/or read any sort of compressed mail archive? We have a large installation with a few users who need to keep a large amount of email available. With maildir this means a large number of individual files, leading to additional load on our backup process. Even using a compressed mbox file as an archive would help, but only if Dovecot is able to interact with this file seamlessly while keeping current email in the maildir format. Please pardon if this is old business, but I haven't been able to find any reference to it by searching. Thanks. -Dave -- Dave Hall System Administrator Computer Science Binghamton University davehall(a)cs.binghamton.edu 607-760-2328 (Cell) 607-777-4641 (Office)

3 2

[Dovecot] imap crash 2.2.9 hg
by Oli Schacher 08 Dec '13

08 Dec '13

Hi Timo With dovecot built from the latest 2.2.9 hg (342f6962390e) we get imap crashes. This only affects one account which is used by multiple clients. The first few logins seem to work ok, but after a few seconds the log is flooded with Dec 5 13:43:10 team dovecot: imap-login: Login: user=<sales(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=5.6.7.8, mpid=27923, TLS, session=<GeNN38jsHgBNbZEi> Dec 5 13:43:10 team dovecot: imap(sales(a)example.com): Fatal: master: service(imap): child 27923 killed with signal 11 (core dumped) Dec 5 13:43:11 team dovecot: imap-login: Login: user=<sales(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=5.6.7.8, mpid=27925, TLS, session=<NNVS38jsnwBNbZEi> Dec 5 13:43:11 team dovecot: imap(sales(a)example.com): Fatal: master: service(imap): child 27925 killed with signal 11 (core dumped) Dec 5 13:43:11 team dovecot: imap-login: Login: user=<sales(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=5.6.7.8, mpid=27927, TLS, session=<8LxX38jsAgBNbZEi> Dec 5 13:43:11 team dovecot: imap(sales(a)example.com): Fatal: master: service(imap): child 27927 killed with signal 11 (core dumped) [...] messagelog meanwile gets floods of: imap[29173]: segfault at 60 ip 00007f104c160f40 sp 00007fff935a0f58 error 4 in libdovecot-storage.so.0.0.0[7f104c095000+10d000] imap[29175]: segfault at 60 ip 00007fb7247eff40 sp 00007fff8a949578 error 4 in libdovecot-storage.so.0.0.0[7fb724724000+10d000] imap[29177]: segfault at 60 ip 00007f59e4f5df40 sp 00007fff70e884b8 error 4 in libdovecot-storage.so.0.0.0[7f59e4e92000+10d000] imap[29179]: segfault at 60 ip 00007fdda0e68f40 sp 00007fffd3576498 error 4 in libdovecot-storage.so.0.0.0[7fdda0d9d000+10d000] imap[29181]: segfault at 60 ip 00007f60d774af40 sp 00007fffc249aee8 error 4 in libdovecot-storage.so.0.0.0[7f60d767f000+10d000] imap[29183]: segfault at 60 ip 00007fce0da4ff40 sp 00007fff33ff92f8 error 4 in libdovecot-storage.so.0.0.0[7fce0d984000+10d000] imap[29185]: segfault at 60 ip 00007f2e4414ef40 sp 00007fff5888ab28 error 4 in libdovecot-storage.so.0.0.0[7f2e44083000+10d000] imap[29187]: segfault at 60 ip 00007fb0e6d3ef40 sp 00007fff0ed60c58 error 4 in libdovecot-storage.so.0.0.0[7fb0e6c73000+10d000] imap[29189]: segfault at 60 ip 00007f77c8292f40 sp 00007fff4d14bc08 error 4 in libdovecot-storage.so.0.0.0[7f77c81c7000+10d000] imap[29197]: segfault at 60 ip 00007f8366108f40 sp 00007fffd2e060a8 error 4 in libdovecot-storage.so.0.0.0[7f836603d000+10d000] [...] The user with the client on ip 1.2.3.4 tells me he doesn't see any errors in his outlook client, so maybe this crash only affects additional background connections. OS: Centos 6.5, 64 bit (gdb) bt full #0 0x00007f6fdcb9ef40 in mail_index_view_is_inconsistent () from /usr/lib64/dovecot/libdovecot-storage.so.0 No symbol table info available. #1 0x00007f6fdcb4f73b in mailbox_is_inconsistent () from /usr/lib64/dovecot/libdovecot-storage.so.0 No symbol table info available. #2 0x00000000004176dc in client_send_box_error () No symbol table info available. #3 0x0000000000411c46 in cmd_select_full () No symbol table info available. #4 0x0000000000416d6d in command_exec () No symbol table info available. #5 0x0000000000415e90 in ?? () No symbol table info available. #6 0x0000000000415f7d in ?? () No symbol table info available. #7 0x00000000004161fd in client_handle_input () No symbol table info available. #8 0x000000000041656f in client_input () No symbol table info available. #9 0x00007f6fdc87a0c6 in io_loop_call_io () from /usr/lib64/dovecot/libdovecot.so.0 No symbol table info available. #10 0x00007f6fdc87b187 in io_loop_handler_run () from /usr/lib64/dovecot/libdovecot.so.0 No symbol table info available. #11 0x00007f6fdc87a038 in io_loop_run () from /usr/lib64/dovecot/libdovecot.so.0 No symbol table info available. #12 0x00007f6fdc828e43 in master_service_run () from /usr/lib64/dovecot/libdovecot.so.0 No symbol table info available. #13 0x000000000041fd58 in main () No symbol table info available. Possibly related to recent change 9946079253c4/"imap: If SELECT fails with "mailbox is inconsistent", disconnect client. (Plus related cleanups.)" ? Is this "mailbox_is_inconsistent" call something I need to worry about? Reverting back to 2.2.7 doesn't show any errors for the affected account. Thanks Oli -- message transmitted on 100% recycled electrons

2 1

Re: [Dovecot] zlib config questions
by Richard Platel 08 Dec '13

08 Dec '13

You only need to add the zlib plugin to mail_plugins once. As far as I know, there's no indication in the logs that mail is being compressed, and the filename isn't modified to indicate that it's compressed, but, of course, the files are zlib data on disk. One gotcha if you're using maildir is, if you're planning to compress old mail, make sure that the S= and W= sizes in the filenames are correct, otherwise dovecot errors and closes the client session, and it can't repair the filename on it's own. On Dec 6, 2013, at 12:51 AM, dovecot-request(a)dovecot.org wrote: > Message: 6 > Date: Thu, 5 Dec 2013 13:55:40 -0800 > From: Terry Barnum <terry(a)dop.com> > To: Dovecot Mailing List <dovecot(a)dovecot.org> > Subject: [Dovecot] zlib config questions > Message-ID: <EF7F46D0-DE03-4B11-85ED-D669DE78D931(a)dop.com> > Content-Type: text/plain; charset=us-ascii > > After nearly running out of space I swapped in larger disks and then saw the recent threads about zlib compression. Unfortunately I'm still confused after reading <http://wiki2.dovecot.org/Plugins/Zlib>. > > In order to compress new email being stored do I only need to change > > 10-mail.conf to this: > mail_plugins = $mail_plugins zlib > > and 90-plugin.conf to this: > plugin { > zlib_save_level = 6 > zlib_save = gz > ... > > Or do I need to instead (or also?) add it to the list of plugins in 20-imap.conf? > > A simple 'sudo doveadm reload' to enable? > > Once enabled, is there an indication in the logs that compression is taking place? > > Do new mail files have a suffix like .Z to indicate they've been compressed? > > Any gotchas to be aware of? > > I'm running macports dovecot 2.2.5. > > Thanks for any help. > > -Terry > > Terry Barnum > digital OutPost > http://www.dop.com

6 7

[Dovecot] No Dovecot 2.2.9 on OpenBSD 5.4 amd64
by Philippe Lelédy 08 Dec '13

08 Dec '13

Hi, First I have this warning when configuring: configure: WARNING: sys/ucred.h: present but cannot be compiled configure: WARNING: sys/ucred.h: check for missing prerequisite headers? configure: WARNING: sys/ucred.h: see the Autoconf documentation configure: WARNING: sys/ucred.h: section "Present But Cannot Be Compiled" configure: WARNING: sys/ucred.h: proceeding with the compiler's result configure: WARNING: ## ---------------------------------- ## configure: WARNING: ## Report this to dovecot(a)dovecot.org ## configure: WARNING: ## ---------------------------------- ## So I do ! Second, make builds fine, but doveconf not: doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf doveconf: Fatal: pool_system_realloc(536870912): Out of memory Because I can't run doveconf, I give the only information I can get dovecot --version 2.2.9 and dovecot --build-options Build options: ioloop=kqueue notify=kqueue ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL drivers: Passdb: bsdauth checkpassword passwd passwd-file Userdb: checkpassword passwd prefetch passwd-file Install prefix . : /usr/local File offsets ... : 64bit I/O polling .... : kqueue I/O notifys .... : kqueue SSL ............ : yes (OpenSSL) GSSAPI ......... : no passdbs ........ : static passwd passwd-file checkpassword bsdauth : -shadow -pam -sia -ldap -sql -vpopmail userdbs ........ : static prefetch passwd passwd-file checkpassword : -ldap -sql -vpopmail -nss SQL drivers .... : : -pgsql -mysql -sqlite Full text search : squat : -lucene -solr Ph. Le.

2 1

[Dovecot] bug report: doveadm assertion failure "mail_index_map_lookup_seq_range"
by email-from-bobby 08 Dec '13

08 Dec '13

A negated subject search on an empty folder causes an assertion failure in doveadm. To reproduce: bash-3.2# doveadm mailbox create -u ephraim "Freshly Empty" bash-3.2# doveadm search -u ephraim mailbox "Freshly Empty" NOT subject '***JUNK MAIL***' doveadm(ephraim): Panic: file mail-index-map.c: line 548 (mail_index_map_lookup_seq_range): assertion failed: (first_uid <= last_uid\ ) doveadm(ephraim): Error: Raw backtrace: 2 libdovecot.0.dylib 0x0000000100347463 default_fatal_handler + 486 -> 3 \ libdovecot.0.dylib 0x00000001003472c0 default_fatal_handler + 67 -> 4 libdovecot.0.dylib 0x000\ 0000100347705 i_fatal + 0 -> 5 libdovecot-storage.0.dylib 0x00000001002a799f mail_index_map_lookup_seq_range + 309 -> 6 \ libdovecot-storage.0.dylib 0x00000001002b6d4f mail_index_lookup_seq_range + 12 -> 7 lib20_fts_plugin.so \ 0x00000001003fe325 fts_search_lookup + 3307 -> 8 lib20_fts_plugin.so 0x00000001003fddfb fts_search_lookup + 1985 -\ > 9 lib20_fts_plugin.so 0x00000001003fd6e2 fts_search_lookup + 168 -> 10 lib20_fts_plugin.so 0x00\ 000001003ff148 fts_mailbox_allocated + 1139 -> 11 doveadm 0x00000001001dd3d2 doveadm_mail_iter_init + 1\ 99 -> 12 doveadm 0x00000001001df3ce cmd_search_run + 138 -> 13 doveadm 0x0\ 0000001001d94f9 doveadm_mail_next_user + 196 -> 14 doveadm 0x00000001001d9ad1 doveadm_mail_try_run + 77\ 6 -> 15 doveadm 0x00000001001e1a09 main + 1150 -> 16 libdyld.dylib 0x00007fff915\ ba5fd start + 1 -> 17 ??? 0x0000000000000009 0x0 + 9 Abort trap: 6 bash-3.2# A positive search is no problem: bash-3.2# doveadm search -u ephraim mailbox "Freshly Empty" subject '***JUNK MAIL***' bash-3.2# Version and configuration info: bash-3.2# /Applications/Server.app/Contents/ServerRoot/usr/sbin/dovecotd --version 2.2.5 bash-3.2# /Applications/Server.app/Contents/ServerRoot/usr/sbin/dovecotd -n # 2.2.5: /Library/Server/Mail/Config/dovecot/dovecot.conf # OS: Darwin 13.0.0 x86_64 hfs auth_mechanisms = cram-md5 login apop plain digest-md5 auth_realms = mail.vishniac.com auth_socket_path = /var/run/dovecot/auth-userdb auth_username_format = %n debug_log_path = /Library/Logs/Mail/mail-debug.log default_internal_user = _dovecot default_login_user = _dovenull disable_plaintext_auth = no first_valid_gid = 6 first_valid_uid = 6 hostname = mail.vishniac.com imap_id_log = * imap_id_send = "name" * "version" * imap_urlauth_submit_user = submit info_log_path = /Library/Logs/Mail/mail-info.log log_path = /Library/Logs/Mail/mail-err.log login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_access_groups = mail mail_attribute_dict = file:/Library/Server/Mail/Data/attributes/attributes.dict mail_location = maildir:/Library/Server/Mail/Data/mail/users/%u mail_log_prefix = "%s(pid %p user %u): " mail_plugins = quota zlib acl fts fts_sk managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational \ regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_size = 200 M namespace acl-mailboxes { list = children location = maildir:/Library/Server/Mail/Data/mail/users/%%u:INDEX=/Library/Server/Mail/Data/mail/shared/%%u prefix = shared.%%u. separator = . subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } namespace list-archives { list = children location = maildir:/Library/Server/Mail/Data/listserver/messages/archive/lists/%%u:INDEX=/Library/Server/Mail/Data/listserver/mess\ ages/archive/shared/%%u prefix = archives.%%u. separator = . subscriptions = no type = shared } passdb { driver = od } passdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file } plugin { acl = vfile:/Library/Server/Mail/Config/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/Library/Server/Mail/Data/shared/shared-mailboxes fts = sk quota = maildir:User quota quota_warning = storage=100%% quota-exceeded %u sieve = /Library/Server/Mail/Data/rules/%u/dovecot.sieve sieve_dir = /Library/Server/Mail/Data/rules/%u stats_refresh = 30 secs stats_track_cmds = yes } postmaster_address = postmaster(a)vishniac.com protocols = imap pop3 lmtp sieve quota_full_tempfail = yes service auth { extra_groups = _keytabusers idle_kill = 15 mins unix_listener auth-userdb { user = _dovecot } } service dict { unix_listener dict { user = _dovecot } } service dns_client { unix_listener dns-client { mode = 0600 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } service_count = 0 } service imap { client_limit = 5 process_limit = 20 service_count = 0 } service indexer-worker { user = _dovecot } service lmtp { unix_listener lmtp { mode = 0600 } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { client_limit = 5 process_limit = 200 service_count = 0 } service quota-exceeded { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-exceeded.sh unix_listener quota-exceeded { group = mail mode = 0660 user = _dovecot } user = _dovecot } service quota-warning { executable = script /Applications/Server.app/Contents/ServerRoot/usr/libexec/dovecot/quota-warning.sh unix_listener quota-warning { group = mail mode = 0660 user = _dovecot } user = _dovecot } service stats { fifo_listener stats-mail { mode = 0600 user = _dovecot } } ssl_ca = </etc/certificates/mail.vishniac.com.6BC35F87D55C160F0933F54763846F6CC1EB5A81.chain.pem ssl_cert = </etc/certificates/mail.vishniac.com.6BC35F87D55C160F0933F54763846F6CC1EB5A81.cert.pem ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL:!ADH:!eNULL ssl_key = </etc/certificates/mail.vishniac.com.6BC35F87D55C160F0933F54763846F6CC1EB5A81.key.pem ssl_key_path = /etc/certificates/mail.vishniac.com.6BC35F87D55C160F0933F54763846F6CC1EB5A81.key.pem userdb { args = partition=/Library/Server/Mail/Config/dovecot/partition_map.conf enforce_quotas=no driver = od } userdb { args = /Library/Server/Mail/Config/dovecot/submit.passdb driver = passwd-file } verbose_proctitle = yes protocol lmtp { mail_plugins = quota zlib acl fts fts_sk sieve } protocol lda { mail_plugins = quota zlib acl fts fts_sk sieve } protocol imap { mail_max_userip_connections = 20 mail_plugins = quota zlib acl fts fts_sk imap_acl imap_quota imap_zlib } protocol pop3 { mail_max_userip_connections = 6 } bash-3.2#

3 2

[Dovecot] delete message with specified id
by Костырев Александр Алексеевич 08 Dec '13

08 Dec '13

Good day, everyone! Could someone help me to find a way to delete message with certain id from all users's mailboxes? What seems to be a problem: I have configured exim + dovecot lmtp I got a long list of aliases in BD in form of: +----------+-------------------------------------+ |alias_name recipients | (for example) -----------|-------------------------------------+ | list_a | user1@example.org,user2@example.org | +----------|-------------------------------------+ When I send a message to that list_a, user1 and user2 get the mail and I see this in log: Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, user1(a)example.org) copy from INBOX: box=INBOX, uid=1, msgid=<E1VojxY-0004Gl-Gu@beta-mail>, size=570 Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, user1(a)example.org) oCOXKmAkoVIjQAAA635u4w: msgid=<E1VojxY-0004Gl-Gu@beta-mail>: from=root@beta-mail: subj=: saved mail to INBOX Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, user2(a)example.org) copy from INBOX: box=INBOX, uid=1, msgid=<E1VojxY-0004Gl-Gu@beta-mail>, size=570 Dec 6 12:12:27 beta-mail dovecot: lmtp(16419, user2(a)example.org) oCOXKmAkoVIjQAAA635u4w: msgid=<E1VojxY-0004Gl-Gu@beta-mail>: from=root@beta-mail: subj=: saved mail to INBOX Is it possible to delete these letters with known msgid=<E1VojxY-0004Gl-Gu@beta-mail> from all users mailboxes with couple of simple commands ? How do I do it currently: in exim's log I get mailaddress of a user, get into his mailbox (wich cd), find the letter I need, with ls -i I get inode, search (with find) through all users mails and delete all files with that inode, then I have to rebuild dovecot indexes with doveadm mailbox status -A -t all INBOX -- С уважением, Костырев Александр администратор Linux-систем

2 2

[Dovecot] pigeonhole openssl s_client
by LEVAI Daniel 08 Dec '13

08 Dec '13

Hi! I'm trying to get information about a server certificate from a pigeonhole sieve server. Various connection attempts show only "wrong version number" or "unknown protocol" errors from openssl: $ openssl s_client -connect example.com:4190 { -tls1, -tls1_1, -tls1_2 } [ -starttls { imap, pop3 } ] None of these work. I'm trying to see who signed the server cert. How could I do this? Thanks, Daniel -- LÉVAI Dániel PGP key ID = 0x83B63A8F Key fingerprint = DBEC C66B A47A DFA2 792D 650C C69B BE4C 83B6 3A8F

2 1

[Dovecot] Replication via sneakernet
by David Bishop 07 Dec '13

07 Dec '13

Is there a way to get a running transaction log from a Dovecot instance to synchronize (and I use that word very, very loosely) multiple instances that don't share a network? Why I would want to do such a thing: I have a couple way stations along a long, winding road through very hilly country, and at each of these stations, I have a few people (and many, many more at one end of the road). Which people are where varies from hour to hour (but they're all members of a known, larger, group of people with accounts). It would be helpful to get communication (however limited) along this road (and establishing direct communication, either through radio or landline, is not feasible within the budget constraints I have), and it is possible to store a complete copy of the mail spool to a small box at each station (the total mail spool over the period I care about is in the tens of megs). There are trams shuttling back and forth along this road (stopping at each station), and adding a small box (such as a weatherproofed Raspberry Pi with a wifi dongle) to transport files up and down the road is pretty simple. Doing incremental copies of the mail spool is also simple, keeping track of files that get moved or deleted is a bit harder (but still not that bad), but I have no idea how hard it is to track what messages have been seen, especially for the shared folders (which we use instead of mailing lists). I realize this is not a "normal" use of Dovecot, but given this, does anyone who knows the software (and how it keeps track of messages) better have suggestions on how to approach the problem?

4 6

[Dovecot] Easy migration from Dovecot 1.2.16 ppc maildir to 2.1.17 amd64 mdbox
by Philippe Lelédy 07 Dec '13

07 Dec '13

Hi After http://retrospekt.dk/2011/08/migrating-maildir-to-dovecot-2-0-dbox/ I used a two phases process. The first, transfering over the network, is done by this shell function, on the *new* server. The argument is the <user> fetchOldServer () { rsync -poazuHK --exclude="**/dovecot.index*" \ -e ssh root@oldServer:/var/mail/Maildirs/$1 /var/mail/oldServer/ } I had to add --exclude="**/dovecot.index*" because of a change of endianness (ppc -> amd64). the second, having dovecot import the folder, is done by this second fonction dsync () { doveadm backup -R -u $1(a)mondomaine.fr maildir:/var/mail/oldServer/$1 } this one is really fast. Both in one function doveImport() { fetchOldServer $1 && dsync $1 } I tried for initial load to empty mailbox. I am not sure it will works on a non empty mailbox. But would be nice, as it would allow a fast last minute sync before switch, minimizing downtime. Ph. Le

2 1

Re: [Dovecot] Dovecot readable compressed mail archive
by Dave Hall 06 Dec '13

06 Dec '13

Alan, My goal is to reduce the file count in my backups. Based on the information at the link you sent it looks like for a Maildir setup the file count remains the same. Do you know if it's possible to have a mixed config with Dovecot where for a given user the Inbox is a maildir, but the archives are compressed mbox files? Thanks. -Dave On 12/04/2013 02:06 PM, Alan McGinlay wrote: > http://wiki2.dovecot.org/Plugins/Zlib try this.. Excuse the lack of quoted text, im on my phone

1 0

[Dovecot] Authentification Dovecot + Samba4
by dago＠quantentunnel.de 06 Dec '13

06 Dec '13

Hello list, I am struggling with setting up dovecot 2.1.7 with samba 4.1.2 on debian wheezy. Dovecot should authenticate via LDAP, but I cannot get it to work reliably. Sometimes auth works, sometimes not. Referals are already activated in ldap.conf … LDAP-authentication works fine with other clients (Apache Directory Studio, …) Has somebody got a similar setup running? I would love some hints on how to debug this issue … Thank you! Regards dovecot-ldap.conf hosts = 192.168.188.156:389 dn = CN=Administrator,CN=Users,DC=DOMAIN,DC=LOCAL dnpass = Test123 auth_bind = yes ldap_version = 3 base = DC=DOMAIN,DC=LOCAL tls = no debug_level = -1 ldap_version = 3 scope = subtree user_attrs = uidNumber=uid,gidNumber=gid user_filter = (&(&(objectClass=Person)(sAMAccountName=%u))) pass_attrs = sAMAccountName=user,userPassword=password pass_filter = (&(&(objectClass=Person)(sAMAccountName=%u))) logs: srv1 dovecot: auth: Debug: auth client connected (pid=0) srv1 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=doveadm#011resp=<hidden> srv1 dovecot: auth: Debug: ldap(john): bind search: base=DC=DOMAIN,DC=LOCAL filter=(&(&(objectClass=Person)(sAMAccountName=john))) srv1 dovecot: auth: Error: ldap_search srv1 dovecot: auth: Error: put_filter: "(&(&(objectClass=Person)(sAMAccountName=john)))" srv1 dovecot: auth: Error: put_filter: AND srv1 dovecot: auth: Error: put_filter_list "(&(objectClass=Person)(sAMAccountName=john))" srv1 dovecot: auth: Error: put_filter: "(&(objectClass=Person)(sAMAccountName=john))" srv1 dovecot: auth: Error: put_filter: AND srv1 dovecot: auth: Error: put_filter_list "(objectClass=Person)(sAMAccountName=john)" srv1 dovecot: auth: Error: put_filter: "(objectClass=Person)" srv1 dovecot: auth: Error: put_filter: simple srv1 dovecot: auth: Error: put_simple_filter: "objectClass=Person" srv1 dovecot: auth: Error: put_filter: "(sAMAccountName=john)" srv1 dovecot: auth: Error: put_filter: simple srv1 dovecot: auth: Error: put_simple_filter: "sAMAccountName=john" srv1 dovecot: auth: Error: ldap_build_search_req ATTRS: sAMAccountName srv1 dovecot: auth: Error: ldap_send_initial_request srv1 dovecot: auth: Error: ldap_send_server_request srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid -1 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid -1 (timeout 0 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: DOMAIN.local port: 0 srv1 dovecot: auth: Error: refcnt: 1 status: Connected srv1 dovecot: auth: Error: last used: Fri Dec 6 19:08:49 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: * msgid 35, origid 33, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 1 srv1 dovecot: auth: Error: * msgid 33, origid 33, status RequestCompleted srv1 dovecot: auth: Error: outstanding referrals 1, parent count 1 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 3 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 35 message type search-result srv1 dovecot: auth: Error: ldap_chase_referrals srv1 dovecot: auth: Error: read1msg: V2 referral chased, mark request completed, id = 35 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 0 new referrals srv1 dovecot: auth: Error: read1msg: mark request completed, ld 0x7fef48794580 msgid 35 srv1 dovecot: auth: Error: merged parent (id 33) error info: result errno 1, error <00002020: Operation unavailable without authentication>, matched <> srv1 dovecot: auth: Error: request done: ld 0x7fef48794580 msgid 33 srv1 dovecot: auth: Error: res_errno: 1, res_error: <00002020: Operation unavailable without authentication>, res_matched: <> srv1 dovecot: auth: Error: ldap_free_request (origid 33, msgid 33) srv1 dovecot: auth: Error: ldap_free_request (origid 33, msgid 35) srv1 dovecot: auth: Error: ldap_free_connection 0 1 srv1 dovecot: auth: Error: ldap_send_unbind srv1 dovecot: auth: Error: ldap_free_connection: actually freed srv1 dovecot: auth: Error: ldap_parse_result srv1 dovecot: auth: Error: ldap_err2string srv1 dovecot: auth: Error: ldap(john): ldap_search(base=DC=DOMAIN,DC=LOCAL filter=(&(&(objectClass=Person)(sAMAccountName=john)))) failed: Operations error srv1 dovecot: auth: Error: ldap_msgfree srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid -1 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid -1 (timeout 0 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 1 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 37 message type search-entry srv1 dovecot: auth: Error: ldap_first_attribute srv1 dovecot: auth: Error: ldap_get_values srv1 dovecot: auth: Error: ldap_next_attribute srv1 dovecot: auth: Debug: auth(john): username changed john -> john srv1 dovecot: auth: Debug: ldap(john): result: sAMAccountName=john srv1 dovecot: auth: Error: ldap_get_dn srv1 dovecot: auth: Error: ldap_msgfree srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid -1 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid -1 (timeout 0 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 1 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid -1 all 0 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 37 message type search-reference srv1 dovecot: auth: Error: ldap_chase_v3referrals srv1 dovecot: auth: Error: ldap_url_parse_ext(ldap://DOMAIN.local/CN=Configuration,DC=DOMAIN,DC=local) srv1 dovecot: auth: Error: re_encode_request: new msgid 39, new dn <CN=Configuration,DC=DOMAIN,DC=local> srv1 dovecot: auth: Error: re_encode_request new request is: srv1 dovecot: auth: Error: ber_dump: buf=0x7fef4879d8d0 ptr=0x7fef4879d956 end=0x7fef4879e8ac len=134 srv1 dovecot: auth: Error: 0000: 61 6d 65 4e 61 6d 65 00 00 00 00 00 00 00 00 00 ameName......... srv1 dovecot: auth: Error: 0010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ srv1 dovecot: auth: Error: 0080: 00 00 00 00 00 00 ...... srv1 dovecot: auth: Error: ldap_chase_v3referral: msgid 37, url "ldap://DOMAIN.local/CN=Configuration,DC=DOMAIN,DC=local" srv1 dovecot: auth: Error: ldap_send_server_request srv1 dovecot: auth: Error: ldap_new_connection 0 1 1 srv1 dovecot: auth: Error: ldap_int_open_connection srv1 dovecot: auth: Error: ldap_connect_to_host: TCP DOMAIN.local:389 srv1 dovecot: auth: Error: ldap_new_socket: 19 srv1 dovecot: auth: Error: ldap_prepare_socket: 19 srv1 dovecot: auth: Error: ldap_connect_to_host: Trying 192.168.188.156:389 srv1 dovecot: auth: Error: ldap_pvt_connect: fd: 19 tm: -1 async: 0 srv1 dovecot: auth: Error: anonymous rebind via ldap_sasl_bind("") srv1 dovecot: auth: Error: ldap_sasl_bind srv1 dovecot: auth: Error: ldap_send_initial_request srv1 dovecot: auth: Error: ldap_send_server_request srv1 dovecot: auth: Error: ldap_result ld 0x7fef48794580 msgid 40 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 msgid 40 (timeout 100000 usec) srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: DOMAIN.local port: 0 srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: rebind in progress srv1 dovecot: auth: Error: queue is empty srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 3 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 40, origid 40, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: * msgid 37, origid 37, status InProgress srv1 dovecot: auth: Error: outstanding referrals 1, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 2 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL srv1 dovecot: auth: Error: ldap_int_select srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 msgid 37 message type search-result srv1 dovecot: auth: Error: read1msg: ld 0x7fef48794580 0 new referrals srv1 dovecot: auth: Error: read1msg: mark request completed, ld 0x7fef48794580 msgid 37 srv1 dovecot: auth: Error: wait4msg ld 0x7fef48794580 0 s 99976 us to go srv1 dovecot: auth: Error: wait4msg continue ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Connections: srv1 dovecot: auth: Error: * host: DOMAIN.local port: 0 srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: rebind in progress srv1 dovecot: auth: Error: queue is empty srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: * host: 192.168.188.156 port: 389 (default) srv1 dovecot: auth: Error: refcnt: 2 status: Connected srv1 dovecot: auth: Error: last used: Fri 2013 srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Outstanding Requests: srv1 dovecot: auth: Error: * msgid 40, origid 40, status InProgress srv1 dovecot: auth: Error: outstanding referrals 0, parent count 0 srv1 dovecot: auth: Error: * msgid 37, origid 37, status RequestCompleted srv1 dovecot: auth: Error: outstanding referrals 1, parent count 0 srv1 dovecot: auth: Error: ld 0x7fef48794580 request count 2 (abandoned 0) srv1 dovecot: auth: Error: ** ld 0x7fef48794580 Response Queue: srv1 dovecot: auth: Error: Empty srv1 dovecot: auth: Error: ld 0x7fef48794580 response count 0 srv1 dovecot: auth: Error: ldap_chkResponseList ld 0x7fef48794580 msgid 40 all 1 srv1 dovecot: auth: Error: ldap_chkResponseList returns ld 0x7fef48794580 NULL dovecot -n: # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_debug = yes auth_verbose = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = vmail mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } } ssl = no userdb { driver = passwd }

2 1

[Dovecot] SQL as a storage backend
by Zachary Sturgeon 06 Dec '13

06 Dec '13

Hello, I am researching using dovecot with an SQL database as the storage backend. From what I've read, dovecot only supports mbox style file storage, but I'd like to investigate the possibility of using a database instead. According to http://dovecot.org/pipermail/dovecot/2006-June/013818.html, this possibility has been explored before and has generally been accepted that Dovecot is not optimized to handle this. Any suggestions? - Zachary Sturgeon

4 3

[Dovecot] UIDL and namespaces after qmail-pop3d and BincIMAP
by Adrian C. 06 Dec '13

06 Dec '13

Hello, I migrated qmail-pop3d and BincIMAP to Dovecot in the past, and I could always tweak the settings a little to match what old services used to provide, namely namespaces (separator /, prefix INBOX/) and pop3_uidl_format (%f). This time I'm migrating to a large mail system which has its configuration set differently and there's no changing it. pop3_uidl_format = %08Xu%08Xv namespace private {prefix = INBOX. separator = . inbox = yes} Am I corrent in thinking dsync plugin is the only chance I have of getting this mail migrated right? Unfortunately Debian's Dovecot is much much older than required v2.1.4... so I could use some advice from Dovecot experts. Thanks. -- Adrian C. (anrxc) | anrxc..sysphere.org | PGP ID: D20A0618 PGP FP: 02A5 628A D8EE 2A93 996E 929F D5CB 31B7 D20A 0618

1 0

[Dovecot] Design details of high performance dovecot cluster
by JEHERUL 06 Dec '13

06 Dec '13

Dear All, Currently we are running a mail system for 10000 users each 2GB mailbox. At present we have 5 mail servers where users mailboxes are distributed almost uniformly. We have a HP SAN Storage (HP EVA 6400) where mailboxes are stored. We partition the storage into five vg and each is mounted on the 5 servers. We are using postfix and dovecot. The system was running fine but currently we notices high IO load due to IMAP connection. So we are planning to build a dovecot cluster. Please suggest some design for the dovecot cluster keeping in mind to our scenario. (If needed we can buy additional hardware like load balancer). With Thanks and Regards -- Jeherul Islam India

2 3

[Dovecot] SOLR quick and dirty how to - needs review/testing
by Christian Rößner 06 Dec '13

06 Dec '13

Hi, I just wrote a quick and dirty how to. But not sure, if that is done the way it should. So any kind of feedback is welcome. http://www.roessner-network-solutions.com/?p=1127 At least the stuff does not break things here :-) Kind regards -Christian Rößner -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein

1 0

[Dovecot] Active Directory LDAP userdb and dovecot
by Simone Ferretti 06 Dec '13

06 Dec '13

Hello everybody, I have a problem with LDAP userdb and dovecot. Let me first explain my LDAP configuration: I got three Active Directory LDAP servers (a.galliera.it, b.galliera.it, c.galliera.it) responding round robin to the name galliera.it. I want to use LDAP for the userdb lookup, so I configured dovecot-ldap-userdb.conf.ext as follow: hosts = galliera.it # round robin base = dc=galliera,dc=it ldap_version = 3 auth_bind=yes auth_bind_userdn = %n(a)galliera.it dn=CN=stampa,CN=Users,DC=galliera,DC=it dnpass=stampa base = DC=galliera,DC=it scope = subtree deref = always user_attrs = sAMAccountName=home=/home/dovecot.galliera.it/%$,=uid=8,=gid=8 user_filter = (&(objectClass=person)(sAMAccountName=%n)) default_pass_scheme=CRYPT With this configuration everything go fine, I can authenticate and lookup my users in the expected way. What follows is the conversation between (one of) the LDAP server(s) and dovecot after a issue of the command $ doveadm user -u <user>@galliera.it : 62.785686 10.0.31.235 -> 10.0.5.0 TCP 74 43053 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=536265719 TSecr=0 WS=32 62.786216 10.0.5.0 -> 10.0.31.235 TCP 78 ldap > 43053 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 62.786279 10.0.31.235 -> 10.0.5.0 TCP 66 43053 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=536265719 TSecr=0 62.786394 10.0.31.235 -> 10.0.5.0 LDAP 122 bindRequest(1) "CN=stampa,CN=Users,DC=galliera,DC=it" simple 62.786583 10.0.31.235 -> 10.0.5.0 TCP 74 43054 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=536265719 TSecr=0 WS=32 62.786953 10.0.5.0 -> 10.0.31.235 TCP 78 ldap > 43054 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 62.787008 10.0.31.235 -> 10.0.5.0 TCP 66 43054 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=536265719 TSecr=0 62.787039 10.0.31.235 -> 10.0.5.0 LDAP 122 bindRequest(1) "CN=stampa,CN=Users,DC=galliera,DC=it" simple 62.788484 10.0.5.0 -> 10.0.31.235 LDAP 88 bindResponse(1) success 62.788528 10.0.31.235 -> 10.0.5.0 TCP 66 43053 > ldap [ACK] Seq=57 Ack=23 Win=14624 Len=0 TSval=536265719 TSecr=36040952 62.789334 10.0.5.0 -> 10.0.31.235 LDAP 88 bindResponse(1) success 62.789365 10.0.31.235 -> 10.0.5.0 TCP 66 43054 > ldap [ACK] Seq=57 Ack=23 Win=14624 Len=0 TSval=536265720 TSecr=36040952 62.789462 10.0.31.235 -> 10.0.5.0 LDAP 174 searchRequest(2) "DC=galliera,DC=it" wholeSubtree 62.790396 10.0.5.0 -> 10.0.31.235 LDAP 392 searchResEntry(2) "CN=Marco De benedetto,OU=S.S.C. Area sistemistica,OU=S.C. S.I.e.T. - Servizi informatici e telecomunicazioni,OU=Dipartimento di Staff,OU=Direzione generale,DC=galliera,DC=it" | searchResRef(2) | searchResDone(2) success 62.790508 10.0.31.235 -> 10.0.5.0 LDAP 191 searchRequest(3) "CN=Configuration,DC=galliera,DC=it" wholeSubtree 62.791077 10.0.5.0 -> 10.0.31.235 LDAP 168 searchResRef(3) | searchResDone(3) success 62.791172 10.0.31.235 -> 10.0.5.0 LDAP 203 searchRequest(4) "CN=Schema,CN=Configuration,DC=galliera,DC=it" wholeSubtree 62.791838 10.0.5.0 -> 10.0.31.235 LDAP 88 searchResDone(4) success 62.828752 10.0.31.235 -> 10.0.5.0 TCP 66 43054 > ldap [ACK] Seq=427 Ack=473 Win=15680 Len=0 TSval=536265730 TSecr=36040952 Strange things happen instead if I change the 'hosts' configuration variable to one (no matter what) of the domain controllers e.g.: hosts = a.galliera.it base = dc=galliera,dc=it ldap_version = 3 auth_bind=yes auth_bind_userdn = %n(a)galliera.it dn=CN=stampa,CN=Users,DC=galliera,DC=it dnpass=stampa base = DC=galliera,DC=it scope = subtree deref = always user_attrs = sAMAccountName=home=/home/dovecot.galliera.it/%$,=uid=8,=gid=8 user_filter = (&(objectClass=person)(sAMAccountName=%n)) default_pass_scheme=CRYPT Changing this variable to only one of the domain controllers make the doveadm request (issued as above) hang for some seconds and then exit with a Request time out message. This is the conversation record, you can note that there is *more the one* LDAP server involved in the conversation despite the fact that in the conf file only one is specified: 3427.019635 10.0.31.235 -> 10.0.10.0 TCP 74 33963 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=537106777 TSecr=0 WS=32 3427.020428 10.0.10.0 -> 10.0.31.235 TCP 78 ldap > 33963 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 3427.020489 10.0.31.235 -> 10.0.10.0 TCP 66 33963 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=537106777 TSecr=0 3427.020562 10.0.31.235 -> 10.0.10.0 LDAP 122 bindRequest(1) "CN=stampa,CN=Users,DC=galliera,DC=it" simple 3427.021894 10.0.31.235 -> 10.0.10.0 TCP 74 33964 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=537106778 TSecr=0 WS=32 3427.022474 10.0.10.0 -> 10.0.31.235 LDAP 88 bindResponse(1) success 3427.022498 10.0.31.235 -> 10.0.10.0 TCP 66 33963 > ldap [ACK] Seq=57 Ack=23 Win=14624 Len=0 TSval=537106778 TSecr=33551087 3427.022805 10.0.10.0 -> 10.0.31.235 TCP 78 ldap > 33964 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 3427.022868 10.0.31.235 -> 10.0.10.0 TCP 66 33964 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=537106778 TSecr=0 3427.022996 10.0.31.235 -> 10.0.10.0 LDAP 122 bindRequest(1) "CN=stampa,CN=Users,DC=galliera,DC=it" simple 3427.024537 10.0.10.0 -> 10.0.31.235 LDAP 88 bindResponse(1) success 3427.024574 10.0.31.235 -> 10.0.10.0 TCP 66 33964 > ldap [ACK] Seq=57 Ack=23 Win=14624 Len=0 TSval=537106778 TSecr=33551087 3427.024884 10.0.31.235 -> 10.0.10.0 LDAP 176 searchRequest(2) "DC=galliera,DC=it" wholeSubtree 3427.028078 10.0.10.0 -> 10.0.31.235 LDAP 391 searchResEntry(2) "CN=Simone Ferretti,OU=S.S.C. Area sistemistica,OU=S.C. S.I.e.T. - Servizi informatici e telecomunicazioni,OU=Dipartimento di Staff,OU=Direzione generale,DC=galliera,DC=it" | searchResRef(2) | searchResDone(2) success 3427.028426 10.0.31.235 -> 10.0.5.0 TCP 74 43077 > ldap [SYN] Seq=0 Win=14600 Len=0 MSS=1460 SACK_PERM=1 TSval=537106779 TSecr=0 WS=32 3427.028882 10.0.5.0 -> 10.0.31.235 TCP 78 ldap > 43077 [SYN, ACK] Seq=0 Ack=1 Win=16384 Len=0 MSS=1460 WS=1 TSval=0 TSecr=0 SACK_PERM=1 3427.028932 10.0.31.235 -> 10.0.5.0 TCP 66 43077 > ldap [ACK] Seq=1 Ack=1 Win=14624 Len=0 TSval=537106780 TSecr=0 3427.029091 10.0.31.235 -> 10.0.5.0 LDAP 80 bindRequest(4) "<ROOT>" simple 3427.029816 10.0.5.0 -> 10.0.31.235 LDAP 88 bindResponse(4) success 3427.029832 10.0.31.235 -> 10.0.5.0 TCP 66 43077 > ldap [ACK] Seq=15 Ack=23 Win=14624 Len=0 TSval=537106780 TSecr=36074586 3427.030001 10.0.31.235 -> 10.0.5.0 LDAP 193 searchRequest(3) "CN=Configuration,DC=galliera,DC=it" wholeSubtree 3427.030980 10.0.5.0 -> 10.0.31.235 LDAP 168 searchResRef(3) | searchResDone(3) success 3427.064639 10.0.31.235 -> 10.0.10.0 TCP 66 33964 > ldap [ACK] Seq=167 Ack=348 Win=15680 Len=0 TSval=537106789 TSecr=33551087 3427.068791 10.0.31.235 -> 10.0.5.0 TCP 66 43077 > ldap [ACK] Seq=142 Ack=125 Win=14624 Len=0 TSval=537106790 TSecr=36074586 Is there anyone that have some ideas of what is going on? My dovecot version is 2.2.9 (5c170e0786f3) running on a debian wheezy 3.2.0-4-amd64. My Active Directory server is a windows server 2003 R2. Follows my doveconf -n: # 2.2.9 (5c170e0786f3): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 ext4 auth_cache_size = 8 k auth_debug = yes auth_master_user_separator = * auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@+ auth_verbose = yes disable_plaintext_auth = no first_valid_uid = 5 hostname = dovecot.galliera.it last_valid_uid = 100000 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_access_groups = mail mail_debug = yes mail_gid = mail mail_location = maildir:/home/%d/%n/Maildir mail_privileged_group = mail mail_uid = mail maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = children location = maildir:/var/mail/shared/istituzionali:INDEX=/var/mail/shared/istituzionali/INDEX/%n prefix = Avvisi al personale. subscriptions = yes type = public } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile fts = squat fts_squat = partial=4 full=10 mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = from subject uid box msgid size sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)galliera.it protocols = " imap lmtp sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { mode = 0600 user = mail } unix_listener auth-userdb { mode = 0777 user = mail } user = root } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl = no ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem syslog_facility = local5 userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap } protocol imap { mail_max_userip_connections = 30 mail_plugins = fts fts_squat mail_log zlib acl imap_acl notify } protocol pop3 { pop3_uidl_format = %v.%u } Thanks in advance and ciao! Simone

1 0

[Dovecot] Expire plugin and databases
by Mauricio Tavares 06 Dec '13

06 Dec '13

Dumb question: do I need to have a database to run the expire plugin?

2 1

[Dovecot] zlib config questions
by Terry Barnum 05 Dec '13

05 Dec '13

After nearly running out of space I swapped in larger disks and then saw the recent threads about zlib compression. Unfortunately I'm still confused after reading <http://wiki2.dovecot.org/Plugins/Zlib>. In order to compress new email being stored do I only need to change 10-mail.conf to this: mail_plugins = $mail_plugins zlib and 90-plugin.conf to this: plugin { zlib_save_level = 6 zlib_save = gz ... Or do I need to instead (or also?) add it to the list of plugins in 20-imap.conf? A simple 'sudo doveadm reload' to enable? Once enabled, is there an indication in the logs that compression is taking place? Do new mail files have a suffix like .Z to indicate they've been compressed? Any gotchas to be aware of? I'm running macports dovecot 2.2.5. Thanks for any help. -Terry Terry Barnum digital OutPost http://www.dop.com

1 0

[Dovecot] Syslog debug messages
by Bruno Galindro da Costa 05 Dec '13

05 Dec '13

Is there a way to configure dovecot to register in syslog the debug messages enabled by mail_debug=yes as a debug not as information? I need this because I want to send this kind of information only to a remote server. I've configured rsyslog to do this, but dovecot is registering those debug messages as information not as debug (as I expected). This is my rsyslog config: mail.info;\ mail.warning;\ mail.err;\ mail.crit -/var/log/mail.log mail.* :omrelp:192.168.2.162:2514 root@imap:~# dovecot -n # 1.2.9: /etc/dovecot/dovecot.conf Warning: fd limit 1024 is lower than what Dovecot can use under full load (more than 4748). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: Linux 2.6.32-44-server x86_64 Ubuntu 10.04.4 LTS xfs log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve pop3s listen(default): *:143,[::]:143 listen(imap): *:143,[::]:143 listen(pop3): * listen(managesieve): * ssl_listen(default): *:993,[::]:993 ssl_listen(imap): *:993,[::]:993 ssl_listen(pop3): *:2221,[::]:2221 ssl_listen(managesieve): ssl_ca_file(default): /etc/dovecot/ca.crt ssl_ca_file(imap): /etc/dovecot/ca.crt ssl_ca_file(pop3): /etc/dovecot/ca.crt ssl_ca_file(managesieve): ssl_cert_file(default): /etc/dovecot/ufsc.br.crt ssl_cert_file(imap): /etc/dovecot/ufsc.br.crt ssl_cert_file(pop3): /etc/dovecot/ufsc.br.crt ssl_cert_file(managesieve): /etc/ssl/certs/dovecot.pem ssl_key_file(default): /etc/dovecot/ufsc.br.key ssl_key_file(imap): /etc/dovecot/ufsc.br.key ssl_key_file(pop3): /etc/dovecot/ufsc.br.key ssl_key_file(managesieve): /etc/ssl/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_process_per_connection: no login_process_size: 256 login_max_processes_count: 900 login_max_connections: 1024 max_mail_processes: 2048 mail_max_userip_connections(default): 2048 mail_max_userip_connections(imap): 2048 mail_max_userip_connections(pop3): 10 mail_max_userip_connections(managesieve): 10 mail_privileged_group: mail mail_uid: vmail mail_gid: mail mail_location: maildir:/var/mail/mailboxes/%d/%n:INDEX=/var/mail/indexes/%d/%n mail_debug: yes fsync_disable(default): yes fsync_disable(imap): yes fsync_disable(pop3): yes fsync_disable(managesieve): no mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): quota imap_quota autocreate trash zlib mail_plugins(imap): quota imap_quota autocreate trash zlib mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve managesieve_implementation_string(default): dovecot managesieve_implementation_string(imap): dovecot managesieve_implementation_string(pop3): dovecot managesieve_implementation_string(managesieve): Cyrus timsieved v2.2.13 lda: fsync_disable: no postmaster_address: xxx(a)xxx.xxx.xx mail_plugins: quota sieve auth_socket_path: /var/run/dovecot/auth-master auth default: cache_size: 1024 cache_ttl: 600 cache_negative_ttl: 60 username_chars: abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@~ username_format: %Lu passdb: driver: checkpassword args: /etc/dovecot/passdb.v3.1.sh userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-ldap-userdb.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: mail plugin: quota_exceeded_message: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx. quota: maildir:DefaultQuota quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 %u quota_warning2: storage=90%% /usr/local/bin/quota-warning.sh 90 %u trash: /etc/dovecot/dovecot-trash.conf sieve: /var/mail/sieve_scripts/%d/%n/.dovecot.sieve sieve_dir: /var/mail/sieve_scripts/%d/%n/sieve mail_log_events: delete expunge copy mailbox_delete mail_log_fields: uid box msgid from subject size vsize autocreate: Spam autosubscribe: Spam -- Att. Bruno Galindro da Costa

2 1

[Dovecot] FTS solr issue with second private namespace
by Andreas Oster 05 Dec '13

05 Dec '13

Hi all, I have just stumbled over an issue with the FTS plugin of dovecot. For our primary namespace, INBOX and its subfolders, searching works without any problems but in a second namespace, which I have created for old/archived mails, searching of the mail text/body does not work. I can see the search request in the tomcat log but no result is created and the mail client (Thunderbird) keeps displaying the serach message without returning any results. Tomcat6 catalina.out: Dez 02, 2013 11:58:00 AM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr path=/select params={fl=uid,score&sort=uid+asc&q=body:"schiller"&fq=%2Bbox:1b4de60d0a6287522d0c00004424cda4+%2Buser:"testuser"&rows=2} hits=0 status=0 QTime=1 I am currently using Dovecot 2.2.9 and do not have any special FTS config: mail_plugins = quota mailbox_alias fts fts_solr plugin { fts = solr fts_solr = break-imap-search url=http://localhost:8080/solr/ fts_autoindex = yes } Thank you for your kind help best regards Andreas

1 2

[Dovecot] Full text search improvements
by Timo Sirainen 05 Dec '13

05 Dec '13

FTS indexing is something I hear quite often nowadays. I’ve added some hacks to make it work better for some installations, but it’s about time to think about the whole design and how it could be improved for everyone in future. Here are some of my initial thoughts. Currently Dovecot supports 3 full text search engines: Solr, CLucene and Dovecot Squat. CLucene plugin has various features built in, which should have been built in a generic way to work with all the engines (although Solr has most of those already built-in). Squat was abandoned a few years ago in favor of Solr/CLucene, but perhaps it could be brought back to life, since it looks like its index sizes could be smaller than Lucene's. Here's a list of things that should be added to generic Dovecot FTS code to improve all the backends: 1. Support for multiple languages. Use textcat while indexing to guess the language of the indexed data. (Perhaps run it separately for each paragraph to handle multi-language mails? Or at least many emails begin/end with different language than the text in the middle, e.g. "Foo Bar wrote:" is often in various languages.) Index the data using the detected language's stemming and other features. Keep track of which languages have been used in the index, and when searching stem the search words to all the used languages. Since each added language requires additional searches and there's the possibility of wrong detection, the list of allowed languages could be configurable. See also http://ntextcat.codeplex.com/ or at least change textcat to use UTF8. 2. Word stemming. This can be done for many languages with Snowball library. Solr has also implemented several other languages, perhaps its code can be somehow automatically translated to C(++) for use with Dovecot? 3. Don't index language-specific stopwords. We can get the word lists from e.g. Solr. 4. Try to detect compound words and index each part separately for languages that use them. http://wiki.apache.org/solr/LanguageAnalysis#Decompounding suggests two possible ways to do it. 5. Normalize words (e.g. drop diacritics). libicu can be used for this. 6. Drop (Unicode) characters that don't belong to the language? Or especially don't index most of the weird Unicode characters. This would avoid filling the index with unnecessary garbage. 7. Don't index non-text data? For example if there is large block of base64 data or something else that definitely doesn't look like text, it's pretty useless to index it. Then again, we do want to index all kinds of IDs that someone might want to search. This could be a bit difficult to implement well. 8. Index attachments separately, so it would be possible to search only attachments. (Should "SEARCH BODY word1 BODY word2" return matches if word1 and word2 are in different attachments?) 9. Attachments can be translated to indexable UTF-8 text already with fts_decoder setting by doing it via a conversion script. This could also support Apache Tika server directly. 10. It should be configurable which fields are indexed. Body and header would always be separately indexed. Optionally there could be also at least: attachments, From, To, Cc, Bcc and Subject. The From/To/Cc/Bcc could also be indexed together in one "addresses" field. The more fields there are, the larger the index, but better/faster search results. 11. Each indexed mail should have metadata: Mailbox GUID, mail UID and the language the mail was indexed with. For attachments there should also be the MIME part number. When matching results, drop results if returned language doesn't match the query language. Squat ----- Currently Squat index consists of a trie containing all the words and pointer to a file listing all the message UIDs that contain them. Each node in the trie has a pointer to the UIDs, so e.g. with "abc" the "a" node will contain UIDs of all mails that contain the "a" letter (e.g. 1,3-5,10). "ab" node will contain mails that have the "ab" substring. Since the "ab" is a subset of "a", the "ab" won't contain UIDs directly but instead it contains indexes to the "a" list to get a better compression (e.g. UID 3-5,10 -> 2-4 indexes in the "1,3-5,10" list). The "abc" node then similarly refers to the "ab" node's indexes. It's configurable how long words Squat will index. Also substring matching is configurable. By default both are 4 letters, so words longer than 4 letters will be split to 4 letter pieces which are indexed (e.g. "dovecot" -> "dove", "ovec", "veco", "ecot"). When searching these pieces are looked up and the results are merged. It's pretty pointless to do a search for 1-2 letter substrings. Most likely the user wants to find 1-2 letter word instead. Perhaps this is true also for 3 letters? The Squat index could be changed to only add results for the first 1-2 (or 1-3?) letters only for full words, not to word prefixes. This of course would mean that the "ab" referring to "a" UID list would no longer work for the first nodes. Substring searching likely wouldn't work very nicely for stemmed words. So Squat should probably index the full stemmed word and then also index the unstemmed word in the small 4 letter pieces. It should be possible to also disable substring searching entirely. Squat already attempts to reduce disk space by encoding the common characters with less bits than other characters. This is hardcoded for English language though. Each index compression could analyze the most common letters and dynamically use those. Perhaps different languages could even use separate Squat index files to get the most advantage of this? Although if there are a lot of languages it's a bit annoying to have many different index files. Squat currently indexes each Unicode character as one letter, so there can be quite a huge number of different 4 letter words. This substring indexing should probably be disabled for words that contain letters not used by the current language. The UID lists are not compressed very efficiently. See http://www2009.eprints.org/41/1/p401.pdf for alternatives. There is currently one Squat index per mailbox. There should be one per user. This requires adding a separate ID -> { mailbox GUID, UID, language, mime part } mapping file. Squat indexes should be updated in two parts. For old mails there are the large trie+uidlist base files in optimized format. For new mails there are small trie+uidlist files in a format where they are just appended to. When the trie or uidlist becomes large enough, it's first internally sorted/optimized, and then merged with the base files by recreating new optimized base files. This fixes the scalability problem with current large Squat indexes where with large unsorted indexes the sorting could have taken forever. Since substring searches in Squat produce only "maybe matches" UID lists, the mails still need to be opened and searched through. This step could probably also do the same language detection + stemming as is done during indexing to improve the search results. (And this feature could be enabled even if no FTS index is enabled.)

6 9

[Dovecot] Postfix & Dovecot Sieve Advice
by craig.dovecot＠noboost.org 05 Dec '13

05 Dec '13

Hi, I've configured up Dovecot Pigeonhole with Postfix for delivery (all working perfectly). Seeing as I'm about to use this in production, I'm just after any advice or tips people might have to safeguard email delivery from Postfix to Dovecot via LMTP? Spec: postfix-2.6.6-2.2.el6_1.x86_64 dovecot-2.0.9-5.el6.x86_64 dovecot-pigeonhole-2.0.9-5.el6.x86_64 Postfix: virtual_transport = lmtp:unix:private/dovecot-lmtp Dovecot (key settings): vim /etc/dovecot/conf.d/10-auth.conf auth_username_format = %Ln vim /etc/dovecot/conf.d/10-master.conf service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } vim /etc/dovecot/conf.d/20-lmtp.conf protocol lmtp { mail_plugins = $mail_plugins sieve } vim /etc/dovecot/conf.d/90-sieve.conf plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_vacation_min_period = 1h sieve_vacation_default_period = 10d sieve_vacation_max_period = 30d } Regards, Craig

1 0

[Dovecot] BUG: Authentication client sent unknown handshake command
by Emmanuel Dreyfus 04 Dec '13

04 Dec '13

Hi After upgrading the kernel, everything is fine, except dovecot authentication. I get this trange thing (data after REQUEST? changed just in case it contains anything sensitive): Nov 29 16:56:01 volanges dovecot: auth: Error: BUG: Authentication client sent unknown handshake command: REQUEST?6970356762?616?6?235264ef69dbd1665538af54d12fdaea?session_pid=453?req... Nov 29 16:56:01 volanges dovecot: imap: Error: Authentication server didn't send valid SPID as expected: MECH PLAIN plaintext Nov 29 16:56:01 volanges dovecot: imap: Error: Disconnected from auth server, aborting (client-pid=161 client-id=1) Nov 29 16:56:01 volanges dovecot: imap-login: Internal login failure (pid=161 id=1) (internal failure, 1 successful auths): user=<jdoe>, method=PLAIN, rip=192.0.2.251, lip=192.0.2.10, mpid=453, TLS, TLSv1 with cipher AES128-SHA (128/128 bits) Reverting to the previous kernel fixed the problem, but I have not been able to spot what the problem was. Any idea? -- Emmanuel Dreyfus manu(a)netbsd.org

3 5

[Dovecot] Ubuntu packages and broken link in docs
by Alan McGinlay - SICS 04 Dec '13

04 Dec '13

Hi, Two things: 1. Does anyone know of a good PPA with updated packages of Dovecot for Ubuntu? "For the latest Dovecot for latest Ubuntu LTS see Xiaoka APT Repository. (Outdated. Could someone provide a ppa for latest stable Dovecot, please?)" 2. On the http://wiki2.dovecot.org/PrebuiltBinaries#Ubuntu page there is a link to a supposedly outdated PPA, the ppa page now redirects to an ad for the guys services so should probably be removed. /Alan

2 1

[Dovecot] Different settings for SSL/non-SSL protocols
by Алексей Прокопчук 04 Dec '13

04 Dec '13

Good time of the day! It is possible to setup dovecot with different requirements for SSL and non-SSL protocols? What would I like to do: pop3/imap non-SSL = allowed plain text authentication. pop3/imap with SSL = allowed plain text authentication with required valid SSL certificates. I need to allow access from any IP address for first group of users, which have valid SSL certificates. And allow access from only local IP addresses for second group of users which doesn't have SSL certificates at all. I tried to setup dovecot for such task. SSL and non-SSL pop3/imap works together fine, but without require valid SSL certificates. If I set auth_ssl_require_client_cert = yes, non-SSL pop3/imap refuses authentication without valid SSL certificate. I tried to use different sections for protocol pop3 {} and protocol pop3s {} (and imap/imaps) but this seems doesn't work. Is there any way to solve this? Thanks for attention, with best regards, Alexey Prokopchuk (AP8686-RIPE)

1 2

[Dovecot] Complete migration from Cyrus on remote server
by Alan McGinlay - SICS 04 Dec '13

04 Dec '13

Hi All! I am working on a complete migration from an old solaris machine running Cyrus IMAP v2.3.14 and wish to migrate all users to a new ubuntu vm running Dovecot 2.0.19. What I have so far is a fully functional dovecot installation with LDAP / Dovecot SASL auth using Maildir++. My plan is to use Perdition IMAP proxy on a third host and migrate users a few at a time (see attached picture of my whiteboard). The proxy is in place and already used by webmail clients to connect to the old server, shortly I will change the dns to point smtp.domain.com and imap.domain.com etc to the proxy instead of the old server but I haven't finished testing yet. Once that is done it is a simple matter of changing the proxy configuration per user to make them hit the new server instead. The problem I am having with this is that I am using Imapsync (http://imapsync.lamiral.info) to perform the initial synchronization (i have scripted it to maintain sync every 10 minutes with the addtion of "--maxage 1" option) using the following command line options: /usr/local/bin/imapsync --noreleasecheck --useheader ALL --delete2 --expunge2 --tmpdir /var/vmail/cache --subscribe --subscribed --tls1 --tls2 --usecache --nofoldersizes --nocheckmessageexists --host1 oldserver.domain.com --authuser1 adminuser --user1 testuser(a)domain.com --authmech1 PLAIN --password1 <HIDDEN> --host2 newserver.domain.com --authuser2 adminuser --user2 testuser(a)domain.com --authmech2 PLAIN --password2 <HIDDEN> All email is copied over and stored in dovecot as you would expect. Then I switch the user to the new server on the imapproxy and restart the client (thunderbird or whatever). This is where all email headers are downloaded again as if they were new! There are *Many* users here who would complain intensely if this happened and I was really wanting the migration to be as invisible as possible. Is there a way to do what I have described without the clients redownloading headers / full messages? I have been working on this for some time now but have hit a roadblock and don't know where to turn, any help would be really appreciated! Notes: * The proxy is not used during imapsync. * Some users have 20 years worth of mail running into 10's of GB * I have looked at dsync but the docs state that the mailbox should not be accessed during sync, this is not possible for me (it doesn't say why this is the case however)

4 7

[Dovecot] file descriptor errors
by Christian Rößner 04 Dec '13

04 Dec '13

Hi, I use dovecot 2.2.9 on Gentoo Linux and I get lots of these erors in my log file: Dec 4 08:53:37 mx dovecot: auth: Error: close failed in file object destructor: Dec 4 08:53:37 mx dovecot: auth: Error: IOError: [Errno 9] Bad file descriptor What could cause these error messages? My mailboxes are stored on an ext4 filesystem: /dev/vdb1 on /srv/mail type ext4 (rw,noatime) doveconf -n: # OS: Linux 3.11.2-hardened x86_64 Gentoo Base System release 2.2 ext4 auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_access_groups = mail mail_attachment_dir = /srv/mail/copymail/attachments mail_gid = mail mail_location = maildir:/srv/mail/virtual/%d/%n mail_plugins = quota acl zlib mail_log notify mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk-E-Mail { auto = subscribe special_use = \Junk } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. } passdb { args = /usr/local/sbin/ispcp-decrypt.py driver = checkpassword } plugin { acl = vfile acl_shared_dict = file:/srv/mail/virtual/shared-mailboxes.db quota = dict:User quota::file:/srv/mail/virtual/%d/%n/dovecot-quota quota_rule = *:storage=300M:messages=20000 quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster(a)deltaweb.de protocols = imap pop3 lmtp sieve service auth-worker { extra_groups = ssl-cert unix_listener auth-worker { mode = 0600 user = vmail } user = vmail } service auth { extra_groups = ssl-cert unix_listener /var/spool/postfix.relay/private/auth { group = postfix mode = 0660 user = postfix } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0660 user = vmail } user = vmail } service config { unix_listener config { mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { address = ::1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = </etc/ssl/certs/mx_deltaweb_de.crt ssl_key = </etc/ssl/private/mx_deltaweb_de.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = quota acl zlib mail_log notify sieve } protocol lda { mail_plugins = quota acl zlib mail_log notify sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = quota acl zlib mail_log notify imap_quota imap_acl imap_zlib } Thanks in advance -Christian Rößner -- Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 78823400, F: +49 6631 78823409, M: +49 176 93118939 USt-IdNr.: DE225643613, http://www.roessner-network-solutions.com

1 0

[Dovecot] Possible managesieve bug.
by Pedro R. Benito da Rocha 04 Dec '13

04 Dec '13

Hi, I'm migrating from from 1.1 to 2.2. Currently I am doing test to ensure I'm doing it right. On the old server the managesieve config says: sieve = /correo/%d/%u/dovecot.sieve sieve_dir = /correo/%d/%u/Sieve and is working fine. But the same config on the new server is not working. I have activated verbose logging and this is the result: Dec 3 09:59:41 imap-01 dovecot: managesieve-login: Login: user=<xxxx(a)ubu.es>, method=LOGIN, rip=10.145.4.65, lip=10.145.4.45, mpid=29855, session=<T7hfhJ3s+QAKkQRB> Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Error: sieve-storage: Performing readlink() on active sieve symlink '/correo/ubu.es/xxxx(a)ubu.es/dovecot.sieve' failed: Permission denied Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Error: sieve-storage: Failed to stat active sieve script symlink (/correo/ubu.es/xxxx(a)ubu.es/dovecot.sieve) Permission denied. Dec 3 09:59:41 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Disconnected: Logged out bytes=120/331 Dec 3 09:59:51 imap-01 dovecot: managesieve-login: Login: user=<pedro(a)ubu.es>, method=LOGIN, rip=10.145.4.65, lip=10.145.4.45, mpid=29858, session=<6bDthJ3s+wAKkQRB> Dec 3 09:59:51 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Error: sieve-storage: Performing readlink() on active sieve symlink '/correo/ubu.es/xxxx(a)ubu.es/dovecot.sieve' failed: Permission denied Dec 3 09:59:51 imap-01 dovecot: managesieve(xxxx(a)ubu.es): Disconnected: Logged out bytes=44/199 Permissions are ok. I modified the permissions using 0777 but the error message is the same. I have made other tests to see if I can find the problem, and I made it work if I delete "%d" from config, this way: sieve = /correo/%u/dovecot.sieve sieve_dir = /correo/%u/Sieve I have copied all filters preserving permissions, and with the same file permissions is working. If I add the '%d' to the path error comes again. Can anyone tell me if this is the normal behavior or is a bug? Thanks, Pedro -- ------------------------------------------------------------------------ Pedro R. Benito da Rocha - Servicio de Informatica - Area de Sistemas Universidad de Burgos (España) E-mail: pedro(a)ubu.es Tel: +34 947258845 ------------------------------------------------------------------------

2 2

[Dovecot] disconnecting (disconnected by server)
by Patrick Westenberg 03 Dec '13

03 Dec '13

Hi all, I just recognized a lot of log entries like this on my proxy: Dec 03 13:50:54 imap-login: Info: proxy(mail(a)example.com): disconnecting 1.2.3.4 (Disconnected by server): user=<mail(a)example.com>, method=PLAIN, rip=1.2.3.4, lip=2.4.6.8, TLS, session=<qk02v6DsJwBTlUQX> There are no similar entries on the backends. What does this mean? Something I have to worry about? Regards Patrick # 2.2.7: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_mechanisms = plain login default_process_limit = 150 director_mail_servers = 172.17.1.2 172.17.1.1 director_servers = 172.17.1.3 172.17.1.4 director_user_expire = 5 mins lmtp_proxy = yes log_path = /var/log/dovecot.log managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 172.17.1.3 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director } service lmtp { inet_listener lmtp { address = 172.17.1.3 port = 24 } } service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 4190 } } service pop3-login { executable = pop3-login director } ssl_cert = </etc/ssl/certs/wildcard.example.com.crt ssl_key = </etc/ssl/private/wildcard.example.com.key protocol !smtp { passdb { args = proxy=y nopassword=y starttls=any-cert driver = static } } protocol smtp { passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } } protocol lmtp { auth_socket_path = director-userdb } # 2.2.2: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.1 auth_mechanisms = plain login disable_plaintext_auth = no dotlock_use_excl = no hostname = mb01.example.com listen = 172.17.1.1 log_path = /var/log/dovecot.log login_trusted_networks = 172.17.1.3 172.17.1.4 mail_fsync = always mail_gid = vmail mail_home = /var/mail/%d/%n mail_location = maildir:~/Maildir mail_plugins = quota mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spamverdacht { auto = subscribe } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. separator = . type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::file:%h/Maildir/dovecot-quota quota_rule2 = INBOX.Trash:ignore quota_warning = storage=90%% quota-warning 90 %u quota_warning2 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_after = /usr/local/etc/dovecot/sieve/sieve_after.sieve sieve_default = /usr/local/etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve } postmaster_address = postmaster(a)example.com protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { mode = 0666 user = vmail } } service lmtp { inet_listener lmtp { address = 172.17.1.1 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/etc/dovecot/quota_warning.sh unix_listener quota-warning { user = vmail } user = root } ssl_cert = </etc/ssl/certs/mb01.example.com.crt ssl_key = </etc/ssl/private/mb01.example.com.key submission_host = mf01.wk-serv.net userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = quota sieve } protocol imap { mail_max_userip_connections = 30 mail_plugins = quota imap_quota }

2 5

[Dovecot] Error in imap_address_arg_append
by Potapov Sergey 03 Dec '13

03 Dec '13

Hi Function imap_envelope_parse return incorrect result for addresses with groups due to error in imap_address_arg_append because of with ", " is added after group name and before first mailbox. Patch for dovecot v2.1 in attach.

2 1

[Dovecot] Gettings mails recently moved to a folder
by Florian Lindner 03 Dec '13

03 Dec '13

Hello, some spam training tools learn the same message over and over again. Since I want to use a daily cronjob to train messages and I do not want to have the same messages trained multiple times, I need to way to get new messages in a folder. Is there a (consolish) way to get a list of messages that were recently moved to a folder? dovecot does not modify mtime, according to RFC 3501. Thanks, Florian

5 9

[Dovecot] imap-login hangs after receiving revoked SSL certificate
by Алексей Прокопчук 03 Dec '13

03 Dec '13

Good time of the day! My English is not very good, excuse me if I said something wrong. I use dovecot-2.1.16 on Gentoo Linux amd64. I need to setup dovecot (imap and pop3) for SSL and non-SSL connection simultaneously. For SSL connections client must submit a valid SSL certificate. Now SSL part of dovecot.conf looks like this: ----------------- ssl = yes ssl_cert = </etc/ssl/dovecot/dovecot.pem ssl_key = </etc/ssl/dovecot/dovecot.pem ssl_ca = </etc/ssl/ca/ca.pem ssl_verify_client_cert = yes auth_ssl_require_client_cert = yes protocol !smtp { auth_ssl_require_client_cert = yes } ----------------- All works fine with valid certificates. But if I submit revoked certificate, dovecot doesn't send error or success messages to mail client, process 'imap-login' eats 100% CPU and completely hangs. Only SIGKILL can terminate it. When dovecot receives revoked certificate, following messages appears in the log: ------------------ Dec 2 13:50:26 mail dovecot: imap-login: Invalid certificate: certificate revoked: /O=AP inc./OU=Admins/CN=Alexey Prokopchuk/UID=alexpro Dec 2 13:50:26 mail dovecot: imap-login: Invalid certificate: Different CRL scope: /CN=AP inc. root certification authority/O=AP inc./C=UA Dec 2 13:50:39 mail last message repeated 17950 times ------------------- If I'm not mistaken, in case of revoked certificate submission, dovecot must simply answer "SSL error" or "permission denied" to client and close connection, but according to log, it tries to check certificate again and again and do it in infinite loop. I can't understand for now - I misconfigured something or it's a bug? Thanks for attention, with best regards, Alexey Prokopchuk (AP8686-RIPE)

2 3

[Dovecot] proxy, userdb and passdb
by Jogi Hofmüller 03 Dec '13

03 Dec '13

Dear all, We are getting closer to the migration of our mailsystem. Now I have a special question. We are successfully using passdb { driver = pam } and that is good. Now, how would I tell dovecot to proxy certain users (the ones not yet migrated) to the old server? My attempts to configure an additional userdb failed since this seems to override the passdb setting. Grateful for any hints! Cheers, -- j.hofmüller Optimism doesn't alter the laws of physics. - Subcommander T'Pol

4 5

[Dovecot] Dove LDA vs Exim LDA
by Kumar Shantanu 02 Dec '13

02 Dec '13

Hello All, I have built up my email server with exim + dovecot + clamv/spamassasin. I am using exim as LDA(local delivery agent). I was reading about using dovecot as LDA but I couldn't find why should I use it? Now, I am looking expert advice on "Why should I use dovecot LDA" ? Is there any benefit in terms of functionality or performance ? Any advice/suggestion/feedbacks welcome. Thanks Shantanu

5 5

[Dovecot] "[CANNOT] Mailbox GUIDs are not permanent without index files" when trying to delete folder
by Nissim Etrog 02 Dec '13

02 Dec '13

Hello, Dovecot 2.0.9 on Red Hat Enterprise Linux Server release 6.4 (Santiago) location is set to : mail_location = mbox:~/mail:INBOX=/var/mail/%u:INDEX=MEMORY Index is set to memory due to permissions problems when using disk index. Everything works, even rename folder, but when trying to delete folder, using any mail client, it fails with: "[CANNOT] Mailbox GUIDs are not permanent without index files". Why ? Regards,Nissim Etrog

1 0

[Dovecot] doveadm table formatter: hidden titles may cause misaligned headers
by Julian Reich 02 Dec '13

02 Dec '13

Hello, I recently noticed a small bug in the doveadm table formatter: hidden titles may cause the headers to be misaligned. The behavior in question was introduced by commit <http://hg.dovecot.org/dovecot-2.2/rev/210282ae46e1> and doveadm -f table quota get -A may be used to reproduce it. Most simple patch attached: it simply restores the old behavior, to some extent. Actually hiding those titles may be desired. Regards, Julian Reich

1 0

[Dovecot] dovecot-antispam plugin problem with multiple messages
by Richard Platel 29 Nov '13

29 Nov '13

Hi With dovecot 2.2.5, and dovecot-antispam built from a recent HEAD pull, when copying multiple messages to or from a Spam folder, the plugin sends multiple copies of the first message to the backend. I've tried this with the pipe and spool2dir backends. For example with the spool2dir backend, via IMAP doing A COPY 1:3 Spam yields 3 copies of message id 1 in the dir: dev:imap-8.1 rplatel@imap01:/var/run/dovecot_as_tmp$ sudo -u mail md5sum * 28ad0a215eb7ecbd3a814a8a334d85bf 00000000001385586164-rplatel(a)ff-dev.com-00001s 28ad0a215eb7ecbd3a814a8a334d85bf 00000000001385586164-rplatel(a)ff-dev.com-00002s 28ad0a215eb7ecbd3a814a8a334d85bf 00000000001385586164-rplatel(a)ff-dev.com-00003s I see the same behaviour with the pipe backend, the pipe program is invoked 3 times, but with the same message content.

1 1

[Dovecot] proxy_maybe & director incompatibility
by Trent Lloyd 29 Nov '13

29 Nov '13

Hi Folks, I spent quite some time yesterday understanding how proxy works along with the director. I came to the conclusion that proxy_maybe and director cannot be used together, but this isn’t a true incompatibility so much as caused by the way things are handled and the order they are processed in. The way proxy_maybe works is that it is processed by the auth provider once it gets the response from the passdb, it checks for proxy_maybe and then checks for the ‘host’ parameter and compares it to the local IP (this is always null at that stage, because director won’t add host until later). proxy_maybe is deleted and then if the IPs do not match (i.e. the connection should be proxied) it sets proxy. This result is returned from the auth provider and then piped into director, which adds the relevant ‘host’ parameter if ‘proxy’ is set. The problem here is that because proxy_maybe is processed before director, it is not possible to conditionally proxy when using director — only if host is also returned from passdb. The secondary problem is that director only adds host= if proxy is set (and the auth code generally assumes proxy/proxy_maybe/proxy_always are exclusive settings) — this logic would also need to change. You would also need some logic to add host only if host doesn’t already exist, to handle situations where proxies might come from both passdb and/or director. I am seeking to understand if there is any significant reason proxy_maybe is handled during the auth section, it would seem better to simply always set ‘proxy=yes’, and then optionally have proxy_maybe passed all the way through to the connection stage and then do the local host check there. This would solve my use case, and I cannot imagine what else it would break — but I am no expert on dovecot or other people’s use cases, so I am hoping for feedback from others on this and what else would need to be considered or why this would not work before I spent time trying to implement the change. Thanks, Trent Lloyd w: www.webinabox.net.au

2 1

[Dovecot] Dovecot's brittle configuration syntax
by Kai Hendry 29 Nov '13

29 Nov '13

Hi there, Whilst trying to come up with a minimal configuration for Dovecot: http://dabase.com/blog/Minimal_Dovecot/ I noticed the configuration syntax is a bit admin unfriendly. It's easy to get an infamous Error code 89. Is there any back story to the grammar or language this configuration is in? Kind regards,

2 1

Re: [Dovecot] Dovecot's brittle configuration syntax
by Joseph Tam 29 Nov '13

29 Nov '13

Kai Hendry <hendry(a)dabase.com> wrote: > Whilst trying to come up with a minimal configuration for Dovecot: > http://dabase.com/blog/Minimal_Dovecot/ I think your characterization of the complexity of dovecot configuration by simply counting configuration lines to get it working is off base. It's conceivable to have all the default values work for you and only specify those that differ from defaults (or configure your system to conform to defaults if you want to place the proverbial cart before the horse), but that doesn't make it less complex -- it just hides it. (See doveconf -a if you want to see what you're shorthanding). If you want minimal configuration fuss, you can try uw-imapd. Not a lot of knobs to twist on that thing, but you'll have to accept all its limitations as well. A well chosen set of defaults that works for most people is a good design decision, but I've seen plenty of different and oddball layouts (including the sneakernet post preceding this one) that requires a lot of flexibility, which necessarily requires a lot of configuration to express them. The sample configuration is verbose because it doubles as documentation: you can use it as a starting point and remove the parts you don't need, or start from the documentation and move forward. I agree, though, that the documentation needs an editorial overhaul -- it's a little bewildering to find what you need along with the contextual information. > I noticed the configuration syntax is a bit admin unfriendly. It's easy > to get an infamous Error code 89. > > Is there any back story to the grammar or language this configuration is > in? It appears to me to have grown organically, and maybe will need pruning some day. Joseph Tam <jtam.home(a)gmail.com>

2 1

Re: [Dovecot] Replication via sneakernet
by David Bishop 28 Nov '13

28 Nov '13

D'oh. Replied to Timo instead of to the list. Apologies! On Thu, Nov 28, 2013 at 1:07 PM, David Bishop <dovecot(a)dpe.lusars.net>wrote: > On Thu, Nov 28, 2013 at 1:02 AM, Timo Sirainen <tss(a)iki.fi> wrote: > >> On 28.11.2013, at 5.17, David Bishop <dovecot(a)dpe.lusars.net> wrote: >> >> > There are trams shuttling back and forth along this road (stopping at >> each >> > station), and adding a small box (such as a weatherproofed Raspberry Pi >> > with a wifi dongle) to transport files up and down the road is pretty >> > simple. >> >> But if you do it this way and you can keep a full copy of the shared mail >> storage on your Raspberry, that would be possible already with dsync I >> think. dsync supports quick incremental updates by keeping track of the >> previous state between the servers. This state is saved in a file, so you >> could keep a different state for each different dsynced server. >> > > Bravo for a solution that doesn't require a code change and doesn't seem > to require directly touching the spools! :) > > Reading the man page, it looks like only mirroring for people who happen > to be checking email at a given place (as well as people who have received > mail and the shared mailboxes) seems like a pretty simple thing to do. > Hurrah! > > Thank you, this is wonderful. > > And more questions... > > If I'm running a virtual mail domain, the user/pass I give is for the > virtual mail user, correct? And, in a virtual mail setup, do I specify > "username" or "username@domain"? > > Is there a window beyond which synchronization becomes more difficult? For > instance, if messages (or metadata updates, like "I deleted this message") > get parked overnight without updating, and in the morning (9 hours later), > the trams (one at a time) pull into range of wifi, there won't be > confusion, right? > >

2 1

[Dovecot] sendmail to postfix-dovecot
by Roger Berger 28 Nov '13

28 Nov '13

Hi, I am a newbie to postfix and dovecot so I hope you can help me. I have an old server running sendmail for many years now. On this server I have about 100 domains and 500 users. The users are named as myuser or myuser.dom. People use pop3 and imap for fetching reading their email. I've setup a new server with postfix and dovecot2 on freebsd and managed to get it all working with virtual users. However, now I found out that I overlooked something; People have to login with username(a)domain.tld<mailto:username@domain.tld> on the new server but only use their username on the old server. This means they all have to change their login credentials, which is not an option. Is it possible to do some scripting before authentication where the username is looked up in the database and the right domain is added to the account? If I understand right it is not possible to use system and virtual users together. Thanks, Roger

5 6

Re: [Dovecot] Permissions problems
by Joseph Tam 27 Nov '13

27 Nov '13

<md.benson(a)gmail.com> wrote: > Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.error] imap(mark): Error: > rename(/mpool/mail/mark/dovecot.index.log.newlock, > /mpool/mail/mark/dovecot.index.log) failed: Permission denied > ... > This is what the directory currently looks like: > > mark@proliant-1:~$ ls -la /mpool/mail > total 6 > drwxrwxrwx+ 3 root root 3 2013-11-24 17:17 . > drwxr-xr-x+ 5 root root 5 2013-11-24 13:50 .. > drwxrwxrwx+ 5 mark staff 9 2013-11-24 22:20 mark I'm think the "+" is the problem: you have, in the words of the manpage for ls, ... this character is a plus sign (+) character if a non-trivial ACL is associated with the file ... Try ls -alv /mpool/mail I don't use ACLs, so I can help you how to modify them. Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] Enabling quota
by Andreas Kasenides 27 Nov '13

27 Nov '13

Hello everybody. Sorry if this has been answered before, I just could not find any info. Just point me if that is so. Can somebody please explain why there is no option --with-quota (ot may be --with-fs-quota) for the configure command? As it stands now, at least for the fs back-end the only thing that tells us that Dovecot does not do quotas is after the build/configuration we get dovecot: imap(xxdxx): Error: quotactl(Q_GETQUOTA, csfs9.cs.ucy.ac.cy:/mail) failed: No such file or directory which essentially means that during the build no quota development libraries were found and therefore fs quota will not function. This is rather confusing and the above error does not help much. Note also that "dovecot --build-options" is also silent on this. I suppose other back-ends do not have this requirement since there is no need for such devel libraries. thankx Andreas

3 3

[Dovecot] Dsync on a medium sized site
by Skeffling 27 Nov '13

27 Nov '13

Hello, We're looking at changing our current Dovecot setup to use dsync between 2 servers in different data centres to share the load and to provide resilience. We're quite excited about the possibilities! We receive about 100,000 emails a day, to about 10,000 mailboxes - a mix of IMAP and POP3. We'll use Dovecot Deliver via exim to put mail in to the Maildir. Has dsync been used on sites of this size? -Any tips? Do people tend to sync between 2 servers, or do some people use more than 2? I'm interested in other people's experience before setting up some test boxes. Thanks! Andrew.

1 0

[Dovecot] Failute to compile of pigeonhole-0.4.2 with Dovecot 2.2.7
by Andreas Kasenides 27 Nov '13

27 Nov '13

On trying to compile pigeonhole-0.4.2 on Dovecot 2.2.7 on a CentOS 6.4 machine Linux xxx.xxx 2.6.32-358.14.1.el6.x86_64 #1 SMP Tue Jul 16 23:51:20 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux with ./configure --with-dovecot=/usr/local/lib/dovecot I get the following error: ............ /bin/sh ../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I../.. -I/usr/local/include/dovecot -I../.. -I../../src/lib-sieve -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT sieve-storage.lo -MD -MP -MF .deps/sieve-storage.Tpo -c -o sieve-storage.lo sieve-storage.c libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I/usr/local/include/dovecot -I../.. -I../../src/lib-sieve -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT sieve-storage.lo -MD -MP -MF .deps/sieve-storage.Tpo -c sieve-storage.c -fPIC -DPIC -o .libs/sieve-storage.o sieve-storage.c: In function 'sieve_storage_inbox_script_attribute_set': sieve-storage.c:702: error: 'MAILBOX_ATTRIBUTE_PREFIX_DOVECOT_PVT_SERVER' undeclared (first use in this function) sieve-storage.c:702: error: (Each undeclared identifier is reported only once sieve-storage.c:702: error: for each function it appears in.) sieve-storage.c:702: error: expected ')' before string constant sieve-storage.c:693: warning: unused parameter 'name' sieve-storage.c: In function 'sieve_storage_inbox_script_attribute_rename': sieve-storage.c:718: error: 'MAILBOX_ATTRIBUTE_PREFIX_DOVECOT_PVT_SERVER' undeclared (first use in this function) sieve-storage.c:718: error: expected ')' before string constant sieve-storage.c:720: error: expected ')' before string constant sieve-storage.c:709: warning: unused parameter 'oldname' sieve-storage.c:709: warning: unused parameter 'newname' sieve-storage.c: In function 'sieve_storage_inbox_script_attribute_unset': sieve-storage.c:738: error: 'MAILBOX_ATTRIBUTE_PREFIX_DOVECOT_PVT_SERVER' undeclared (first use in this function) sieve-storage.c:738: error: expected ')' before string constant sieve-storage.c:729: warning: unused parameter 'name' make[3]: *** [sieve-storage.lo] Error 1 make[3]: Leaving directory `/root/dovecot-2.2-pigeonhole-0.4.2/src/lib-sievestorage' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/root/dovecot-2.2-pigeonhole-0.4.2/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/root/dovecot-2.2-pigeonhole-0.4.2' make: *** [all] Error 2 Dovecot 2.2.7 compiles and runs fine. Any help appreciated. Andreas

2 2

[Dovecot] Permissions problems
by Google 27 Nov '13

27 Nov '13

Hi, I have dovecot 2.0.20 running (its an old version, I know, it came from the stable archive at OpenCSW) with Solaris SMF integration working fine. It enables and disables okay. However, I cantt connect to it, it is allowing the connection, but spewing on permissions: Nov 24 17:34:20 proliant-1 dovecot: [ID 583609 mail.info] master: Dovecot v2.0.20 starting up Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.info] imap-login: Login: user=<mark>, method=PLAIN, rip=192.168.1.69, lip=192.168.1.72, mpid=18816 Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.info] imap-login: Login: user=<mark>, method=PLAIN, rip=192.168.1.69, lip=192.168.1.72, mpid=18818 Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.info] imap-login: Login: user=<mark>, method=PLAIN, rip=192.168.1.69, lip=192.168.1.72, mpid=18820 Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.info] imap(mark): Connection closed bytes=17/340 Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.info] imap-login: Login: user=<mark>, method=PLAIN, rip=192.168.1.69, lip=192.168.1.72, mpid=18822 Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.error] imap(mark): Error: rename(/mpool/mail/mark/dovecot.index.log.newlock, /mpool/mail/mark/dovecot.index.log) failed: Permission denied Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.error] imap(mark): Error: rename(/mpool/mail/mark/dovecot-uidlist.tmp, /mpool/mail/mark/dovecot-uidlist) failed: Permission denied Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.error] imap(mark): Error: unlink(/mpool/mail/mark/dovecot-uidlist.tmp) failed: Permission denied Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.error] imap(mark): Error: rename(/mpool/mail/mark/dovecot-uidlist.tmp, /mpool/mail/mark/dovecot-uidlist) failed: Permission denied Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.error] imap(mark): Error: unlink(/mpool/mail/mark/dovecot-uidlist.tmp) failed: Permission denied Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.error] imap(mark): Error: rename(/mpool/mail/mark/dovecot-uidlist.tmp, /mpool/mail/mark/dovecot-uidlist) failed: Permission denied Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.error] imap(mark): Error: unlink(/mpool/mail/mark/dovecot-uidlist.tmp) failed: Permission denied Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.error] imap(mark): Error: rename(/mpool/mail/mark/dovecot-uidlist.tmp, /mpool/mail/mark/dovecot-uidlist) failed: Permission denied Nov 24 17:34:27 proliant-1 dovecot: [ID 583609 mail.error] imap(mark): Error: unlink(/mpool/mail/mark/dovecot-uidlist.tmp) failed: Permission denied If I actually try to copy mail to the inbox of the account it core-dumps and does, and the SMF service drops into maintenance mode which requires re-enabling. The output from doveconf -n (this is changes from the default settings I think?) is: root@proliant-1:~# doveconf -n # 2.0.20: /etc/opt/csw/dovecot/dovecot.conf # OS: SunOS 5.11 i86pc zfs auth_first_valid_uid = 101 disable_plaintext_auth = no first_valid_uid = 101 mail_location = maildir:/mpool/mail/%u passdb { driver = pam } ssl_cert = </opt/csw/ssl/certs/dovecot.pem ssl_key = </opt/csw/ssl/private/dovecot.pem userdb { driver = passwd } The mail_location is in a ZFS filesystem on my RAIDz array. I couldnt think of any other way of creating user-specific folders in the location. As the value suggests, each user gets their own directory on the filesystem for mail. Is this still a ‘safe’ way to do things or would I be better off relocating each user’s ‘home’ directory to the pool somehow? This is what the directory currently looks like: mark@proliant-1:~$ ls -la /mpool/mail total 6 drwxrwxrwx+ 3 root root 3 2013-11-24 17:17 . drwxr-xr-x+ 5 root root 5 2013-11-24 13:50 .. drwxrwxrwx+ 5 mark staff 9 2013-11-24 22:20 mark mark@proliant-1:~$ ls -la /mpool/mail/mark/ total 14 drwxrwxrwx+ 5 mark staff 9 2013-11-24 22:20 . drwxrwxrwx+ 3 root root 3 2013-11-24 17:17 .. drwxrwxrwx+ 2 mark staff 2 2013-11-24 17:17 cur -rwxrwxrwx+ 1 mark staff 51 2013-11-24 22:20 dovecot-uidlist.tmp -rwxrwxrwx+ 1 mark staff 8 2013-11-24 22:20 dovecot-uidvalidity -rwxrwxrwx+ 1 mark staff 0 2013-11-24 17:17 dovecot-uidvalidity.529234ad -rwxrwxrwx+ 1 mark staff 40 2013-11-24 22:20 dovecot.index.log.newlock drwxrwxrwx+ 2 mark staff 2 2013-11-24 17:17 new drwxrwxrwx+ 2 mark staff 3 2013-11-24 17:21 tmp Any ideas? -- Mark Benson http://DECtec.info Twitter: @DECtecInfo HECnet: STAR69::MARK Online Resource & Mailing List for DEC Enthusiasts.

3 2

[Dovecot] Dovecot 2.1.16
by paolo.brocchi 27 Nov '13

27 Nov '13

Hi, i would ask you a question about a particular dovecot configuration. I would like to have in INBOX folder some emails (e.g email with a header key). The same emails i would like to have into the folders, under INBOX, create by users. How can i do? Thanks Paolo

2 4

[Dovecot] Dovecot 2.1 Panic
by Alexandr Sabitov 27 Nov '13

27 Nov '13

Hi, Dovecot 2.1.12 sends panic message when it tries to authenticate some users. Apparently because they use different authentication mechanisms on different email clients at the same time. For example, in debug logs this user uses CRAM-MD5, NTLM and PLAIN in account settings of his email clients. All passwords are stored in plain text (base64) in LDAP. Please advise me what I can tweak to fix this issue ? Nov 27 06:38:36 dovecot-1 auth: Error: ldap(gone(a)in.com.au,201.45.21.151,<qZlhoBnsvQDLLRuX>): Multiple password values not supported Nov 27 06:38:36 dovecot-1 auth: Panic: file passdb-ldap.c: line 95 (ldap_lookup_finish): assertion failed: (password == NULL || scheme != NULL) Nov 27 06:38:36 dovecot-1 auth: Error: ldap(gone(a)in.com.au,201.45.21.151,<qZlhoBnsvQDLLRuX>): Multiple password values not supported Nov 27 06:38:36 dovecot-1 auth: Error: Raw backtrace: /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x485ca) [0x7f90ed51b5ca] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x48616) [0x7f90ed51b616] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f90ed4eeeef] -> dovecot-proxy/auth() [0x42967c] -> dovecot-proxy/auth() [0x428da1] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f90ed5277a6] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f90ed5287df] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f90ed527748] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f90ed513123] -> dovecot-proxy/auth(main+0x376) [0x41bd26] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f90ec2d8c8d] -> dovecot-proxy/auth() [0x40d0f9] Nov 27 06:38:36 dovecot-1 auth: Error: Raw backtrace: /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x485ca) [0x7f90ed51b5ca] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x48616) [0x7f90ed51b616] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f90ed4eeeef] -> dovecot-proxy/auth() [0x42967c] -> dovecot-proxy/auth() [0x428da1] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f90ed5277a6] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f90ed5287df] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f90ed527748] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f90ed513123] -> dovecot- proxy/auth(main+0x376) [0x41bd26] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f90ec2d8c8d] -> dovecot-proxy/auth() [0x40d0f9] Nov 27 06:38:36 dovecot-1 director: Error: Auth server disconnected unexpectedly Nov 27 06:38:36 dovecot-1 auth: Fatal: master: service(auth): child 26841 killed with signal 6 (core dumps disabled) This is LDAP configuration on one of director servers where clients are authenticated. uris = ldap://ldap-node-2.mynetwork.net, ldap://ldap-node-3.mynetwork.net debug_level = 0 base = ou=email, dc=netregistry, dc=net user_attrs = homeDirectory=home, uidNumber=uid, gidNumber=gid, mailQuotaSize=quota_rule=*:storage=%$ user_filter = (&(objectClass=nrPOPAccount)(uid=%u)) pass_attrs = uid=user, userPassword=password, =proxy=y, =destuser=%u, =pass=Secret456 pass_filter = (&(objectClass=nrPOPAccount)(uid=%u)) default_pass_scheme = PLAIN Regards, Alexandr Sabitov System Administrator

1 0

[Dovecot] Dovecot software testing and release practice
by Andreas Kasenides 26 Nov '13

26 Nov '13

Since this, it seems, was lost in, the now infamous, 2.2.9 thread I would like to resubmit the following proposal for Timo's consideration. Thanks Timo for doing an excellent job. I believe that the following will add further value to Dovecot in the long run. Thankx Andreas ============================ > On 23-11-2013 3:47, Noel Butler wrote: > > On Fri, 2013-11-22 at 10:14 +0100, Ralf Hildebrandt wrote: > * Thomas Leuxner <tlx(a)leuxner.net>: > * Ralf Hildebrandt <Ralf.Hildebrandt(a)charite.de> 2013.11.22 > 09:44: > > Which patch? > > > http://www.dovecot.org/list/dovecot/2013-November/093654.html > Pigeonhole related patches. > Damn. Those are biting me as well :/ > > These would be found if Timo reverted back to issuing RC's before any > official release, to iron out the > niggly off-putting bugs, like most software does, or gets his devs and > a community of official > >testers>each with wildly different > configurations and set ups, ASF have an excellent model that could be > >followed, >bunch of devs and testers who each report on different distros and configs, why? because no >single dev can imagine and test every possible configuration. it might just save dovecot's good name, I >recall a lot of damage was done to that in the circles I'm in when 2.0 was released with patches nearly >every few days and weeks, I know a few ISP's and businesses that went back to courier or Wu's because >major bugs were getting in often, though it has been a lot better since 2.1 series, until this release >that is :) I second this and offer my services for two, three different system configs from Dovecot's plain old simple config with MAILDIR to slightly more complicated configurations with proxying/LDAP/dsync/mySQL etc based on virtualization with KVM. I also propose that upon employing above strategy that Timo should come up with a release cycles (long term, short term) with announced targets. Patches should be released as patches strictly as needed, not releases, and should be announced on a low traffic list like he is already doing with releases. OR something along these lines. I know these are growing pains but essential. Email systems are CRITICAL for most of us. Andreas

1 0

[Dovecot] Replication master/master
by John Smith 26 Nov '13

26 Nov '13

Hello, i need help for this error: "dovecot: replicator: Error: Invalid replicator db record:" my config http://pastebin.com/jVnvyWZM -- Best Regards, Evgeny Senior System Administrator OOO "Vaz Service Hurley"

1 0

[Dovecot] Problem with Thunderbird and mailbox with SPECIAL-USE flag
by Sylvain 26 Nov '13

26 Nov '13

Hi ! I have an old Courier IMAP and in front of it, I have put a proxy cache with the great Dovecot. SOGo webmail is connected to the proxy and works great (very very more fast) but I have a problem with Thunderbird : mailbox with « SPECIAL USE » aren't automatically detected. To make that works, I must : - in Dovecot : define the namespace inbox : « prefix = » and « separator = . » - in Thunderbird : force in the account, the personal namespace to "INBOX." and untick « Allow server to exceed namespace » (sorry : personal translation :D). If I define in the namespace inbox as the dovecot wiki said : « prefix = INBOX. » and « separator = . », TB see a sub-folder INBOX and mailbox with special use aren't automatically detected. :-( I must have forgotten a parameter in my Dovecot configuration but I don't see it.. Can you have a look please ? Here my configuration : # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_debug_passwords = yes auth_mechanisms = plain login disable_plaintext_auth = no first_valid_uid = 100 imapc_host = xxxxxx mail_gid = imapproxy mail_home = /var/local/cache/dovecot/%1Mu/%1.1Mu/%u mail_location = imapc:~/imapc mail_uid = imapproxy namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . type = private } passdb { args = host=xxxxxx port=143 default_fields = userdb_imapc_user=%u userdb_imapc_password=%w driver = imap } protocols = imap ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { driver = prefetch } Sylvain

1 1

[Dovecot] 2.2.9
by Nick Edwards 26 Nov '13

26 Nov '13

Timo (since he is the only one that maters here), In past couple of days I have seen 4 people on IRC bitten by 2.2.8 and pigeonhole bug, none of them are on this list, so like all others who want to download and build them, are unaware of the patch, so, given how wide the userbase is with pigeonhole sieve and dovecot, this would or should be considered a serious bug, so my question is Timo, is it not best to immediately push 2.2.9, or should even more server administrators become frustrated and curse waiting two more months until you have a list you think is best putting out a new release, many of them dont like the constant new releases all the time with only minor things, but with a build failure, thats a serious issue.

15 27

Re: [Dovecot] 2.2.9
by Rick Romero 26 Nov '13

26 Nov '13

Noel, I include you in the gang of three, and I only read half the posts on this list. I have no specific reason to, but it isn't a good association. A decade ago I was active on the Pegasus mail and Mercury lists, and names stood out after a while. Unfortunately on this list, the names stand out for a completely different reason - and its not positive. Just chill, everyone. You never know who's going to interview you in a year. Rick

2 1

[Dovecot] postfix and dovecot - no emails in new folder
by Don Hill 26 Nov '13

26 Nov '13

Hi. I am working on setting up Dovecot v2.0.9 and postfix 2.6.6 on centos 6.4. I have postfix configured with dovecot using virtual users. Everything seems to be working with the exception of no emails being delivered to the Maildir/new folder. If I touch a file into that folder then the file gets delivered to the email client using imap. I can also send email from the client with no problems. In fact if I look at the logs postfix says the email was delivered to the mailbox. postfix/virtual[27270]: 8652F35C38A8: to=<user(a)domain.tld>, relay=virtual, delay=0.11, delays=0.1/0.01/0/0, dsn=2.0.0, status=sent (delivered to mailbox)$ Here is my dovecot -n output *doveconf: Warning: NOTE: You can get a new clean config file with: doveconf -n > dovecot-new.conf** **doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:85: protocol { ssl_listen } has been replaced by service { inet_listener { address } }** **# OS: Linux 2.6.32-042stab079.6 x86_64 CentOS release 6.4 (Final) reiserfs** **auth_mechanisms = plain login** **default_login_user = vmail** **first_valid_gid = 5000** **first_valid_uid = 5000** **listen = *** **mail_access_groups = vmail** **mail_location = maildir:/var/vmail/%d/%u/Maildir** **mbox_write_locks = fcntl** **passdb {** ** args = scheme=SHA1 /etc/dovecot/passwd** ** driver = passwd-file** **}** **protocols = imap pop3** **service auth {** ** unix_listener auth-client {** ** group = postfix** ** mode = 0660** ** user = postfix** ** }** ** user = root** **}** **service imap-login {** ** inet_listener imaps {** ** address = *** ** }** ** process_min_avail = 1** ** user = vmail** **}** **service pop3-login {** ** inet_listener pop3s {** ** address = *** ** }** **}** **ssl_cert = </etc/pki/dovecot/certs/dovecot.pem** **ssl_key = </etc/pki/dovecot/private/dovecot.pem** **userdb {** ** args = uid=5000 gid=5000 home=/var/vmail/%d/%u allow_all_users=yes** ** driver = static** **}* Any thoughts?

4 7

[Dovecot] Invitation to connect on LinkedIn
by Don Hill 26 Nov '13

26 Nov '13

LinkedIn ------------ I'd like to add you to my professional network on LinkedIn. - Don Don Hill Senior Technical Consultant at Lincoln Financial Group Greater Chicago Area Confirm that you know Don Hill: https://www.linkedin.com/e/458g9e-hogi596x-46/isd/18305189187/jxXw8l7X/?hs=… -- You are receiving Invitation to Connect emails. Click to unsubscribe: http://www.linkedin.com/e/458g9e-hogi596x-46/V7LnuFRIQXpYNGb2yum6IE4IQU3ZkP… (c) 2012 LinkedIn Corporation. 2029 Stierlin Ct, Mountain View, CA 94043, USA.

1 0

[Dovecot] error while compiling dovecot 2.2.9
by Luuk 25 Nov '13

25 Nov '13

while doing 'sudo make install', its complaining about the existance of ‘/usr/local/lib/dovecot/auth’ ..... make[3]: Entering directory `/home/luuk/source/dovecot-2.2.9/src/anvil' /usr/bin/mkdir -p '/usr/local/lib/dovecot' /bin/sh ../../libtool --mode=install /usr/bin/install -c anvil '/usr/local/lib/dovecot' libtool: install: /usr/bin/install -c .libs/anvil /usr/local/lib/dovecot/anvil make[3]: Nothing to be done for `install-data-am'. make[3]: Leaving directory `/home/luuk/source/dovecot-2.2.9/src/anvil' make[2]: Leaving directory `/home/luuk/source/dovecot-2.2.9/src/anvil' Making install in auth make[2]: Entering directory `/home/luuk/source/dovecot-2.2.9/src/auth' make[3]: Entering directory `/home/luuk/source/dovecot-2.2.9/src/auth' /usr/bin/mkdir -p '/usr/local/lib/dovecot' /bin/sh ../../libtool --mode=install /usr/bin/install -c auth checkpassword-reply '/usr/local/lib/dovecot' libtool: install: /usr/bin/install -c .libs/auth /usr/local/lib/dovecot/auth libtool: install: /usr/bin/install -c .libs/checkpassword-reply /usr/local/lib/dovecot/checkpassword-reply /usr/bin/mkdir -p '/usr/local/lib/dovecot/auth' /usr/bin/mkdir: cannot create directory ‘/usr/local/lib/dovecot/auth’: File exists make[3]: *** [install-auth_moduleLTLIBRARIES] Error 1 make[3]: Leaving directory `/home/luuk/source/dovecot-2.2.9/src/auth' make[2]: *** [install-am] Error 2 make[2]: Leaving directory `/home/luuk/source/dovecot-2.2.9/src/auth' make[1]: *** [install-recursive] Error 1 make[1]: Leaving directory `/home/luuk/source/dovecot-2.2.9/src' make: *** [install-recursive] Error 1 luuk@asus:~/source/dovecot-2.2.9> any tips on what i did wrong?

4 7

[Dovecot] Zlib plugin - when does it make sense?
by Frerich Raabe 25 Nov '13

25 Nov '13

Hi, I run a small IMAP server for a dozen guys in the office, serving about 55GB of Maildir. I recently became aware of the Zlib plugin ( http://wiki2.dovecot.org/Plugins/Zlib ) and wondered 1. given that there is about zero CPU load on my IMAP server, is enabling the plugin a no-brainer or are there other things (except CPU load) to consider? 2. For enabling the plugin, I suppose you compress all the existing mail just once and then add 'zlib' to mail_plugins in order to have all future incoming mail saved? Any insight by people familiar with the plugin would be much appreciated - thanks! -- Frerich Raabe - raabe(a)froglogic.com www.froglogic.com - Multi-Platform GUI Testing

4 5

[Dovecot] prohibit deletion of Junk folder
by Alexandre Ellert 25 Nov '13

25 Nov '13

Hi, I have an issue with a sieve_before rule (the script move incoming email to Junk folder when DMARC=fail and policy is quarantine) because one of my user delete his Junk folder : dovecot: lda(myuser(a)domain.com): Error: sieve: execution of script /etc/dovecot/sieve_before/01-dmarc-fail.sieve failed, but implicit keep was successful: 1 Time(s) dovecot: lda(myuser(a)domain.com): Error: sieve: msgid=<20131124212217.5F346580D49(a)anotherdomain.com>: failed to store into mailbox 'Junk': Mailbox doesn't exist: Junk: 1 Time(s) How can I do to prohibit the deletion of Junk folder by end users ? Tell me if you need 'dovecot -n' and thanks for your advices. Alexandre.

2 2

[Dovecot] Dovecot 2.2.7/2.2.8 failing to call dspam with antispam
by Guillaume Hilt 25 Nov '13

25 Nov '13

Hello again, I'm running Gentoo AMD64 2013 with postfix, mysql, dovecot and dspam : dovecot 2.2.8 (it was working fine with 2.2.6 after doing a chmod 4511 on dspam binary), dspam 3.10.2-r1 and dovecot-antispam-2.0_pre20130429 (recompiled after each dovecot upgrade). I've set dspam to debug, and mail_debug to yes. uid 1001 is user vmail (dovecot is running under vmail) gid 12 is group mail (vmail is a member, with mail,postfix,dspam,dovecot,apache) All the necessary users are trusted in dspam configuration. Here's my plugin settings : antispam_verbose_debug = 1 antispam_debug_target = syslog antispam_backend = dspam antispam_allow_append_to_spam = NO antispam_skip_from_line = NO antispam_spam = Spam antispam_trash = Trash antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_dspam_binary = /usr/bin/dspam antispam_dspam_args = --user;%u;--deliver=;--source=error;--signature=%%s antispam_dspam_spam = --class=spam antispam_dspam_notspam = --class=innocent antispam_dspam_result_header = X-DSPAM-Result When i'm moving an email to the dspam folder, Thunderbird throw me an error : Failed to call dspam (email is dropped in the Spam folder anyway, but a copy stay on my INBOX) ==> /var/log/mail/mail/log <== Nov 25 13:01:04 srv1 dovecot: imap: Debug: Loading modules from directory: /usr/lib64/dovecot Nov 25 13:01:04 srv1 dovecot: imap: Debug: Module loaded: /usr/lib64/dovecot/lib90_antispam_plugin.so Nov 25 13:01:04 srv1 dovecot: imap: Debug: Added userdb setting: plugin/maildir=shadowprojects.org/ghilt/ Nov 25 13:01:04 srv1 dovecot: imap(ghilt(a)shadowprojects.org): Debug: Effective uid=1001, gid=12, home=/home/vmail/shadowprojects.org/ghilt/ Nov 25 13:01:04 srv1 dovecot: imap(ghilt(a)shadowprojects.org): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/shadowprojects.org/ghilt/.maildir Nov 25 13:01:04 srv1 dovecot: imap(ghilt(a)shadowprojects.org): Debug: maildir++: root=/home/vmail/shadowprojects.org/ghilt/.maildir, index=, indexpvt=, control=, inbox=/home/vmail/shadowprojects.org/ghilt/.maildir, alt= Nov 25 13:01:04 srv1 dovecot: imap(ghilt(a)shadowprojects.org): Debug: Namespace : Using permissions from /home/vmail/shadowprojects.org/ghilt/.maildir: mode=0770 gid=default Nov 25 13:01:04 srv1 dovecot: imap(ghilt(a)shadowprojects.org): Debug: dspam error:29764 prefix=imap(ghilt(a)shadowprojects.org): Nov 25 13:01:04 srv1 dovecot: imap(ghilt(a)shadowprojects.org): Debug: executing /usr/bin/dspam failed: 13 (uid=1001, gid=12) Nov 25 13:01:04 srv1 dovecot: imap: Error: Nov 25 13:01:04 srv1 dovecot: imap: Error: ==> /var/log/dspam/dspam.debug <== 9976: [11/25/2013 13:12:23] DSPAM Instance Startup 9976: [11/25/2013 13:12:23] input args: /usr/bin/dspam --user ghilt(a)shadowprojects.org --deliver= --source=error --signature=89,52900600118151560172939 --class=spam 9976: [11/25/2013 13:12:23] pass-thru args: 9976: [11/25/2013 13:12:23] processing user ghilt(a)shadowprojects.org 9976: [11/25/2013 13:12:23] uid = 1001, euid = 0, gid = 12, egid = 12 9976: [11/25/2013 13:12:23] loading preferences for user ghilt(a)shadowprojects.org ... 9976: [11/25/2013 13:06:08] DSPAM Instance Shutdown. Exit Code: 99 9976: [11/25/2013 13:06:08] process_users() failed on error 9 If i try to call dspam like this, it works : sudo -u vmail /usr/bin/dspam --source=error --class=spam --signature=4be87a9f953248352114216 --client --user vmail Any idea ? Thanks, -- Guillaume Hilt

2 3

[Dovecot] Checkpassword interface for custom password check and home mounting
by Jouko Nikula 25 Nov '13

25 Nov '13

Hi, I'm trying to use the checkpassword interface to do a password check and if the check succeeds I mount the user home directory (including mail) using the users login password and uid. My password check seems to work, but when I add the home directory mounting things seem to stop. Dovecot never logs the result of the password check and nothing happens until the client gets bored and tries again. I added trace to the dovecot's checkpassword-reply and I see that it's really executed, it writes the reply and returns 0 for successful authentication. My dovecot version is 2.1.7. My checkpassword is a setuid binary and the mount is a self made fuse-fs. Any ideas what happens? Are there better ways to do this? Thanks, - Jouko

2 2

[Dovecot] Checkpassword interface for custom password check and home mounting
by Jouko Nikula 25 Nov '13

25 Nov '13

Hi, I'm trying to use the checkpassword interface to do a password check and if the check succeeds I mount the user home directory (including mail) using the users login password and uid. Things work well if I do the mount manually, but when I add the home directory mounting to checkpassword things seem to stop. Dovecot logs the result of the password check, but doesn't send the result to client. Here's the log: Nov 25 10:32:05 jlaptop dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Nov 25 10:32:05 jlaptop dovecot: auth: Debug: auth client connected (pid=27551) Nov 25 10:32:05 jlaptop dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=8HsMAvjrvgB/AAAB#011lip=127.0.0.1#011rip=127.0.0.1#011lport=143#011rport=39614 Nov 25 10:32:05 jlaptop dovecot: auth: Debug: client out: CONT#0111#011 Nov 25 10:32:05 jlaptop dovecot: auth: Debug: client in: CONT<hidden> Nov 25 10:32:05 jlaptop dovecot: auth: Debug: checkpassword(jouko.nikula,127.0.0.1,<8HsMAvjrvgB/AAAB>): execute: /usr/sbin/gpgfusemount /usr/lib/dovecot/checkpassword-reply Nov 25 10:32:05 jlaptop dovecot: auth: Debug: checkpassword(jouko.nikula,127.0.0.1,<8HsMAvjrvgB/AAAB>): exit_status=0 My dovecot version is 2.1.7. My checkpassword is a setuid binary and the mount is a self made fuse-fs. Any ideas what happens? Are there better ways to do this? Thanks, - Jouko

1 0

[Dovecot] quota warning by script fails
by Jimmy Koerting 24 Nov '13

24 Nov '13

Hello! I looked around all online resources I found, but I'm not able to find my failure. So any help would be welcome! The problem arises with an dovecot 2.2.6 on a 9.2 FreeBSD RELEASE in a jailed environment. I have the following config settings regarding quota (which works in general, but just without calling the script): /etc/dovecot/conf.d/90-quota.conf: ... plugin { quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u } service quota-warning { executable = script /usr/sbin/quota-warning.sh unix_listener quota-warning { mode = 0666 } } ... script: -rwxrwxrwx 1 root wheel 580 23 Nov 17:14 /usr/sbin/quota-warning.sh* socket: [root@testfbsd ~]# ll /var/run/dovecot/quota-warning srw-rw-rw- 1 root wheel 0 23 Nov 17:06 /var/run/dovecot/quota-warning= Calling the 'quota-warning.sh' script from the console works: Nov 23 17:00:42 testfbsd dovecot: lda(admin(a)testfbsd.XXXXXXXXX.net): msgid=<Ne509YyBcF4pRuYBSyaSfTuUquS9YW@testfbsd>: saved mail to INBOX But when I force dovecot to call it with sending to much mails to the server, the following log comes up (which show, that dovecot at least wants to call the script :"Debug: quota: Executing warning: quota-warning 95 admin@testfbxxxxxxxxxxxxnet" in my understanding): (no further errors or messages about non existing sockets or wrong perms etc. comes up) ==> /var/log/maillog <== Nov 23 18:19:15 testfbsd sm-mta[75486]: STARTTLS=server, relay= mail-wi0-f196.google.com [209.85.212.196], version=TLSv1/SSLv3, verify=NOT, cipher=RC4-SHA, bits=128/128 Nov 23 18:19:15 testfbsd sm-mta[75486]: rANHJEOP075486: from=< jtxxxxxxxx(a)gmail.com>, size=288072, class=0, nrcpts=1, msgid=<CAJeXgQBj7VvTqKGDTNE-PCXKf28X3fSQ3R=zp+L2cPEjVLN-7g(a)mail.gmail.com>, proto=ESMTP, daemon=MTA, relay=mail-wi0-f196.google.com [209.85.212.196] ==> /var/log/debug.log <== Nov 23 18:19:17 testfbsd dovecot: lda: Debug: Loading modules from directory: /usr/iports/lib/dovecot Nov 23 18:19:17 testfbsd dovecot: lda: Debug: Module loaded: /usr/iports/lib/dovecot/lib10_quota_plugin.so Nov 23 18:19:17 testfbsd dovecot: auth: Debug: master in: USER 1 admin@testfbxxxxxxxxxxxxnet service=lda Nov 23 18:19:17 testfbsd dovecot: auth: Debug: passwd-file(admin@testfbxxxxxxxxxxxxnet): lookup: user=admin@testfbxxxxxxxxxxxxnet file=/etc/mail/mailuser Nov 23 18:19:17 testfbsd dovecot: auth: Debug: userdb out: USER 1 admin@testfbxxxxxxxxxxxxnet uid=1000 gid=1000 home=/home/admin@testfbxxxxxxxxxxxxnet quota_rule=*:storage=2M Nov 23 18:19:17 testfbsd dovecot: lda: Debug: auth input: admin@testfbxxxxxxxxxxxxnet uid=1000 gid=1000 home=/home/admin@testfbxxxxxxxxxxxxnet quota_rule=*:storage=2M Nov 23 18:19:17 testfbsd dovecot: lda: Debug: Added userdb setting: plugin/quota_rule=*:storage=2M Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Effective uid=1000, gid=1000, home=/home/admin@testfbxxxxxxxxxxxxnet Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Quota root: name=User quota backend=maildir args= Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Quota rule: root=User quota mailbox=* bytes=2097152 messages=0 Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Quota rule: root=User quota mailbox=Trash bytes=+10485760 messages=0 Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Quota rule: root=User quota mailbox=Deleted Messages bytes=+10485760 messages=0 Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Quota warning: bytes=1992294 (95%) messages=0 reverse=no command=quota-warning 95 admin@testfbxxxxxxxxxxxxnet Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Quota warning: bytes=1677721 (80%) messages=0 reverse=no command=quota-warning 80 admin@testfbxxxxxxxxxxxxnet Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Quota warning: bytes=1048576 (50%) messages=0 reverse=no command=quota-warning 50 admin@testfbxxxxxxxxxxxxnet Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Quota grace: root=User quota bytes=209715 (10%) Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/admin@testfbxxxxxxxxxxxxnet/mail Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: maildir++: root=/home/admin@testfbxxxxxxxxxxxxnet/mail, index=, indexpvt=, control=, inbox=/home/admin@testfbxxxxxxxxxxxxnet/mail, alt= Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Quota root: name=User quota backend=maildir args= Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Quota warning: bytes=0 (95%) messages=0 reverse=no command=quota-warning 95 raw mail user Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Quota warning: bytes=0 (80%) messages=0 reverse=no command=quota-warning 80 raw mail user Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Quota warning: bytes=0 (50%) messages=0 reverse=no command=quota-warning 50 raw mail user Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Quota grace: root=User quota bytes=0 (10%) Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Nov 23 18:19:17 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Destination address: admin@testfbxxxxxxxxxxxxnet (source: user@hostname) Nov 23 18:19:18 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: Namespace : Using permissions from /home/admin@testfbxxxxxxxxxxxxnet/mail: mode=0700 gid=default Nov 23 18:19:18 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): Debug: quota: Executing warning: quota-warning 95 admin@testfbxxxxxxxxxxxxnet ==> /var/log/maillog <== Nov 23 18:19:18 testfbsd dovecot: lda(admin@testfbxxxxxxxxxxxxnet): msgid=<CAJeXgQBj7VvTqKGDTNE-PCXKf28X3fSQ3R=zp+L2cPEjVLN-7g(a)mail.gmail.com>: saved mail to INBOX Nov 23 18:19:18 testfbsd sm-mta[75487]: rANHJEOP075486: to=<admin@testfbxxxxxxxxxxxxnet>, delay=00:00:03, xdelay=00:00:03, mailer=local, pri=318436, dsn=2.0.0, stat=Sent So, please advice, what I miss here! Thanks a lot! Kind regards, jimmy

1 1

[Dovecot] dovecot patch: do scanf correctly
by Jann Horn 24 Nov '13

24 Nov '13

As far as I can tell, there are two places in which dovecot does not use scanf properly. This patch should fix that. -------------------------------------------------------------------------------- diff -r 8a3d0426f514 src/lib-dns/dns-lookup.c --- a/src/lib-dns/dns-lookup.c Sat Nov 23 23:22:09 2013 +0000 +++ b/src/lib-dns/dns-lookup.c Sun Nov 24 06:30:12 2013 +0100 @@ -102,7 +102,7 @@ } /* first line: <ret> <ip count> */ if (sscanf(line, "%d %u", &result->ret, - &result->ips_count) == 0) + &result->ips_count) != 2) return -1; if (result->ret != 0) { result->error = net_gethosterror(result->ret); diff -r 8a3d0426f514 src/lib-settings/settings.c --- a/src/lib-settings/settings.c Sat Nov 23 23:22:09 2013 +0000 +++ b/src/lib-settings/settings.c Sun Nov 24 06:30:12 2013 +0100 @@ -44,7 +44,7 @@ { int num; - if (!sscanf(value, "%i", &num) || num < 0) + if (sscanf(value, "%i", &num) != 1 || num < 0) return t_strconcat("Invalid number: ", value, NULL); *result = num; return NULL; -------------------------------------------------------------------------------- Specifically, both invocations disregard that sscanf("", "%d", &num) and similar make sscanf return EOF (-1 on my system) and the first invocation also does not account for the case that the second argument is not matched.

1 0

Re: [Dovecot] 2.2.9
by Rick Romero 23 Nov '13

23 Nov '13

Thanks for providing and maintaining a great piece of software. Rick

1 0

[Dovecot] Dict client unescaping sieve script
by Joshua Perry 22 Nov '13

22 Nov '13

I've created a dict service that listens on a unix socket and answers queries for sieve scripts (among other things). As I understand it (from the source code at http://hg.dovecot.org/dovecot-2.2/file/tip/src/lib-dict/dict-client.c) the dict client will unescape \001n, \001t, and \0011 to line feeds, tabs, and the \001 character respectively. In my service I am escaping those three characters in my response (if I don't escape them the line-oriented nature of the protocol causes a failure for multiline sieve scripts) but every time LDA attempts to process a sieve script I get an error in the logs (see below) showing sieve choking on \001 characters. Is there some configuration value I've missed or something? *dovecot log* Nov 8 23:04:54 www dovecot: lmtp(29940, josh(a)redacted.com) pxg7JxZufVL0dAAAPhZyyg: sieve: failed to compile script dict:proxy:/var/run/dovecot-auth.sock:sieve;name=main script (view user logfile /var/mail/vhosts/redacted.com/josh/.dovecot.sieve.log for more information) *.dovecot.sieve.log* sieve: info: started log at Nov 08 16:14:38. main script: line 1: error: unexpected character(s) starting with 0x01. main script: line 1: error: unexpected unknown characters found at (the presumed) end of file. main script: error: parse failed.

2 2

[Dovecot] dovecot + sieve redirect failed
by Tibor Korocz 22 Nov '13

22 Nov '13

Hi Guys, I have a strange problem and I couldn't find any solution, I hope somebody could help me. I'm using postfix+dovecot+sieve combination and I tried to set up redirect. .sieve: require ["fileinto", "regex", "date", "relational", "vacation"]; redirect "xxxx(a)gmail.com"; keep; But I get some error in the mail.log: sieve: msgid=<1562626302.336239.1385116787283>: failed to redirect message to <xxxxx(a)gmail.com> (refer to server log for more information) Nov 22 11:39:50 server dovecot: lda(xxx@xxxx): sieve: msgid=<1562626302.336239.1385116787283>: stored mail into mailbox 'INBOX' Nov 22 11:39:50 server dovecot: lda(xxx@xxxx): Error: sieve: execution of script /var/vmail/xxxx/.sieve failed, but implicit keep was successful (user logfile /var/vmail/xxxx/.sieve.log may reveal additional details) .sieve.log: error: msgid=<1562626302.336239.1385116787283>: failed to redirect message to <xxxx(a)gmail.com> (refer to server log for more information). I couldn't find any other details in the logs. Any idea what is the problem and what is the solution? Thanks, Tibi

2 1

[Dovecot] removing html via dovecot/sieve
by Bonz 22 Nov '13

22 Nov '13

is there a howto or similar for configuring dovecot as a user to strip mime. ideally i would like all html copies deleted, but graphics, etc dumped to ~/public_html and replaced with a url. i have a super crappy link so html, etc usually jams my spool. i can usually wget things however hence this desired approach. bonz.

2 1

[Dovecot] Personal Sieve Resieving Default Sieve?
by Jim McNamara 22 Nov '13

22 Nov '13

Hello all. In my dovecot install we have a default.sieve script which filters incoming mail based on the subdomain of our main domain. All it does is if the mail comes from A.domain.com move in to folder A in inbox, and if it comes from B.domain.com, move to folder B also in inbox. In my personal sieve script, I'd like to grab a particular email each day that the default.sieve saw coming from A.domain.com and moved it to folder A, and either copy or move it to another folder, C. My google-fu was weak while looking for second sieve passes undoing the first, so I thought it best to ask here. Thanks for your time.

2 1

[Dovecot] Pigeonhole make check fails with Dovecot 2.2.8
by Tamsy 22 Nov '13

22 Nov '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Is it just here? When compiling dovecot-2.2-pigeonhole-0.4.2 at the stage "make check" Pigeonhole is throwing the following message and stops: Test case: ./tests/test-header.svtest: 1: Test 'Basic functionality' SUCCEEDED 2: Test 'Matching empty key' SUCCEEDED 3: Test 'Ignoring whitespace' FAILED: header test does not strip leading whitespace 4: Test 'Absent or empty header' SUCCEEDED 5: Test 'Invalid header name' SUCCEEDED 6: Test 'Folded header' SUCCEEDED I have tried to compile Pigeonhole 0.4.2 and also the latest dovecot-2-2-pigeonhole-b7434a02fc51 from the Mercurial repository but the outcome at "make test" is always the same: 3: Test 'Ignoring whitespace' FAILED: header test does not strip leading whitespace Cheers, Tamsy -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQEcBAEBAgAGBQJSjC2QAAoJEKYXVM1dyOfZ9xsIAKDC7goLP3N2rr90Lf0P6gam wQFmYY3HUMIKi3FKWcCy6DQBN6Qr33QWTk/b4OY1LDMOETolZTWIEwvlix+YdI8x oRdKQXWHR9k+jd9etWkNuuk2xUnbjz353IOMZ3Yc+spuv0JyUvYhef6pfq3MLTYQ R+YW4aoNp3XstAKcknnkduNwrfRXoZoFT/YOU3VQyDUwUa6u07JhuL+onZtb0mO+ HsdD4NNY28YqHY1/eoT3YNRbgtRxyOfzxh3f17ITbquM0ZgiPJucWX7HpIiwNJFu 3gqkceDLqqAL9DKUjDapSyR2IjxJlRSGcxQckxlkGXzcaTNNWqAn7mMxSr3hEaY= =EY7D -----END PGP SIGNATURE-----

5 12

[Dovecot] (no subject)
by Axel Reinhold 22 Nov '13

22 Nov '13

Subject: dovecot-2.2.8 does no more quit correctly after update to dovecot-2.2.8 monit is no more validating pop3 server due to dovecot mo more logging out correctly "+OK Logging out" is missing With 2.2.7: [root@pie ~]# telnet glen 110 Trying 188.138.31.225... Connected to glen. Escape character is '^]'. +OK Dovecot ready. <1da9.1.528e3113.qpIWrdBNJbF3qp/tA9R+sQ==(a)glen.ypack.de> quit +OK Logging out Connection closed by foreign host. with 2.2.8: [root@pie ~]# telnet glen 110 Trying 188.138.31.225... Connected to glen. Escape character is '^]'. +OK Dovecot ready. <1fc9.1.528e31b1.W4FN6a7gzBMYNOBoxP43OQ==(a)glen.ypack.de> quit Connection closed by foreign host. After quit the "+OK Logging out" is missing! New option? Or bug? Regards Axel

2 1

[Dovecot] dovecot-2.2.7: Fatal: master: service(imap): child 49545 killed with signal 11 (core dumped)
by Marcin Mirosław 21 Nov '13

21 Nov '13

Hi! After upgrade I'm noticing many coredummps, below is backtrace: $ echo "bt"|gdb .... #0 o_stream_zlib_flush (stream=0xc8be5b27640) at ostream-zlib.c:222 222 if (o_stream_zlib_send_flush(zstream) < 0) (gdb) #0 o_stream_zlib_flush (stream=0xc8be5b27640) at ostream-zlib.c:222 #1 0x00007a695e8f09cd in o_stream_flush (stream=stream@entry=0xc8be5b276d0) at ostream.c:147 #2 0x00007a695e83c06f in o_stream_zlib_close (stream=0xc8be5b27640, close_parent=true) at ostream-zlib.c:35 #3 0x00007a695e8f0375 in o_stream_close_full (stream=stream@entry=0xc8be5b276d0, close_parents=close_parents@entry=true) at ostream.c:49 #4 0x00007a695e8f06e2 in o_stream_close (stream=stream@entry=0xc8be5b276d0) at ostream.c:85 #5 0x00007a695e8f1738 in o_stream_copy_error_from_parent (_stream=_stream@entry=0xc8be5b27640) at ostream.c:434 #6 0x00007a695e83c5cc in o_stream_zlib_flush (stream=0xc8be5b27640) at ostream-zlib.c:227 #7 0x00007a695e8f09cd in o_stream_flush (stream=stream@entry=0xc8be5b276d0) at ostream.c:147 #8 0x00007a695e83c06f in o_stream_zlib_close (stream=0xc8be5b27640, close_parent=true) at ostream-zlib.c:35 #9 0x00007a695e8f0375 in o_stream_close_full (stream=stream@entry=0xc8be5b276d0, close_parents=close_parents@entry=true) at ostream.c:49 #10 0x00007a695e8f06e2 in o_stream_close (stream=stream@entry=0xc8be5b276d0) at ostream.c:85 #11 0x00007a695e8f1738 in o_stream_copy_error_from_parent (_stream=_stream@entry=0xc8be5b27640) at ostream.c:434 #12 0x00007a695e83c5cc in o_stream_zlib_flush (stream=0xc8be5b27640) at ostream-zlib.c:227 #13 0x00007a695e8f09cd in o_stream_flush (stream=stream@entry=0xc8be5b276d0) at ostream.c:147 #14 0x00007a695e83c06f in o_stream_zlib_close (stream=0xc8be5b27640, close_parent=true) at ostream-zlib.c:35 #15 0x00007a695e8f0375 in o_stream_close_full (stream=stream@entry=0xc8be5b276d0, close_parents=close_parents@entry=true) at ostream.c:49 #16 0x00007a695e8f06e2 in o_stream_close (stream=stream@entry=0xc8be5b276d0) at ostream.c:85 #17 0x00007a695e8f1738 in o_stream_copy_error_from_parent (_stream=_stream@entry=0xc8be5b27640) at ostream.c:434 #18 0x00007a695e83c5cc in o_stream_zlib_flush (stream=0xc8be5b27640) at ostream-zlib.c:227 #19 0x00007a695e8f09cd in o_stream_flush (stream=stream@entry=0xc8be5b276d0) at ostream.c:147 #20 0x00007a695e83c06f in o_stream_zlib_close (stream=0xc8be5b27640, close_parent=true) at ostream-zlib.c:35 #21 0x00007a695e8f0375 in o_stream_close_full (stream=stream@entry=0xc8be5b276d0, close_parents=close_parents@entry=true) at ostream.c:49 #22 0x00007a695e8f06e2 in o_stream_close (stream=stream@entry=0xc8be5b276d0) at ostream.c:85 #23 0x00007a695e8f1738 in o_stream_copy_error_from_parent (_stream=_stream@entry=0xc8be5b27640) at ostream.c:434 #24 0x00007a695e83c5cc in o_stream_zlib_flush (stream=0xc8be5b27640) at ostream-zlib.c:227 #25 0x00007a695e8f09cd in o_stream_flush (stream=stream@entry=0xc8be5b276d0) at ostream.c:147 #26 0x00007a695e83c06f in o_stream_zlib_close (stream=0xc8be5b27640, close_parent=true) at ostream-zlib.c:35 [...] #285878 0x00007a695e8f0adc in o_stream_default_cork (_stream=0xc8be5b27640, set=<optimized out>) at ostream.c:419 #285879 o_stream_default_cork (_stream=0xc8be5b27640, set=<optimized out>) at ostream.c:412 #285880 0x00000c8be506b72d in client_input (client=0xc8be5b07b00) at imap-client.c:945 #285881 0x00007a695e8e4867 in io_loop_call_io (io=0xc8be5b8f370) at ioloop.c:387 #285882 0x00007a695e8e5d1f in io_loop_handler_run (ioloop=ioloop@entry=0xc8be5ab50f0) at ioloop-epoll.c:220 #285883 0x00007a695e8e4178 in io_loop_run (ioloop=0xc8be5ab50f0) at ioloop.c:411 #285884 0x00007a695e87a847 in master_service_run (service=0xc8be5ab4f80, callback=callback@entry=0xc8be5077f20 <client_connected>) at master-service.c:566 #285885 0x00000c8be50785d4 in main (argc=1, argv=0xc8be5ab4d50) at main.c:400 And gdb is killing by OOM. I suspect this can be related to imapc. Regards, Marcin

1 2

[Dovecot] dsync-2.2.7 incorrectly synchronizes subscription status of renamed mailbox
by Karol Jurak 21 Nov '13

21 Nov '13

Hi, It seems that dsync-2.2.7 doesn't correctly synchronize subscription status of a renamed mailbox. The situation is as follows. There are two servers: A and B, and a test user test_mdbox. Mailboxes (mdbox) of this user on both servers are synchronized. Specifically on both of them there is a (subscribed) Test1 mailbox. Replication plugin is disabled. I rename Test1 to Test2 on A with Thunderbird. The output of 'doveadm mailbox list', contents of subscriptions file and the output of 'doveadm dump -t mailboxlog dovecot.mailbox.log' (below) confirm that the rename succeeded on A. #2976: rename 2b84f621c0fd4ba8bd514c5c43ab9a89 (2013-11-19 14:30:35) #3000: subscribe 2b84f621c0fd4ba8bd514c5c43ab9a89 (2013-11-19 14:30:35) #3024: unsubscribe 99ea7bf70f6e69ad71659995677b43f8 (2013-11-19 14:30:35) Subsequently I run 'doveadm sync -u test_mdbox remote:B'. Nothing changes on A. On B 'doveadm mailbox list' shows that Test1 was renamed to Test2, but subscriptions file still contains Test1 and not Test2. The output of 'doveadm dump -t mailboxlog dovecot.mailbox.log' confirms that only rename was performed: #2160: rename 2b84f621c0fd4ba8bd514c5c43ab9a89 (2013-11-19 14:57:22) Only another 'doveadm sync -u test_mdbox remote:B' fixes subscriptions on B. The following records are added to dovecot.mailbox.log: #2184: unsubscribe 99ea7bf70f6e69ad71659995677b43f8 (2013-11-19 15:00:32) #2208: subscribe 2b84f621c0fd4ba8bd514c5c43ab9a89 (2013-11-19 15:00:32) -- Karol Jurak

2 2

[Dovecot] Enable Rawlog from userdb in Dovecot v2.2
by Steffen Kaiser 21 Nov '13

21 Nov '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, how do I enable Rawlog for one person only? http://wiki2.dovecot.org/Debugging/Rawlog describes how to enable the postlogin script for all users. Rawlog gets active only, if the dovecot.rawlog directory exists. So far, it's working. However. I suspect that there is some notable overhead in this chain, so I tried to enable rawlog via userdb extra fields. So setup the config as: service imap { executable = imap } service postlogin { executable = script-login -d rawlog unix_listener postlogin { } } In the userdb extra fields I tried: service/imap/executable=imap postlogin Log entry: imap: Debug: Unknown userdb setting: plugin/service/imap/executable=imap postlogin and: service imap/executable=imap postlogin (note the space between service imap) Log entry: imap: Debug: Unknown userdb setting: plugin/service imap/executable=imap postlogin - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUoDzAV3r2wJMiz2NAQJxgwf+NCaABKspwVffTpQqVIAdlXGi2gUrRd29 1Ic82v5xqx8jMQ+UxnKNJBX2jgs87GITWpPtTXUVS8H6piNDJrcAxT0lIun0l4Ob 4riQh01HrMjwWORAAWvHHQWZbyiDu8i2h8PjQAG/8idpCt0lCmmr2DyRQwSx+7lf JgfxfccYMRhAHtethm82cjWs3Q/M9deO+ds+aLwxGhDaYxHcU8vD3ESuhqnsR4Bh VqemH3wBADpfKH3ThRKknsfGfEU5d8bcz1GzhOcjfwC24kPsei4k9wcDAy+moyk1 8vPYyvWnhhfb0/yiO3eLpX0mdlM9Iur1X3MFvA0tFwnB8RtuqZGw3g== =/TtK -----END PGP SIGNATURE-----

2 2

Re: [Dovecot] Problems with dovecot 2.1.7, spamassassin 3.3.2 and antispam plugin
by Joseph Tam 21 Nov '13

21 Nov '13

> LD_PRELOAD=/lib/x86_64-linux-gnu/libgcc_s.so.1 /usr/bin/sa-learn -D > --progress $* /tmp/sendmail-msg-$$.txt >> /tmp/sa-learn-pipe.$$.log 2>&1 > > So far to no avail. I'm going to try the spool2dir backend with > incron. Cumbersome, but it should work ... Maybe try rebuilding whatever is using libgcc_s.so with GCC compiler option -static-libgcc? Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] Reset vacation lda-dupes database
by Mike Selner ＠ Yahoo 20 Nov '13

20 Nov '13

Hello, I have dovecot 2.2.6 and pignenhole 0.4.2 running on freebsd9.1. We have a mix of unix users (/home/user) and postfixadmin users (/home/vmail/domain/user). I am using dovecot managesive with afterlogic webmail which has a managesieve plugin to set the out of office message. All works fine. I have sieve_vacation_default_period set to 1d. The problem I'm trying to solve is that users set their vacation message and want to test it. So they have their colleagues send them multiple test messages and want to make sure it works. Of course only the first message gets an auto-reply. I tell them that the auto responder only sends one message per day per sender but they would like to test it with a new message etc. So I have to remove their .lda-dupes file manually so they can try again. My previous autoresponder setup (squirrelmail) used a .forward technique and removed the vacation database when they turned the responder from off to on, and this worked well for the above issue. Is there a solution for dovecot managesieve which will remove or reset the .lda-dupes file whenever a new sieve file is uploaded? Or another solution that will reset the "vacation timer" when the user turns vacation from off to on? Thank you Mike

3 4

[Dovecot] Drac for dovecot 2.2
by Anton Lundin 20 Nov '13

20 Nov '13

Hi folks. I thought that i should publish and announce that i ported the dovecot2-drac plugin to be usable with dovecot 2.2 and Debian patched drac for IPv6. The patches can be found at: https://github.com/glance-/dovecot2-drac //Anton -- Anton Lundin

1 0

[Dovecot] status=undeliverable (lost connection with mail.larptreff.de[private/dovecot-lmtp] while sending MAIL FROM)
by Jan Phillip Greimann 20 Nov '13

20 Nov '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Good morning dovecot-community, I noticed a strange log-entry since the last day: Nov 7 08:34:42 hetzner postfix/lmtp[3764]: 61CB01A3938: to=<jg+introversion(a)larptreff.de>, relay=mail.larptreff.de[private/dovecot-lmtp], delay=0.05, delays=0.01/0.01/0.02/0.01, dsn=4.4.2, status=undeliverable (lost connection with mail.larptreff.de[private/dovecot-lmtp] while sending MAIL FROM) Thankfully I've configured a cronjob for a daily pflogsumm-report, but I don't understand this. It worked for months like a charm. It seems this only happens on mails with "+"-Delimiter. In my opinion there is only one thing which could cause this problem: I updated my dovecot on 2013/11/04 from 2.2.6-1~auto+36 to 2.2.7-1~auto+2 maillog: http://pastebin.com/WDGfEjdp doveconf -n: http://pastebin.com/ay6dxiUf I will try to downgrade again, did someone have a clue? Changelog from 2.2.7 didn't show changes on lmtp. Best regards, Jan -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBAgAGBQJSe0cCAAoJENEKhqzzuxPlLOsH/iQLHuYXH/8HQJI1cyOQ/Xkl KK010kT9EwOZCax+xputF1Cyg9XSCGBwMBA8YFWjTk57EVfNZ4RZLCkpZQU8b0X/ SsDq7jyh8QTBf7K2LEs34L6g2OMbuhv3Hl+D/RqBm09HPoBUGJZEM5ZQu28QE7rD GETa3XkQPwMyo+3GwWXmAzg3wz4tOEGg6meaOzQlGVJshQpSKbDjvln5RtsVc1Qh X9Xa4HdEesH/NXxr6uKUUEjHcp67BLWvmZHrDDIOp4dATqxDbq29QGfiJFvURKur DJZ2hbPPgEFf/Wdf5l3PXfV2OgnubyLiTgRZ7pb+xFNUAlJ2YCeRv5CUigLaps8= =0Jya -----END PGP SIGNATURE-----

7 24