- dovecot - dovecot.org

[Dovecot] Cleanups in HG f11ae64365b5 break Authentication
by Thomas Leuxner 31 Jan '13

31 Jan '13

==> /var/log/dovecot/dovecot.log <== Jan 30 19:57:51 spectre dovecot: master: Warning: SIGHUP received - reloading configuration Jan 30 19:58:48 spectre dovecot: imap-login: Login: user=<tlx(a)leuxner.net>, method=PLAIN, rip=1.2.3.4, lip=5.6.7.8, mpid=15572, TLS, session=<o4WxGYbUsQBeT5Qc> Jan 30 19:58:48 spectre dovecot: imap(tlx(a)leuxner.netuid=5000): Error: user tlx(a)leuxner.netuid=5000: Couldn't drop privileges: User is missing UID (see mail_uid setting) Jan 30 19:58:48 spectre dovecot: imap(tlx(a)leuxner.netuid=5000): Error: Internal error occurred. Refer to server log for more information.

2 2

[Dovecot] v2.1.14 released
by Timo Sirainen 30 Jan '13

30 Jan '13

http://dovecot.org/releases/2.1/dovecot-2.1.14.tar.gz http://dovecot.org/releases/2.1/dovecot-2.1.14.tar.gz.sig If you've been waiting for a fully stable release after the recent cache file troubles in v2.1.11+, this release should be the one. Hopefully there won't be v2.1.15 anytime in near future. (v2.2.rc1 does look close though.) BTW. I know there are quite a lot of mails I haven't replied to in dovecot list. Too busy for now.. + doveadm acl recalc command added - v2.1.11+ had a race condition where it sometimes overwrote data in dovecot.index.cache file. This could have caused Dovecot to return the same cached data to two different messages. - mdbox: Fixes to handling duplicate GUIDs during index rebuild

1 0

[Dovecot] decode2text.sh
by bhs692-dove＠yahoo.com 30 Jan '13

30 Jan '13

Dovecot version: 2.1.13 OS: Centos 6.3 CPU: 64bit x86 There appear to be two related errors in the decode2text.sh file (which can be used for indexing/ searching attachments). - The layout of "$formats" has repeated values for pdf, ppt, etc, so you should only match the pattern once by adding -m1 - The layout of "$formats" has the file extension in the second "column", so the "start of line"(^) match doesn't work as is. Original problem line (from ./src/plugins/fts/decode2texh.sh): fmt=`echo "$formats" | grep -w "^$content_type" | cut -d ' ' -f 2` Here are two options that appear to solve the problem. The first option is probably preferred, since it matches exactly the extension to the second "column". 1) switch the order of commands (cut & grep) and add -m1. for example: fmt=`echo "$formats" | cut -d ' ' -f 2 | grep -w -m1 "^$content_type"` -OR- 2) add "m1" and remove "^". for example: fmt=`echo "$formats" | grep -w -m1 "$content_type" | cut -d ' ' -f 2`

2 1

[Dovecot] passdb to add extra fields?
by Timo Sirainen 30 Jan '13

30 Jan '13

Some passdbs like PAM can't really return any extra fields. Also some people have wanted to combine users' data from different passdb/userdbs so that for example you'd have userdb passwd give the uid/gid/home, but then you'd also have some other userdb give quota limits. So I was thinking something like this: passdb { driver = pam } passdb { driver = sql include = yes } or: userdb { driver = passwd } userdb { driver = passwd-file include = yes } I'm not sure about two things: 1) Should there be a way to replace all of the existing fields instead of just adding new ones? 2) Any thoughts of a better name than "include"? With passdb it would mean that it's included only when the authentication failed for some other passdb. With userdb it means it's included only if a previous userdb lookup succeeded. Also there are already "deny" and "pass" settings. Interaction with them can be somewhat confusing.. Maybe all of these should be replaced with: type=deny: Same as old deny=yes (deny auth if user is in list) type=precondition(?): Same as pass=yes (require another passdb to match) type=postcondition(?): Require user to exist in this passdb/userdb as well, adding any extra fields in it. type=add: Add any extra fields, if the user exists at all. (Better ideas for the names here? Is even "type" a good name?) Then maybe a new setting to delete existing extra fields .. or perhaps just extend passdb { override_fields } so that having "-field" would delete the field if it already existed..

3 6

[Dovecot] A lot of dovecot/imap processes
by Juan Cifo Servera 30 Jan '13

30 Jan '13

Hello! I have a dovecot installed and many users could login via IMAP over SSL (40 users at same time aprox). Users could have "Check mail every X time" enabled in their client (Thunderbird or K-9 mail) - Is this required feature? I noted that if I disable it I still getting news mails without having to check for new mails manually - . I noted that dovecot is creating a lot of process (dovecot/imap and dovecot/imap-login) and is requiring more and more RAM. I think that every login starts a process but never is endend. The output of /*ps aux | grep dovecot | wc*/ is increasing until 250 lines aprox. I think that is limited by process_limit = 256. But if I put process_limit = 100, in the log appers a message that dovecot is aborting logins (and I noted that new connections sometimes couldn't login). Anyway the mailserver is working well, but I'm afraid of the consumtion of RAM. Is that normal? Details: # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-36-generic-pae i686 Ubuntu 12.04.1 LTS nfs auth_mechanisms = plain login dotlock_use_excl = no log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = always mail_location = maildir:/mnt/vmail/%d/%n/Maildir mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vacation-seconds mmap_disable = yes namespace { inbox = yes location = prefix = separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { autocreate = Trash autocreate2 = Sent autocreate3 = Drafts autosubscribe = Trash autosubscribe2 = Sent autosubscribe3 = Drafts sieve = /mnt/vmail/%d/%n/Maildir/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +vacation-seconds sieve_global_dir = /etc/dovecot/sieve_global_dir sieve_global_path = /etc/dovecot/default.sieve sieve_vacation_default_period = 2s sieve_vacation_max_period = 3s sieve_vacation_min_period = 1s } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } user = root } service imap-login { inet_listener imap { port = 0 } process_limit = 256 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 10 } service pop3-login { process_limit = 256 } ssl = required ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } userdb { args = uid=5000 gid=5000 home=/mnt/vmail/%d/%n allow_all_users=yes driver = static } protocol imap { imap_capability = IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDP LUS LIST-EXTENDED I18NLEVEL=1 ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS mail_plugins = autocreate } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master log_path = /var/log/dovecot-deliver.log mail_plugins = " sieve" postmaster_address = ###(a)###.### } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " sieve" } Thank-you very much.

3 2

[Dovecot] Storage plugin documentation
by James Devine 30 Jan '13

30 Jan '13

Is there any documentation anywhere on creating a new storage plugin besides looking through the existing storage code? It's a pretty extensive task and any documentation would help. Thanks

2 1

[Dovecot] help with public namespace/mailbox
by michael＠los-pollos.co 30 Jan '13

30 Jan '13

Dear all, I am hoping someone can help me with a problem that I have been trying to fix for days. Using postfix and dovecot 2.0.19 on Ubuntu 12.04 with LDAP authentication and virtual users and domains. Basically I want to setup both shared and public mailboxes. The shared part is working fine, ie I can share folders successfully and other uses can see them. However when I try and create sub folders in the public folder they don't show up in the client. I have tried creating them in manually in the filesystem ie mkdir .folder and also via thunderbird. I have read through the dovecot wiki's several times over and still cannot see why it won't work. I have debug turned on and these are the log messages I get in syslog when I start up thunderbird: acl: No lookup right to mailbox: public/folder acl vfile: file /home/example.com/public/.folder/dovecot-acl not found acl vfile: file /home/example.com/public/dovecot-acl not found So I create the dovecot-acl file manually in public and set the right file system permissions and the errors go away, yet the folder still doesn't get created despite the following getting logged in syslog. Jan 29 23:43:57 alpha dovecot: imap(testuser(a)example.com): Debug: Namespace public/: /home/example.com/public/.folder2 doesn't exist yet, using default permissions Jan 29 23:43:57 alpha dovecot: imap(testuser(a)example.com): Debug: Namespace public/: Using permissions from /home/example.com/public: mode=0777 gid=-1 Right now I am thinking the problem might be that I am trying to setup both shared and public namespaces within the same configuration and therefore dovecot is looking for acl's for the public when it shouldn't be? Feel like I am stabbing in the dark with this though. Any help anyone can offer will be greatly appreciated! Thanks in advance. Regards, Michael. Here is my dovecot.conf # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab072.10 i686 Ubuntu 12.04.1 LTS auth_debug_passwords = yes auth_socket_path = /var/run/dovecot/auth-master auth_verbose = yes disable_plaintext_auth = no lda_mailbox_autocreate = yes log_timestamp = "%Y-%m-%d %H:%M:%S " mail_debug = yes mail_gid = vmail mail_location = maildir:~/Maildir mail_plugins = quota acl mail_privileged_group = mail mail_uid = vmail namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = no inbox = no list = yes location = maildir:/home/%%d/%%n/Maildir:INDEX=/home/%d/%n/Maildir/Shared/%%n prefix = Shared/%%n/ separator = / subscriptions = no type = shared } namespace { hidden = no list = yes location = maildir:/home/%d/public prefix = public/ separator = / subscriptions = no type = public } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { driver = pam } plugin { acl = vfile acl_anyone = allow acl_shared_dict = file:/home/%d/shared-mailboxes.db quota = maildir quota_rule = *:storage=25GB quota_rule2 = Trash:storage=+10%% quota_warning = storage=95%% /usr/local/bin/quota-warning.sh 95 } postmaster_address = postmaster(a)example.com protocols = imap pop3 quota_full_tempfail = yes sendmail_path = /usr/lib/sendmail service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } user = root } service imap-login { chroot = login executable = /usr/lib/dovecot/imap-login inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 ssl = yes } user = dovecot } service imap { executable = /usr/lib/dovecot/imap } service pop3-login { chroot = login inet_listener pop3 { address = * port = 110 } inet_listener pop3s { address = * port = 995 ssl = yes } user = dovecot } ssl_cert = </etc/ssl/certs/alpha.example.com.crt ssl_key = </etc/ssl/private/alpha.example.com.key userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } userdb { driver = passwd } protocol imap { mail_plugins = quota imap_quota acl imap_acl } protocol pop3 { mail_plugins = quota pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master mail_plugins = quota postmaster_address = postmaster(a)example.com sendmail_path = /usr/lib/sendmail }

3 2

[Dovecot] Duplicate supression mechanism
by 3.listas＠adminlinux.com.br 30 Jan '13

30 Jan '13

Hello, In a Dovecot 2.0.6 server I have an account x@domain and an alias y@domain -> x@domain. When I send an email to x@domain with carbon copy to y@domain, X receives two messages on mailbox. Dovecot2 has any feature of duplicate suppression ? Thanks -- Thiago Henrique adminlinux.com.br

5 7

[Dovecot] dovecot.index is missing
by Alexandr Sabitov 30 Jan '13

30 Jan '13

Dear All, I have noticed that dovecot.index is not generated straight away if you have just a few emails in the mailbox. Instead of that dovecot.index.log is modified and accessed by clients. Only if the number of email reaches some level then it creates dovecot.index in user mailboxes. Can somebody please tell me when (in my understanding of the process) the index log file drops all data into the mail index file. What does trigger that ? Sorry I couldn't find any info on that in the wiki. Best Regards, Alexandr Sabitov

3 3

[Dovecot] doveadm migration: Warning: I/O leak
by Gedalya 29 Jan '13

29 Jan '13

This seems to be happening only when using the pop3c plugin. Any advice? root@imap01:/etc/dovecot# doveadm -D -o imapc_user=chat_logs(a)xxxxxx.com -o 'imapc_password=*******' -o pop3c_user=chat_logs(a)xxxxxx.com -o 'pop3c_password=*****' backup -u chat_logs(a)xxxxxx.com -R imapc: doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_expire_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_listescape_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so doveadm(root): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(chat_logs(a)xxxxxx.com): Debug: Added userdb setting: mail=maildir:/stor/real/domains/xxxxxx.com/ch/chat_logs/Maildir doveadm(chat_logs(a)xxxxxx.com): Debug: Added userdb setting: plugin/quota_rule=*:storage=5120M doveadm(chat_logs(a)xxxxxx.com): Debug: Effective uid=1001, gid=1001, home=/stor/real/domains/xxxxxx.com/ch/chat_logs doveadm(chat_logs(a)xxxxxx.com): Debug: Home dir not found: /stor/real/domains/xxxxxx.com/ch/chat_logs doveadm(chat_logs(a)xxxxxx.com): Debug: Namespace : type=private, prefix=POP3-MIGRATION-NS/, sep=, inbox=no, hidden=yes, list=no, subscriptions=yes location=pop3c: doveadm(chat_logs(a)xxxxxx.com): Debug: fs: root=, index=, control=, inbox=, alt= doveadm(chat_logs(a)xxxxxx.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/stor/real/domains/xxxxxx.com/ch/chat_logs/Maildir doveadm(chat_logs(a)xxxxxx.com): Debug: maildir++: root=/stor/real/domains/xxxxxx.com/ch/chat_logs/Maildir, index=, control=, inbox=/stor/real/domains/xxxxxx.com/ch/chat_logs/Maildir, alt= doveadm(chat_logs(a)xxxxxx.com): Debug: Namespace : /stor/real/domains/xxxxxx.com/ch/chat_logs/Maildir doesn't exist yet, using default permissions doveadm(chat_logs(a)xxxxxx.com): Debug: Namespace : Using permissions from /stor/real/domains/xxxxxx.com/ch/chat_logs/Maildir: mode=0700 gid=-1 dsync(chat_logs(a)xxxxxx.com): Debug: Effective uid=1001, gid=1001, home=/stor/real/domains/xxxxxx.com/ch/chat_logs dsync(chat_logs(a)xxxxxx.com): Debug: Namespace : type=private, prefix=POP3-MIGRATION-NS/, sep=, inbox=no, hidden=yes, list=no, subscriptions=yes location=pop3c: dsync(chat_logs(a)xxxxxx.com): Debug: fs: root=, index=, control=, inbox=, alt= dsync(chat_logs(a)xxxxxx.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc: dsync(chat_logs(a)xxxxxx.com): Debug: imapc: root=, index=, control=, inbox=, alt= dsync(chat_logs(a)xxxxxx.com): Debug: imapc(mail01.xxxxxx.com:143): Looking up IP address dsync(chat_logs(a)xxxxxx.com): Debug: imapc(mail01.xxxxxx.com:143): Connecting to 111.111.111.111:143 dsync(chat_logs(a)xxxxxx.com): Debug: imapc(mail01.xxxxxx.com:143): Server capabilities: IMAP4rev1 NAMESPACE LITERAL+ UIDPLUS IDLE COMPARATOR AUTH=LOGIN AUTH=NTLM AUTH=SCRAM-MD5 AUTH=CRAM-MD5 dsync(chat_logs(a)xxxxxx.com): Debug: imapc(mail01.xxxxxx.com:143): Authenticating as chat_logs(a)xxxxxx.com dsync(chat_logs(a)xxxxxx.com): Debug: imapc(mail01.xxxxxx.com:143): Authenticated successfully dsync(chat_logs(a)xxxxxx.com): Debug: Namespace : /stor/real/domains/xxxxxx.com/ch/chat_logs/Maildir/.Sent Items doesn't exist yet, using default permissions dsync(chat_logs(a)xxxxxx.com): Debug: Namespace : Using permissions from /stor/real/domains/xxxxxx.com/ch/chat_logs/Maildir: mode=0700 gid=-1 dsync(chat_logs(a)xxxxxx.com): Info: Sent Items: only in source (guid=34b8141947b9372e94589bd35a54dac5) dsync(chat_logs(a)xxxxxx.com): Info: INBOX: only in source (guid=c92f64f79f0d1ed01e6d5b314f04886c) dsync(chat_logs(a)xxxxxx.com): Debug: imapc(mail01.xxxxxx.com:143): Looking up IP address dsync(chat_logs(a)xxxxxx.com): Debug: imapc(mail01.xxxxxx.com:143): Connecting to 111.111.111.111:143 dsync(chat_logs(a)xxxxxx.com): Debug: imapc(mail01.xxxxxx.com:143): Server capabilities: IMAP4rev1 NAMESPACE LITERAL+ UIDPLUS IDLE COMPARATOR AUTH=LOGIN AUTH=NTLM AUTH=SCRAM-MD5 AUTH=CRAM-MD5 dsync(chat_logs(a)xxxxxx.com): Debug: imapc(mail01.xxxxxx.com:143): Authenticating as chat_logs(a)xxxxxx.com dsync(chat_logs(a)xxxxxx.com): Debug: imapc(mail01.xxxxxx.com:143): Authenticated successfully dsync(chat_logs(a)xxxxxx.com): Debug: pop3c(111.111.111.111): Looking up IP address dsync(chat_logs(a)xxxxxx.com): Debug: pop3c(111.111.111.111): Connecting to 111.111.111.111:110 dsync(chat_logs(a)xxxxxx.com): Debug: pop3c(111.111.111.111): Authenticating as chat_logs(a)xxxxxx.com dsync(chat_logs(a)xxxxxx.com): Warning: I/O leak: 0xb769a340 (line 1229, fd 14) dsync(chat_logs(a)xxxxxx.com): Warning: I/O leak: 0xb769a340 (line 1229, fd 10) dsync(chat_logs(a)xxxxxx.com): Warning: Timeout leak: 0xb769a5a0 (line 1316) dsync(chat_logs(a)xxxxxx.com): Warning: Timeout leak: 0xb769a5a0 (line 1316)

1 2