August 2011 - dovecot

[Dovecot] Parallel auth
by Bernhard Schmidt 15 Aug '11

15 Aug '11

Hello, we run a Dovecot 2.0.13 instance purely as SASL backend for Postfix, authenticating against a local passwd-file and our central LDAP database. # dovecot -n # 2.0.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32.36-0.5-default x86_64 SUSE Linux Enterprise Server 11 # (x86_64) auth_mechanisms = plain login auth_verbose = yes passdb { args = /etc/dovecot/dovecot-passwd driver = passwd-file } passdb { args = /etc/dovecot/dovecot-ldap-simauth.conf.ext driver = ldap } protocols = none service auth { unix_listener /var/spool/postfix-postout/private/auth { group = postfix mode = 0660 user = postfix } } ssl = no There is only a single user in the passwd-file for monitoring. We monitor authentication delays for both this local user and one user from LDAP. Due to a firmware bug, our six-figures NAS causes extremely high LDAP delays (in the range of 20-60 seconds, instead of the usual 50ms) once an hour. The weird thing is, I also see these delays in the graph for the local user. Which got me thinking * are authentication requests handled serially by dovecot/auth? * any way to solve this situation for the local user (not to be blocked by the delayed LDAP query)? * any way to solve this situation for LDAP users? We could possibly do some loadbalancing if the auth-daemon opened several LDAP connections Thanks, Bernhard

2 1

[Dovecot] migration from courier to dovecot
by Michael 15 Aug '11

15 Aug '11

hi all I have a problem with the conversion of files containing UIDL Courier to dovecot uidl , dovecot version is 1.2.15 , format in dovecot is pop3_uidl_format = %08Xu%08Xv i try any other from available list without success courierpop3dsizelist format /2 920 1290084761 1296206202.H818256P31717.domain.tld,S=57135:2,S 57679 87:1290084761 1296239411.H289216P22896.domain.tld,S=1660:2,S 1694 88:1290084761 1296480156.H578502P4335.domain.tld,S=26610:2,S 26995 89:1290084761 1296552510.H517452P28309.domain.tld,S=2894:2,S 2980 90:1290084761 1296740128.H139710P22101.domain.tld,S=4983:2,S 5121 91:1290084761 1296807457.H887067P13955.domain.tld,S=7841:2,S 8038 92:1290084761 1296807652.H904999P14102.domain.tld,S=114839:2,S 116421 93:1290084761 courierimapuiddb 1 1290084574 847 53 1296206202.H818256P31717.domain.tld,S=57135 54 1296239411.H289216P22896.domain.tld,S=1660 55 1296480156.H578502P4335.domain.tld,S=26610 56 1296552510.H517452P28309.domain.tld,S=2894 57 1296740128.H139710P22101.domain.tld,S=4983 58 1296807457.H887067P13955.domain.tld,S=7841 59 1296807652.H904999P14102.domain.tld,S=114839 and after using a script to convert from http://www.dovecot.org/tools/courier-dovecot-migrate.pl got this file dovecot-uidlist 3 V1290084574 N862 53 PUID87-1290084761 W57679 :1296206202.H818256P31717.domain.tld,S=57135:2,S 54 PUID88-1290084761 W1694 :1296239411.H289216P22896.domain.tld,S=1660:2,S 55 PUID89-1290084761 W26995 :1296480156.H578502P4335.domain.tld,S=26610:2,S 56 PUID90-1290084761 W2980 :1296552510.H517452P28309.domain.tld,S=2894:2,S 57 PUID91-1290084761 W5121 :1296740128.H139710P22101.domain.tld,S=4983:2,S 58 PUID92-1290084761 W8038 :1296807457.H887067P13955.domain.tld,S=7841:2,S 59 PUID93-1290084761W116421:1296807652.H904999P14102.domain.tld,S=114839:2,S Unfortunately, messages are downloaded to the client again and with over 300 account its problematic if someone would be willing and able to help I will be grateful , i don't have any idea what next can do with it ;( if any other information would be helpful please let me know

2 5

[Dovecot] How to "scramble" emails
by Vincent Richomme 15 Aug '11

15 Aug '11

Hi, I am working on a webmail project using dovecot as imap server and I would need to make a demo however I don't want to show all my emails addresses. So my question is knowing that I am using the maildir format, would it ne possible to do a kind of search and replace of all emails/cc/to and replace them by fake ones or will it break something like indexes ? Thanks

2 1

[Dovecot] dovecot crashes after reloading service
by Alan Morais 15 Aug '11

15 Aug '11

Hello, I just made a fresh install of dovecot using Iredmail, and works just fine, but, after changing a parameter on /etc/dovecot.conf, and reloading service, the daemon crashes, with the message as follows: * restarting the service instead of reload works fine. ############# Error message dovecot: Panic: file dict-process.c: line 154 (dict_listener_input): assertion failed: (listener->process es == NULL) Jul 22 10:50:52 dovecot: Error: Raw backtrace: /usr/sbin/dovecot [0x805adb0] -> /usr/sbin/dovecot [0x805ae93] -> /usr/sbi n/dovecot [0x80529c6] -> /usr/sbin/dovecot [0x805a65c] -> /usr/sbin/dovecot [0x804cd60] -> /usr/sbin/dovecot [0x805ece0] -> /usr/sbin/dovecot [0x805ddc8] -> /usr/sbin/dovecot [0x805337d] -> /lib/i686/nosegneg/libc.so.6(__libc_start_main+0xdc) [0x6cce9c] -> /usr/sbin/dovecot [0x804a571] ############## Commands executed included parameter "login_greeting =xxxxxxxxxxxxxx" on dovecot.conf /etc/init.d/dovecot reload ##################### config [root@correio221 ~]# dovecot -n # 1.2.16: /etc/dovecot.conf # OS: Linux 2.6.18-128.el5xen i686 CentOS release 5.3 (Final) nfs log_path: /var/log/dovecot.log protocols: pop3 pop3s imap imaps managesieve listen(default): * listen(imap): * listen(pop3): * listen(managesieve): *:2000 ssl_ca_file: /etc/pki/tls/certs/iRedMail_CA.pem ssl_cert_file: /etc/pki/tls/certs/iRedMail_CA.pem ssl_key_file: /etc/pki/tls/private/iRedMail.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login login_greeting: SIANET POP/IMAP login_process_size: 512 login_processes_count: 128 login_max_processes_count: 256 login_max_connections: 1024 max_mail_processes: 256 first_valid_uid: 5000 last_valid_uid: 5000 mail_uid: 5000 mail_gid: 5000 mail_location: maildir:/home/vmail/%d/%Ln/Maildir mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_process_size: 512 mail_plugins(default): quota imap_quota autocreate mail_plugins(imap): quota imap_quota autocreate mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/managesieve imap_client_workarounds(default): tb-extra-mailbox-sep imap_client_workarounds(imap): tb-extra-mailbox-sep imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes lda: postmaster_address: root auth_socket_path: /var/run/dovecot/auth-master mail_plugins: quota sieve autocreate sieve_global_path: /home/vmail/sieve/dovecot.sieve log_path: /var/log/sieve.log auth default: mechanisms: plain login default_realm: sianet.com.br user: vmail verbose: yes passdb: driver: sql args: /etc/dovecot-mysql.conf userdb: driver: sql args: /etc/dovecot-mysql.conf socket: type: listen client: path: /var/spool/postfix/dovecot-auth mode: 438 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 438 user: vmail group: vmail plugin: quota_warning: storage=85%% /usr/local/bin/dovecot-quota-warning.sh 85 quota_warning2: storage=90%% /usr/local/bin/dovecot-quota-warning.sh 90 quota_warning3: storage=95%% /usr/local/bin/dovecot-quota-warning.sh 95 quota: maildir quota: dict:user::proxy::quotadict quota_rule: *:storage=0 expire: Trash 7 Trash/* 7 Junk 30 expire_dict: proxy::expire auth_socket_path: /var/run/dovecot/auth-master sieve_global_dir: /home/vmail/ sieve_before: %Lh/dovecot.sieve.before sieve: /%Lh/dovecot.sieve sieve_global_path: /home/vmail/dovecot.sieve global_script_path: /home/vmail/dovecot.sieve autocreate: INBOX autocreate2: INBOX.Sent autocreate3: INBOX.Trash autocreate4: INBOX.Drafts autocreate5: INBOX.Junk autosubscribe: INBOX autosubscribe2: INBOX.Sent autosubscribe3: INBOX.Trash autosubscribe4: INBOX.Drafts autosubscribe5: INBOX.Junk dict: expire: db:/var/lib/dovecot/expire/expire.db quotadict: mysql:/etc/dovecot-used-quota.conf Thanks in advance. -- Alan Morais Analista de Suporte Fone: (11) 2125-9222 E-mail: alan.morais(a)sianet.com.br [1] Links: ------ [1] http://www.sianet.com.br

2 1

[Dovecot] mbox issue - dovecot 2.0.13
by John Alexander 15 Aug '11

15 Aug '11

I'm running into the following issue when trying to delete a folder: Aug 2 00:41:46 keg dovecot: imap(user): Error: stat(/home/user/mail/Trash/.imap/MoreTest) failed: Not a directory Dovecot is creating directories correctly /home/user/mail/.imap/Trash directory exists. /home/user/mail/.imap/MoreTest directory exists /home/user/mail/Trash file exists /home/user/mail/MoreTest file exists Config is: mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u Where is this getting munged, please. Thanks much John

2 1

[Dovecot] $IP not getting set?
by A.L. 15 Aug '11

15 Aug '11

Using dovecot 2.0.13. I went to implement relay-ctrl per directions on the Wiki, and failed. After running it down, as best as I can determine, the problem is that the $IP variable is not getting set (and thus not re-set in the script wrapper). I plunked a "set >> debug" into the script, and the only env var's that are set are as listed below (slightly sanitized for public display). Anyone have any ideas? I have tried both the Wiki-way, and this way: http://dovecot.org/list/dovecot/2009-December/045139.html with identical results. CLIENT_LIMIT='1000' CONFIG_FILE='/my_path/config' DOVECOT_CHILD_PROCESS='1' DOVECOT_PRESERVE_ENVS='TZ' DOVECOT_VERSION='2.0.13' GENERATION='7690' IFS=' ' LOG_SERVICE='1' OPTIND='1' PATH='my_path' PPID='1' PS1='# ' PS2='> ' PS4='+ ' PWD='my_pwd' SOCKET_COUNT='1' SSL_SOCKET_COUNT='0'

2 1

[Dovecot] shared mailboxes
by Vasil Mikhalenya 15 Aug '11

15 Aug '11

Hi all, I've read all documentation that I could find, but I can not understand 2 simple things 1. How to create a public mailbox - with per user seen flag. In my configuration this flag is shared 2. How to share one user mailbox with other users and set up acl. In Cyrus it was very easy( cyradm sam mailbox user1 lrs or sam mailbox user2 all ). What way there is to do this in dovecot. It was no problem with shared mailboxes in cyrus, but I need maildir support. Thank you. # 2.0.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.2 ext3 auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain first_valid_uid = 8 last_valid_uid = 8 mail_debug = yes mail_location = mdbox:/var/mail/%1n/%n mail_plugins = acl mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mdbox_preallocate_space = yes namespace { hidden = no inbox = yes list = yes location = prefix = separator = / type = private } namespace { list = children location = mdbox:/var/mail/%%1n/%%n prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { location = maildir:/var/mail/public prefix = public/ separator = / subscriptions = no type = public } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { driver = pam } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap sieve pop3" service auth { unix_listener auth-client { group = mail mode = 0660 user = Debian-exim } unix_listener auth-userdb { group = mail mode = 0600 user = mail } user = $default_internal_user } service imap-login { process_min_avail = 6 service_count = 0 } ssl_ca = </etc/ssl/private/CA.crt ssl_cert = </etc/ssl/private/w.crt ssl_key = </etc/ssl/private/w.key syslog_facility = local0 userdb { args = uid=mail gid=mail home=/var/mail/%1n/%n allow_all_users=yes driver = static } userdb { args = uid=mail gid=mail home=/var/mail/%1n/%n dovecot driver = passwd } protocol lda { mail_plugins = acl sieve } protocol imap { mail_plugins = acl acl imap_acl } -- Best regards, Vasil Mikhalenya

2 1

[Dovecot] Error when trying to delete folders
by Bar Ziony 15 Aug '11

15 Aug '11

Hi, I'm using Dovecot 2.0.12 as an IMAP server. I'm using the lazy expunge plugin (2 namespaces - default and .EXPUNGED). When trying to delete a folder, I get this error: "Server Error: DELETE: Can't rename mailboxes across specified storages" Is that related to the lazy expunge plugin? What does this error means exactly and how can I fix it? `dovecot -n` output: # 2.0.12: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.2 auth_master_user_separator = * lda_mailbox_autocreate = yes listen = * log_path = /var/log/dovecot/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_gid = 1001 mail_location = maildir:~/Maildir:INDEX=/var/indexes/%n mail_plugins = quota mail_privileged_group = vmail mail_uid = 1001 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = no list = yes location = maildir:~/Maildir/expunged prefix = EXPUNGED/ separator = / type = private } passdb { args = scheme=md5-crypt username_format=%n /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { deleted_to_trash_folder = Trash lazy_expunge = EXPUNGED/ quota = maildir:User quota:ns= quota_warning = storage=98%% quota-warning 98 %n quota_warning2 = storage=95%% quota-warning 95 %n quota_warning3 = storage=92%% quota-warning 92 %n quota_warning4 = storage=90%% quota-warning 90 %n quota_warning5 = storage=85%% quota-warning 85 %n quota_warning6 = storage=80%% quota-warning 80 %n sieve = ~/.dovecot.sieve sieve_before = /var/mail/%n/sieve/vacation_message.sieve sieve_dir = ~/sieve } protocols = " imap sieve pop3" service auth { unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 0 } } service pop3-login { inet_listener pop3 { port = 0 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl = required ssl_cert = </etc/dovecot/ssl/certs/mail.home.example.com.crt ssl_key = </etc/dovecot/ssl/private/mail.home.example.com.key userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { info_log_path = /var/log/dovecot/dovecot-lda.log log_path = /var/log/dovecot/dovecot-lda.log mail_plugins = quota sieve } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 100 mail_plugins = quota imap_quota lazy_expunge deleted_to_trash } protocol pop3 { mail_plugins = quota lazy_expunge pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv ssl_cert = </etc/dovecot/ssl/certs/pop3.home.example.com.crt ssl_key = </etc/dovecot/ssl/private/pop3.home.example.com.key } Any help will be much appreciated! Thanks, Bar.

2 1

[Dovecot] SQL passdb lookups not working
by Benjamin Montgomery 14 Aug '11

14 Aug '11

Hello everyone, I'm trying to make dovecot do user authentication against a SQL database. The passwords (managed by Django) are stored as salted SHA1 encoded in hex. I monkey patched Django's password method so that the password hash is made with <password><salt> (Django does <salt><password>, the patched method was verified to return same value as dovecotpw) and the passwords are stored in the database separately as the salted hash and the salt. When I query the values out of the database, I'm using MySQL's concat function to return the password as {SSHA.hex}<sha1 hash><salt>. Dovecot is not able to verify any passwords right now. I've scoured the wiki and I think my setup is correct...config info is below. Any advice on where to look for debugging or setup of my passwords would be appreciated! Ben dovecot-sql.conf: default_pass_scheme = SSHA.hex password_query = \ SELECT emailmanager_emailaddresses.account AS username, \ emailmanager_domain.name AS domain, \ CONCAT('{SSHA.hex}', \ emailmanager_userprofile.shadigest, \ emailmanager_userprofile.salt \ ) AS password \ FROM emailmanager_emailaddresses \ JOIN emailmanager_domain ON emailmanager_emailaddresses.id = emailmanager_domain.id \ JOIN emailmanager_userprofile ON emailmanager_emailaddresses.id = emailmanager_userprofile.id \ WHERE emailmanager_emailaddresses.account = '%n' \ AND emailmanager_domain.name = '%d'

1 1

[Dovecot] Clients can't retrieve new emails
by Jeff Van Epps 12 Aug '11

12 Aug '11

In a formerly working environment suddenly clients aren't notified of new emails and can't retrieve new emails. Server is Ubuntu 11.04 dovecot 1.2.15. Clients which fail are a Pre2 webOS 2.1 and TouchPad webOS 3.0 (those are OS versions, I don't know which particular flavor/version the IMAP clients are); there is also a Thunderbird 3.1.11 client on the same system as the server which works properly. The clients never report an error. I got as far as configuring rawlog: in: ~A2 NAMESPACE ~A3 SELECT "INBOX" ~A4 LIST "" * ~A5 UID STORE 0 +FLAGS.SILENT (\Seen) ~A6 UID STORE 0 +FLAGS.SILENT (\Seen) out: * OK [RAWLOG TIMESTAMP] 2011-08-01 08:28:33 ~A1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in * NAMESPACE (("" "/")) NIL NIL ~A2 OK Namespace completed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk \*)] Flags permitted. * 101 EXISTS * 0 RECENT * OK [UNSEEN 63] First unseen. * OK [UIDVALIDITY 1222650706] UIDs valid * OK [UIDNEXT 863] Predicted next UID * OK [HIGHESTMODSEQ 1903] Highest ~A3 OK [READ-WRITE] Select completed. * LIST (\NoInferiors \UnMarked) "/" "Trash" * LIST (\NoInferiors \UnMarked) "/" "Sent" * LIST (\NoInferiors \UnMarked) "/" "INBOX" ~A4 OK List completed. ~A5 BAD Error in IMAP command UID STORE: Invalid uidset ~A6 BAD Error in IMAP command UID STORE: Invalid uidset I've searched and read messages saying that there is no such thing as UID 0. Okay. Why are the clients suddenly trying to use it? Why doesn't the server just ignore it? (it seems like it may be terminating the connection) What can I do about it? (I'll nag HP about the client side but I don't expect quick action. The server on the other hand is in my house.) dovecot -n output: # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.38-11-generic i686 Ubuntu 11.04 log_timestamp: %Y-%m-%d %H:%M:%S ssl_cert_file: /etc/ssl/certs/lordbah.com.crt ssl_key_file: /etc/ssl/private/lordbah.com.key ssl_key_password: --redacted-- disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_process_per_connection: no login_processes_count: 5 login_max_processes_count: 20 verbose_proctitle: yes mail_privileged_group: mail mail_location: mbox:~*/mail:INBOX=/var/mail/*%u mail_debug: yes mbox_write_locks: fcntl dotlock mail_executable: /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap imap_client_workarounds: tb-extra-mailbox-sep auth default: verbose: yes debug: yes passdb: driver: pam userdb: driver: passwd -- Jeff Van Epps

3 5