September 2011 - dovecot

[Dovecot] Dovecot failing to parse some UTF-8 encoded attachment filenames, returning empty string instead
by Andrew Richards 29 Sep '11

29 Sep '11

Hi, I'm seeing a strange problem with some attachment filenames that are UTF-8 encoded. The problem seems to be related to spaces and/or unusual characters in filenames, like accented characters (or perhaps just to filenames if UTF-8 encoded; I've not explored that fully). These filenames are shown as empty strings in IMAP using Dovecot. I've attached a sample message that exhibits this problem, trimmed down to fairly bare essentials. By comparison I find that (for example) Courier happily returns the filename (still encoded). Although I suspect the problem lies within Dovecot, it may be an underlying Unicode or other component that's at the root of the problem. I can replicate this by putting the attached message in a mailbox (I'm using Maildir format mailboxes, so I just drop the raw file in Maildir/new and change the ownership of the file to match the mailbox owner). Then a pretend IMAP session to show the problem, $ telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. 0 login some.one(a)test.domain password 0 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in 0 select inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 4 EXISTS * 0 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1316621730] UIDs valid * OK [UIDNEXT 8] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest 0 OK [READ-WRITE] Select completed. 0 fetch 4 body * 4 FETCH (BODY (("text" "html" ("charset" "iso-8859-15") NIL NIL "base64" 278 5)("application" "octet-stream" ("name" "") NIL NIL "base64" 18) "mixed")) 0 OK Fetch completed. 0 logout * BYE Logging out 0 OK Logout completed. Connection closed by foreign host. $ especially note the ("name" "") part showing a supposedly empty filename. I've observed this behaviour on the following versions of Dovecot, - 1.2.9 on Ubuntu 10.04LTS (pre-compiled version) - 1.2.17 on Fedora 13 (pre-compiled version) - 2.0.15 on Fedora 13 (from source) I don't think the Dovecot configuration is relevant, but I've put it below for good measure for the 2.0.15 setup. Any ideas on what might be causing this? Best regards, Andrew. # dovecot -n # 2.0.15: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.34.9-69.fc13.i686.PAE i686 Fedora release 13 (Goddard) auth_debug = yes default_login_user = nobody log_path = /var/log/dovecot.log passdb { args = /usr/local/bin/checkcdb driver = checkpassword } protocols = imap pop3 service auth { user = root } service imap-login { inet_listener imap { ssl = no } } service pop3-login { inet_listener pop3 { ssl = no } } ssl = no userdb { driver = prefetch }

2 4

[Dovecot] Virtual Folder configuration problem. [FIXED]
by Terry Carmen 29 Sep '11

29 Sep '11

Well, it took a ton of time and research, but I finally have a working Unread virtual mailbox on Dovecot 2.x on Centos 6.0. I have no idea if it's optimal or correct, but it works perfectly and doesn't raise any errors or warnings. Here's what I ended up with: dovecot.conf: Add the following: mail_plugins = $mail_plugins virtual namespace { type = private prefix = virtual. separator = . location = virtual:~/Maildir/virtual } 10-mail.conf: Add the following: # default namespace namespace { separator = . prefix = inbox = yes } 20-imap.conf: Add the following: protocol imap { mail_plugins = $mail_plugins virtual } 15-lda.conf: Add the following: protocol lda { mail_plugins = $mail_plugins virtual } Restart dovecot. Reload your mail client. Dovecot will create ~/Maildir/virtual cd ~/Maildir/virtual mkdir Unread Use your favorite editor and create a file named "dovecot-virtual" contaiing: # ~/Maildir/virtual/unseen/dovecot-virtual INBOX INBOX.* -INBOX.Trash unseen Save the file and restart your mail client. Go to "Subscriptions" in your mail client and subscribe to the Unseen folder. You should now have a virtual folder that contains all your unread mail, except for the contents of the Trash folder. Enjoy! -- Terry Carmen CNY Support, LLC https://www.cnysupport.com

1 0

[Dovecot] Error message
by Knute Johnson 29 Sep '11

29 Sep '11

I'm getting the following message in my log; dovecot: IMAP(knute): fchown(/home/knute/mail/.imap/INBOX/dovecot.index.cache.lock, -1, 8(mail)) failed: Operation not permitted (egid=1000(knute), group based on /var/mail/knute): 1 Time(s) dovecot: IMAP(knute): fchown(/home/knute/mail/.imap/INBOX/dovecot.index.log.newlock, -1, 8(mail)) failed: Operation not permitted (egid=1000(knute), group based on /var/mail/knute): 2 Time(s) dovecot: IMAP(knute): fchown(/home/knute/mail/.imap/INBOX/dovecot.index.tmp, -1, 8(mail)) failed: Operation not permitted (egid=1000(knute), group based on /var/mail/knute): 4 Time(s) I got these once before on the /var/mail/user files and changed the permissions to 600. /home/knute/mail/.imap/INBOX is 770 and the index files are 600. Is this a problem with the directory privilege? Thanks, -- Knute Johnson

1 0

[Dovecot] "Waiting for authentication process to respond" for invalid users with auth_dovecot
by Ibrahim Harrani 29 Sep '11

29 Sep '11

Hi, I am testing dovecot 2.0.13 and 2.0.14 with qmail-ldap and auth_dovecot patch. If i login to dovecot (pop3/imap) with correct user and password. no problem, I can login immediately. but if I try with nonexistant user, dovecot does not immediate answer, wait for a while and says "Waiting for authentication process to respond." auth_dovecot process remains working in the background. How can I avoid this situation? # telnet 0 143 Trying 0.0.0.0... Connected to 0. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot ready. o login validuser validpass o OK [CAPABILITY IMAP4rev1 LITERAL+ SASL o login validuser wrongpass o NO [UNAVAILABLE] Temporary authentication failure. o login non-existant anypass * OK Waiting for authentication process to respond.. Here is output of dovecot -n # OS: Linux 2.6.32-71.el6.x86_64 x86_64 CentOS Linux release 6.0 (Final) auth_debug = yes auth_verbose = yes base_dir = /var/run/dovecot disable_plaintext_auth = no first_valid_gid = 100 last_valid_gid = 65000 last_valid_uid = 65000 listen = * log_path = /var/log/dovecot mail_debug = yes mail_location = maildir:~/Maildir passdb { args =/opt/qmail/smtp/bin/auth_dovecot ./Maildir/ driver = checkpassword } plugin { mechanisms = plain login quota = maildir } protocols = imap pop3 service imap-login { inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 } service imap-postlogin { executable = script-login /opt/qmail/scripts/dovecotpostlogin.sh } service imap { executable = imap imap-postlogin } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } process_min_avail = 1 } ssl_cert = </etc/ssl/certs/mail.pem ssl_cipher_list = ALL ssl_key = </etc/ssl/private/mail.pem userdb { driver = prefetch } verbose_proctitle = yes verbose_ssl = yes protocol imap { mail_plugins = quota ssl_cert = </etc/ssl/certs/mail.pem ssl_key = </etc/ssl/private/mail.pem } protocol pop3 { mail_plugins = quota ssl_cert = </etc/ssl/certs/mail.pem ssl_key = </etc/ssl/private/mail.pem }

2 2

[Dovecot] outlook 2007 very slow.
by Kui Zhang 29 Sep '11

29 Sep '11

Hello I have a user with 2500+ sub folders. Total mailboxes size is around 6G. (mdbox, dovecot 2:2.0.14) Syncing/Receiving appears to be slow, with outlook 2007. He does not want to switch to an alternative, due to various reasons. I did not find any error logs indicate issues. during idle, imap process appears to loop at adding inotify watches to all folders. I found outlook-idle in wiki, but it is obsolete. doveconf: Warning: Obsolete setting in /etc/dovecot/conf.d/20-imap.conf:55: imap_client_workarounds=outlook-idle is no longer necessary Any one else having similar issue? Anything else I should do to narrow down the issue? Thanks KuiZ

8 16

[Dovecot] Messages not deleted from mbox
by venom00 29 Sep '11

29 Sep '11

Hello, I've two accounts on my mail server, and from my client (Evolution) I've set up two configurations. If I dowload mail one account at a time everything works fine, but if I download both of them at the same time I'm not able to delete downloaded messages, so I download them twice, three times and counting to infinity. On th client side everything looks good: ----------------------------------------------------- LIST +OK 1 messages: 1 485 . UIDL +OK 1 000000704e57eebd . RETR 1 +OK 485 octets Message here... . DELE 1 +OK Marked to be deleted. QUIT +OK Logging out, messages deleted. ----------------------------------------------------- On the server side I've enabled debug logging but nothing relevant comes up, except sometimes an error: Panic: Message unexpectedly expunged from index Full log: http://pastebin.com/raw.php?i=bBizx9tm But most of the times there are no errors and simply the message is not deleted. I'm using mbox format in /var/spool/mail/%u. The dovecot user has read-write access to the folder (even because, as I said, if download an account at once everything works fine). I think it's about locking, I've tried several lock methods but always the same result and I can't see dead locks from lsof, fuser or ls (for dotlocks). Thanks in advance, venom00

1 0

[Dovecot] Dovecot and NTLM problem
by Pavel Obr 28 Sep '11

28 Sep '11

Hallo, i am trying setup dovecot 2.0.9 with NTLM. I tested succesfully winbind with winbind -k, ntlm-auth with ntlm_auth --username=pavel. But I cannot authenticate in Dovecot. My log show these lines: Sep 28 22:16:25 srv-pat dovecot: auth: Debug: auth client connected (pid=6002) Sep 28 22:16:25 srv-pat dovecot: auth: Debug: client in: AUTH#0111#011NTLM#011service=imap#011lip=192.168.7.67#011rip=192.168.100.141#011lport=143#011rport=5109 Sep 28 22:16:25 srv-pat dovecot: auth: Debug: client out: CONT#0111#011 Sep 28 22:16:25 srv-pat dovecot: auth: Fatal: execv(/usr/bin/ntlm_auth) failed: Permission denied Sep 28 22:16:25 srv-pat dovecot: auth: Error: winbind: ntlm_auth exited with exit code 84 Sep 28 22:16:25 srv-pat dovecot: auth: Debug: client in: CONT#0111#011TlRMTVNTUAABAAAAB4IIAAAAAAAAAAAAAAAAAAAAAAA= Sep 28 22:16:25 srv-pat dovecot: auth: Error: winbind(?,192.168.100.141): write(out_pipe) failed: Broken pipe Sep 28 22:16:27 srv-pat dovecot: auth: Debug: client out: FAIL#0111 Do you know what that is mean "Fatal: execv(/usr/bin/ntlm_auth) failed: Permission denied" ? What is exit code 84 - "Error: winbind: ntlm_auth exited with exit code 84"? My dovecot -n: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-131.12.1.el6.x86_64 x86_64 Scientific Linux release 6.1 (Carbon) auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain ntlm login auth_use_winbind = yes auth_username_format = %n mail_home = /data/vmail/%d/%n mail_location = mdbox:~/mail mbox_write_locks = fcntl passdb { driver = pam } protocols = pop3 imap lmtp ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = uid=501 gid=501 home=/data/vmail/%d/%n allow_all_users=yes driver = static } Thank you, Pavel

1 0

[Dovecot] deliver LDA issue with setuid-root
by Daminto Lie 28 Sep '11

28 Sep '11

Hi, I am getting the following error message when trying to implement LDA Dovecot 1.2.9 with virtual users: Sep 28 15:59:33 server1 postfix/pipe[3041]: 28BEC2400A1: to=<msmith(a)example.com>, relay=dovecot, delay=2361, delays=2361/0.01/0/0.03, dsn=4.3.0, status=deferred (temporary failure. Command output: /usr/lib/dovecot/deliver must not be both world-executable and setuid-root. This allows root exploits. See http://wiki.dovecot.org/LDA#multipleuids ) I do not know if I need to change the group to secmail. Currently, I have as follows -rwsr-xr-x 1 root root 933796 2011-06-10 05:36 deliver Can I change it to any other group apart from secmail? and what does it mean by world-executable? Sorry if I ask a silly question here but keen to learn more about linux. Here is my dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap listen: *:143 ssl: no disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 106 last_valid_uid: 200 mail_privileged_group: mail mail_location: maildir:/home/vmail/%u/Maildir mbox_write_locks: fcntl dotlock mail_plugins: quota imap_quota imap_client_workarounds: outlook-idle delay-newmail netscape-eoh tb-extra-mailbox-sep lda: postmaster_address: postmaster(a)example.com mail_plugins: quota sendmail_path: /usr/lib/sendmail rejection_reason: Your message to <%t> was automatically rejected:%n%r auth default: mechanisms: plain login username_format: %Lu verbose: yes debug: yes debug_passwords: yes passdb: driver: pam passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: prefetch userdb: driver: passwd userdb: driver: static args: uid=106 gid=1010 home=/home/vmail/%u socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: mail master: path: /var/run/dovecot-auth-master mode: 432 user: vmail group: vmail plugin: quota: maildir quota_rule: *:storage=3GB quota_rule2: Trash:storage=20%% quota_rule3: Spam:storage=10%% quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2: storage=80%% /usr/local/bin/quota-warning.sh 80 Here is my master.cf # delivery through dovecot dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${recipient} Any help would be greatly appreciated. Thank you

2 1

[Dovecot] Dsync Removing Subscriptions Entries
by Asai 28 Sep '11

28 Sep '11

Greetings, In learning to get Dsync to work, I see a lot of this type of warning in the logs: dsync-remote(user(a)domain.org): Warning: Subscriptions file /vmail/domain/user/subscriptions: Removing invalid entry: INBOX/SOME folder When I ran a test this morning on the backed up emails on the remote server with Thunderbird, I did indeed see that many of the subscribed folders were not present in TB, although the directories and data were indeed present on the remote server. The subscriptions file on the remote server had the omissions which Dsync warned about. These maildir folders seem to work fine on the main server. Can someone help me to understand how to make the sync without omissions in the subscriptions file? -- *Asai* Global Change Multi-Media Internet Application Development IT and Networking Services 520-398-2542

1 0

[Dovecot] Controling users access ?
by Frank Bonnet 28 Sep '11

28 Sep '11

Hello We are going to split our mailhub in two :-) one for students and one for the others Does Dovecot 2 provide some mechanisms to filter users's' login ? a flat file would be enough for my usage ( I use pam_ldap nss_ldap with nsswitch ) thanks

1 0