- dovecot - dovecot.org

[Dovecot] IMAP labeling sometimes not taken into account
by Olivier Cailloux 02 Jun '09

02 Jun '09

Dear Dovecot list, I recently switched from uw-imapd to dovecot to manage my huge mbox files (about 1 GB). I now observe a very strange behavior, difficult to reproduce reliably, which might be related to some misunderstanding on my part on how either dovecot works or imap labeling works. What I call "labeling" is the fact of marking some e-mail, in my e-mail client (currently Thunderbird), with a label, which can be chosen among five labels (plus the "no-label" case). Evolution also supports labeling. As far as I understood until a few days ago, when I put a label, say, number five, on an e-mail, a keyword "$Label5" is added on the "X-Keywords:" line of the corresponding e-mail in my mbox file. Removing the label simply removes the keyword on the same line. That is, at least, what happened with uw-imapd (not that I have seen that documented somewhere but this is what I observed). The label is thus stored on the e-mail server, not on the client hard disk, which is important for me as I extensively use that feature to sort e-mails, and need to access them from several different places (and find the same labels at the same places, naturally, whatever client I use). Since the change for dovecot, however, things are going strange. Sometimes the labels disappear for some reasons. Sometimes they stay there. And I can't reproduce the behavior, it just seems random. This is very annoying as it totally breaks my e-mail management. Currently there is something strange I can reproduce however, and if someone could explain me what is happening I guess it would be a good step towards a solution. I see a specific e-mail as being labeled in thunderbird, having label number five. I also tried with evolution, accessing the same imap folder, evolution also sees that e-mail as having a label number five. I tried running these clients from my imap server, and I tried thunderbird on a Windows box at home, and every clients agree: this e-mail has a "5" label. BUT when I open the mbox file directly on the imap server (using "less"), and scroll to that given e-mail, I see NO "X-Keywords: " line. How then can the e-mail clients know that this e-mail is labeled? Please note that this behavior does not happen with only one specific e-mail, but I take it as an example of what is strange. In fact I can see, especially at the end of the mbox file (thus the latest e-mails), that plenty of e-mails have either no "X-Keywords: " line or a line with "X-Keywords: " and nothing else, whereas they are seen as being labeled (and indeed I remember having labeled most of those through thunderbird). The former e-mails I checked in the m-box (for example, one month ago) all correctly have an X-Keywords line indicating "$Label5" or other appropriate labels. It seems like dovecot is keeping some track of labeled e-mails somewhere which is NOT in the mbox file, probably related to its indexing capabilities. But I don't know how that works and where these index files are stored, how to purge them and rebuild the index, and so on. Apparently these index files have remembered some e-mails as being labeled (which is good, because I indeed labeled them). But I'd like to know how that works to be able to better troubleshoot why sometimes the label disappear. Note that restarting dovecot does not change the label status of the e-mail, so the status must be stored somewhere on disk and not only in memory. Or is all these labeling stuff some unsupported, non-standard extension to IMAP that only uw-imapd supports? (I hope not because I find it very practical and I'd like to use it with dovecot as well!) Thank you for any help. (Technical informations follow.) Olivier ------ 2-12h38-~#dovecot --version 1.0.15 ------ 2-12h38-~#dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S ssl_cert_file: /etc/ssl/certs/imapd.pem ssl_key_file: /etc/ssl/private/imapd.pem login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail auth default: passdb: driver: pam userdb: driver: passwd ------

2 2

[Dovecot] Capability problems dovecot 2.0
by ja nein 01 Jun '09

01 Jun '09

Hi, I had some problems connecting TB 2.x with dovecot 2.0. TB2 complained about not being an IMAP4 server. TB 3 worked. It seems that dovecot 2.0 doesn't return capabilities when queried. Maybe some wrong config, thoug? Here are the debug logs from TB2 comparing dovecot 2.0 (not working) and dovecot 1.2 (working): Dovecot 2.0: NA:CreateNewLineFromSocket: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. NA:SendData: 1 capability ReadNextLine [stream=26c2d60 nb=15 needmore=0] NA:CreateNewLineFromSocket: * CAPABILITY ReadNextLine [stream=26c2d60 nb=28 needmore=0] NA:CreateNewLineFromSocket: 1 OK Capability completed. ProcessCurrentURL: aborting queued urls NA:SendData: 2 logout Dovecot 1.2: NA:CreateNewLineFromSocket: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. NA:SendData: 1 capability ReadNextLine [stream=27dcf50 nb=303 needmore=0] NA:CreateNewLineFromSocket: * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH QUOTA AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5 ReadNextLine [stream=27dcf50 nb=28 needmore=0] NA:CreateNewLineFromSocket: 1 OK Capability completed. NA:SendData: 2 authenticate plain ReadNextLine [stream=27dcf50 nb=4 needmore=0] NA:CreateNewLineFromSocket: + NA:SendData: Logging suppressed for this command (it probably contained authentication information) ReadNextLine [stream=27dcf50 nb=266 needmore=0] NA:CreateNewLineFromSocket: 2 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH QUOTA] Logged in A:SendData: 3 namespace And all goes well... TB3 seems to be fine without extra capability stuff. Regards, Sebastian

5 20

[Dovecot] For the record: Postfix+Spamassassin+ClamAV+Dovecot
by James Butler 01 Jun '09

01 Jun '09

Postfix 2.5.5 SpamAssassin 3.2.5 (under Perl 5.10.0) ClamAV 0.95.1 Dovecot 1.2.rc2 works fine on Fedora 10. Installed Dovecot and ClamAV from source and everything else using yum. I'm using the ClamAV plugin for Spamassassin: http://wiki.apache.org/spamassassin/ClamAVPlugin I'm calling Spamassassin with: /etc/postfix/main.cf: mailbox_command = /usr/bin/spamc -f -e /usr/local/libexec/dovecot/deliver Postfix hands off to Spamassassin, which processes ALL mail (not just attachments) through the ClamAV plugin before parsing for spam, and then hands the whole mess off to Dovecot for 'deliver' to handle. How simple is that? Since ClamAV scanns all mail, it might be too processor-intensive for really large mail systems, but it is working great for our 120+ user system with lots of spam coming in. If you're using Procmail or some other preprocessor that can hand off to a pipe, then you could skip the plugin and pipe messages over a certain size (i.e. >1024) to clamd, instead. Enjoy! James

4 3

[Dovecot] uid fetch error with revision 9112:9d634c93d28a
by Jonathan Siegle 01 Jun '09

01 Jun '09

This command fails: 2 uid fetch somevaliduid (BODYSTRUCTURE BODY.PEEK[]) 2 BAD Error in IMAP command UID: Unknown command BODYSTRUCTURE Thanks, Jonathan

2 8

[Dovecot] Namespace delimiter...
by Lenthir 01 Jun '09

01 Jun '09

As RFC3501 (IMAP) say: 'A NIL hierarchy delimiter means that no hierarchy exists; the name is a "flat" name.' How to change delimiter to NIL? We have flat namespaces in our storage. Now I hardcoded this and everything is working, but maybe it is another possibility... -- Konrad

2 6

[Dovecot] namespace problem with dovecot 2.0
by reg9009 01 Jun '09

01 Jun '09

Hi all, I've got some namespace problems with dovecot 2.0 again. If I start dovecot 2.0 with same settings of namespace and maildir layout as dovecot 1.2, I don't see my folders above the Inbox. I see them as "INBOX/xxx" in the same root level as my INBOX. If I try to subscribe to the folders, I see them as "INBOX^xxx" (and cannot subscribe). My namespace settings: namespace private { separator = / prefix = "INBOX/" inbox = yes #hidden = yes list = yes subscriptions = yes } I tried nearly every separator/combination, but it won't work. Any ideas (to get it work like dovecot 1.2)? I've got no shared folders/namespaces, etc. Layout is plain Maildir. Regards, Sebastian

2 6

[Dovecot] Connection queue full on dovecot 1.1.14 and 1.1.15
by Sven Eulberg 01 Jun '09

01 Jun '09

Hello, sometimes we get the following errors on out dovecot proxies: dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:06:10 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:06:11 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:06:12 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:06:15 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> dovecot: May 27 20:09:36 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:09:36 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> dovecot: May 27 20:09:36 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:09:36 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:09:36 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:11:18 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:11:18 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:39:22 Info: imap-login: Disconnected: Connection queue full (no auth attempts): REMOTE=<IP> LOCAL=<IP> TLS handshaking dovecot: May 27 20:39:22 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> TLS dovecot: May 27 20:39:23 Info: imap-login: Disconnected: Connection queue full (auth failed, 1 attempts): user=<USER>, method=PLAIN, REMOTE=<IP> LOCAL=<IP> Our config: ./dovecot -n # 1.1.15: /usr/local/dovecot-1.1.15/etc/dovecot.conf # OS: Linux 2.6.18-6-686 i686 Debian 4.0 base_dir: /usr/local/dovecot/var/run/dovecot/ log_path: /var/log/dovecot-1.1.log protocols: pop3 pop3s imap imaps ssl_ca_file: /usr/local/dovecot/etc/ssl/de.TR_CRT ssl_cert_file: /usr/local/dovecot/etc/ssl/de.CRT ssl_key_file: /usr/local/dovecot/etc/ssl/de.PKEY disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable(default): /usr/local/dovecot-1.1.15/libexec/dovecot/ imap-login login_executable(imap): /usr/local/dovecot-1.1.15/libexec/dovecot/imap- login login_executable(pop3): /usr/local/dovecot-1.1.15/libexec/dovecot/pop3- login login_log_format_elements: user=<%u> method=%m REMOTE=%r LOCAL=%l %c login_process_per_connection: no login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_processes_count: 10 login_max_processes_count: 256 verbose_proctitle: yes mail_location: maildir:/home/email/%u/Maildir mailbox_idle_check_interval: 60 mmap_disable: yes fsync_disable: yes mail_executable(default): /usr/local/dovecot-1.1.15/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot-1.1.15/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot-1.1.15/libexec/dovecot/pop3 mail_process_size: 512 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/dovecot-1.1.15/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot-1.1.15/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot-1.1.15/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape- eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_lock_session(default): no pop3_lock_session(imap): no pop3_lock_session(pop3): yes pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %v.%u pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login cache_size: 1024 cache_ttl: 28800 failure_delay: 3 passdb: driver: sql args: /usr/local/dovecot/etc/dovecot-mysql.conf It seems to me the error occurs more often after increasing login_processes_count. This errors exists with version 1.1.14 and 1.1.15 and I guess also in earlier versions. Thanks in advance! Best regards, Sven

2 2

[Dovecot] Feature Missing OUTBOX Folder
by Frank Doege 01 Jun '09

01 Jun '09

Hi Dovecot People, i have switched my system from courier-imap to dovecot and iam quite happy with it, the performance is well and i had nearly no problems. One little feature iam missing is in Courier i had a folder called "Outbox" there i could paste mails which i want to sent out. In some networks its not always available to sent mails via port 21, i know i could just set up my email server to another port but it was a nice feature. Is this a big afford or is it just alittle hack ? could it done via a little plugin ? Thanks Timo & all others for the great work ! Frank

5 7

[Dovecot] imap cann't read the mail that foxmail send
by wallace0615 01 Jun '09

01 Jun '09

Hi everyone: I use dovecot only as the imap server, For smtp and pop3, I use apache james. The dovecot version: 1.1.14 And the configuration is : protocols: imap ssl_disable: yes login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: mbox:/usr/local/edupass/mail/repo/%u:INBOX=/usr/local/edupass/mail/%u auth default: passdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot-sql.conf I have no porblems to login. When I use "telent host 25" to send a email, dovecot read it no problems. But when I use outlook and foxmail to send a email, dovecot cann't read the email data. I compared the data that using the two way to send, and found the reason: use outlook and foxmail: at the beginning of the eamil data is "From zxjteacher_SP_LZU <zxjteacher_SP_LZU@myserver>"; and if I telnet host 25 to send the mail: at the beginning of the eamil data is "From <zxjteacher_SP_LZU@myserver>", so I delete "zxjteacher_SP_LZU", dovecot read it out. "zxjteacher_SP_LZU" is because that outlook and foxmail need an account name to represent the eamil address. So, anyone ever confront with this situation? Any helps appreciate. Thx.

3 2

[Dovecot] Expire Plug-in stopped
by Matt Rude 01 Jun '09

01 Jun '09

Good evening, While working with Dovecot 1.2rc4 on Fedora 10, I have been trying to get the Expire plug-in to auto delete messages for us. When I run the plug-in with the test flag, I receive the following message: /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool --test Info: amy(a)example.com/Trash: stop, expire time in future: 1242953758 All messages were deleted before the expire plug-in was added. I understand that dovecot will only expire messages after they have been in the trash or junk longer then the time in dovecot.conf. So I have let this fail since Monday, but continue to receive the same error. A quick grep for expire from my Dovecot logs doesn't show any output. Also, when I look up this error on google, I see other peaple who's output shows a real date (not 1242953758), how do I know when this date is? Thanks -Matt # 1.2.rc4: /usr/local/etc/dovecot.conf # OS: Linux 2.6.27.21-170.2.56.fc10.i686 i686 Fedora release 10 (Cambridge) ext3 listen: *:143 ssl_listen: *:993 ssl_cert_file: /etc/postfix/SSL/mail.mattrude.com.cert ssl_key_file: /etc/postfix/SSL/mail.mattrude.com.key login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_user: postfix mail_location: maildir:/var/spool/virtualmailboxes/%d/%u/:INDEX=/var/spool/virtualmailboxes/.Index/%d/%u/ mail_plugins: autocreate expire quota imap_quota zlib trash auth default: mechanisms: plain login cram-md5 cache_size: 128 cache_ttl: 600 passdb: driver: sql args: /etc/dovecot-mysql.conf userdb: driver: sql args: /etc/dovecot-mysql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: virtualmail group: virtualmail plugin: autocreate: Drafts autocreate2: Sent autocreate3: Trash autocreate4: Junk autocreate5: Junk.IsSpam autocreate6: Junk.IsNotSpam autocreate7: Save autosubscribe: Drafts autosubscribe2: Sent autosubscribe3: Trash autosubscribe4: Junk autosubscribe5: Junk.IsSpam autosubscribe6: Junk.IsNotSpam autosubscribe7: Save auth_socket_path: /var/run/dovecot/auth-master expire: Trash 1 Junk 3 expire_dict: proxy::expire quota: maildir:User quota quota_rule: *:storage=10M quota_rule2: Trash:storage=10%% quota_rule3: Junk:storage=20%% sieve: /var/spool/virtualmailboxes/%d/%u/dovecot.sieve sieve_storage: = /var/spool/virtualmailboxes/%d/%u/ trash: /etc/dovecot-trash.conf dict: expire: db:/var/spool/imap/expire.db

2 1