- dovecot - dovecot.org

[Dovecot] Odd/Incorrect Quota Reporting on Dovecot 1.2.4 & FreeBSD4
by Siraj 'Sid' Rakhada 10 Sep '09

10 Sep '09

Hi, Am seeing an odd problem on an old FreeBSD 4.11 box that I'm trying to get courier off, and dovecot on. At the same time, I'm trying to put some fairly simple quota support on, but getting very odd results. I think it might be better described with the log below, but, the gist of it is this: I have set a 1GB quota, and I was getting intermittent reports on the quota usage - sometimes at the correct usage (300MB or so), and then at some crazy amount over the quota usage. I can get it to be consistently incorrect though, as displayed with the below log. The maildirsize is correct, and matches closely to 'du' output, it's simply coming through incorrect on IMAP. It also only seems to happen if the maildirsize is not created before the first 'getquota[root]' command occurs. I think it's something to do with dovecot + FreeBSD (at least, this version)! I've done a quick test on a Debian box, and I don't have the same problem. Anyone else have any ideas what could be going wrong on this FreeBSD box? Is it worth me giving the dovecot -n output at this stage? It happens on different mailboxes too, this is just a sample. Thanks! ----- information & log follow # /usr/local/dovecot/sbin/dovecot --version 1.2.4 # uname -a FreeBSD server1.domain 4.11-RELEASE-p13 FreeBSD 4.11-RELEASE-p13 #5: Wed Oct 12 18:02:46 BST 2005 root@server1.domain:/usr/obj/build/src/sys/FBSD410RELENG i386 # cat maildirsize 1073741824S 304806180 16002 Attempt 1: . OK Capability completed. a login sid@domain test a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH QUOTA] Logged in a getquotaroot inbox * QUOTAROOT "inbox" "User Quota" * QUOTA "User Quota" (STORAGE 117738174 1048576) a OK Getquotaroot completed. a logout * BYE Logging out a OK Logout completed. closed Attempt 2: (on server do 'rm maildirsize') . OK Capability completed. a login sid@domain test a OK [snip] Logged in a getquotaroot inbox * QUOTAROOT "inbox" "User Quota" * QUOTA "User Quota" (STORAGE 117738174 1048576) a OK Getquotaroot completed. (on server, do 'rm maildirsize' again, while still connected, the first 'getquotaroot' is incorrect, as it seems dovecot regenerates the maildirsize file on login, hence the 'rm') a getquotaroot inbox * QUOTAROOT "inbox" "User Quota" * QUOTA "User Quota" (STORAGE 297662 1048576) a OK Getquotaroot completed. a getquotaroot inbox * QUOTAROOT "inbox" "User Quota"

2 2

[Dovecot] Password & Authentication schemes to comply with postfixadmin
by bsd 09 Sep '09

09 Sep '09

Hello, I am using the latest version of Dovecot on a FreeBSD box. I am trying to figure out which password scheme to use to comply with my database backend which is administered by "postfix admin". Here is an example of the password that can be generated in the database using the various encryption schemes available in postfix admin: $1$a733fb07$/g1h6opQxemdWUtzD2/kQ. --> md5crypt 25f9e794323b453885f5181f1b624d0b --> md5 acFhkap78XB2I --> system I am not certain I have understood very well how things all feet together… I have tried to modify the various options in dovecot-mysql.conf in order to comply with these settings: I have updated "default_pass_scheme" to "PLAIN-MD5, DIGEST-MD5, and CRYPT" but none of this seems to work. Do I have to modify something in dovecot.conf? For the moment I have these settings: auth default { mechanisms = plain login passdb sql { args = /usr/local/etc/dovecot-mysql.conf } userdb sql { args = /usr/local/etc/dovecot-mysql.conf } socket listen { client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } } The main idea is simply not to have cleatext passwd in the DB. Thanks for your support. ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ Gregober ---> PGP ID --> 0x1BA3C2FD bsd @at@ todoo.biz ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ P "Please consider your environmental responsibility before printing this e-mail"

2 1

[Dovecot] LDA does not read quota from userdb's extra fields
by Tim Chen 09 Sep '09

09 Sep '09

The version I use is dovecot 1.2.4 My config in dovecot.conf protocol imap { mail_plugins = quota imap_quota mail_log } protocol lda { mail_plugins = quota } userdb passwd-file { args = /etc/dovecot.userdb } quota = maildir quota_rule = *:storage=100MB /etc/dovecot.userdb user1:*:2001:2001::/ms/user1::userdb_quota_rule=*:storage=300M And in postfix/main.cf mailbox_command = /usr/local/libexec/dovecot/deliver I wish to have a global quota 100MB for all the users and using /etc/dovecot.userdb to specify larger quota(300MB) for some vip users. IMAP works normally as expected, using the following command will report correct quota. a login user1 pass1 user1 getquotaroot INBOX However, it seems LDA treat all users the same quota (100MB), and when trying to send mails to those vip users(300MB), it will reject the email and report "552 Requested mailbox exceeds quota. (in reply to RCPT TO command))" My speculation is LDA forget the read 'extra fields' from userdb, would you please help to verify it? Thanks very much for your help. Sincerely, Tim Chen

2 1

[Dovecot] changing location of index files
by suzuki 09 Sep '09

09 Sep '09

Hello, I think changing index files location of mail_location setting to reduce disk I/O. by adding "INDEX=/var/index/%d/%1n/%n" to mail_location like below, mail_location = maildir:~/Maildir:INDEX=/var/index/%d/%1n/%n Will this change cause any problems or data loss to existing pop3 users? There are only pop3 users on this server. % dovecot --version 1.1.18 % dovecot -n # 1.1.18: /usr/local/dovecot/etc/dovecot.conf # OS: FreeBSD 7.2-STABLE i386 syslog_facility: local4 protocols: pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable: /usr/local/dovecot/libexec/dovecot/pop3-login login_greeting: ready mail_max_userip_connections: 1 verbose_proctitle: yes first_valid_uid: 10026 last_valid_uid: 10026 first_valid_gid: 10026 last_valid_gid: 10026 mail_privileged_group: vmail mail_uid: 10026 mail_gid: 10026 mail_location: maildir:~/Maildir mail_debug: yes maildir_copy_preserve_filename: yes mail_executable: /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins: quota mail_plugin_dir: /usr/local/dovecot/lib/dovecot/pop3 mail_log_max_lines_per_sec: 30 pop3_enable_last: yes pop3_reuse_xuidl: yes pop3_lock_session: yes pop3_client_workarounds: outlook-no-nuls,oe-ns-eoh lda: postmaster_address: postmaster mail_plugins: quota sendmail_path: /usr/local/sbin/sendmail auth_socket_path: /var/run/dovecot/auth-master auth default: verbose: yes passdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: quota: maildir

2 1

Re: [Dovecot] FTS Plugin design
by rui.carneiro＠portugalmail.net 09 Sep '09

09 Sep '09

Hi again! After sometime using my changes on this plugin I found one major problem. When a message have two attachments with same name or one with content-type equal to "message/*", my solr schema design does not work because as attachment unique identifier I used attachment's name what is not correct. Now I am trying to find a way to know the mime part id of the parts used on fts_build_mail. Is that already possible or I need to do that by my own? Thank you in advance, Rui Carneiro

2 1

[Dovecot] The usage of dovecot-uidvalidity* files?
by Tim Chen 09 Sep '09

09 Sep '09

After installing a new server with dovecot 1.2.4, I found there is some new dovecot-uidvalidity* files in user's Maildir directory. However, I did not see such files in other servers with dovecot 1.1.2 (around 2008/07). What is function of those files? What will happen if I delete that files? I am curious why need to keep 2 files: dovecot-uidvalidity dovecot-uidvalidity.4aa4fa4c since the content of dovecot-uidvalidity is '4aa4fa4c' why do we need extra files? Thanks Timo for providing the wonderful dovecot software! Hope you don't mind my stupid questions. Sincerely, Tim Chen

2 1

[Dovecot] compression script for use with zlib module
by Leonardo Rodrigues 09 Sep '09

09 Sep '09

Hi, I'm wondering if someone already implemented a compression script (and would like to share it) based on the step-by-step provided on wiki page of Zlib module. I can already do some find|xargs gzip .... but couldnt implement it completly as described on the wiki page. I know the suggested step-by-step is very detailed and probably a must simplier will be enough for almost anyone .... anyway, if someone have the full script and would like to share it, i would be glad to get it :) http://wiki.dovecot.org/Plugins/Zlib 1) Find the mails you want to compress in a single maildir. 2) Compress the mails to tmp/ * Update the compressed files' mtimes to be the same as they were in the original files (e.g. touch command) 3) Run maildirlock <path> <timeout>. It writes PID to stdout, save it. * <path> is path to the Maildir's dovecot-uidlist (the control directory, if it's separate) * <timeout> specifies how long to wait for the lock before failing. 4) If maildirlock grabbed the lock successfully (exit code 0) you can continue. 5) For each mail you compressed: 1. Verify that it still exists where you last saw it. 2. If it doesn't exist, delete the compressed file. Its flags may have been changed or it may have been expunged. This happens rarely, so just let the next run handle it. 3. If the file does exist, rename() (mv) the compressed file over the original file. * Dovecot can now read the file, but to avoid compressing it again on the next run, you'll probably want to rename it again to include e.g. a "Z" flag in the file name to mark that it was compressed (e.g. 1223212411.M907959P17184.host,S=3271:2,SZ). Remember that the Maildir specifications require that the flags are sorted by their ASCII value, although Dovecot itself doesn't care about that. 6) Unlock the maildir by sending a TERM signal to the maildirlock process (killing the PID it wrote to stdout). -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, NÃO mandem email gertrudes(a)solutti.com.br My SPAMTRAP, do not email it

2 1

[Dovecot] inotify_init() failed: Function not implemented
by franc walter 09 Sep '09

09 Sep '09

Hello, i have in my mail.log some warnings: Sep 2 08:21:49 myserver dovecot: IMAP(me(a)myserver.tld): inotify_init() failed: Function not implemented how can i fix this? Thank you in advance, franc walter

2 1

[Dovecot] Server load while using Zlib compression
by Laurent CARON 09 Sep '09

09 Sep '09

Hi, I wonder if some users are using this plugin on production setups. If yes, how does it perform in terms of cpu load compared with the same setup without compression ? Thanks Laurent

2 1

[Dovecot] Using Dovecot code in a non-LGPL package
by Asheesh Laroia 08 Sep '09

08 Sep '09

Hi Timo (and all!), Venaktesh is a friend of mine working on a patch to the venerable Alpine mail reader so it can read Maildir format mailboxes on disk. Venkatesh wanted to know if he could use some code from Dovecot's lib-storage (safely opening/reading Maildirs, including accounting for NFS and ESTALE) and the UID->message mapping code. This way, Dovecot and Alpine would agree on how to handle UIDs for a given Maildir-format mailbox. Plus Alpine could benefit from the thought you've put into the safety of Maildirs on IMAP (which is *not* trivial!). But there are some possible licensing issues. Alpine (formerly known as PINE) is now licensed under the Apache License 2.0. As far as I can tell, if he wants to contribute a patch back to Alpine upstream, he should use use the Apache License 2.0. But Dovecot is licensed under LGPL 2.1; if he takes Dovecot code, modifies it, and mixes it with Alpine, that would not be allowed by the licenses together (as I understand it). The Apache License 2.0 is a permissive, non-copyleft license like the MIT License, but it adds a patent retaliation clause. See http://www.apache.org/licenses/LICENSE-2.0.html for its text and http://www.gnu.org/philosophy/license-list.html for a short statement of its compatibility with GPLv3; http://en.wikipedia.org/wiki/Apache_License#GPL_compatibility has a little more. License-wise, there are two choices, if you're willing Timo: the modified Dovecot code could be released under GPLv3, which *is* compatible with the Alpine license - it would just mean Alpine+Maildir would be GPLv3 when put together. Or you could grant a special permission to Venkatesh to distribute the modified Dovecot code under the Apache License 2.0. Timo (and others), what do you think? The past of least resistance is to say that a derivative work of Dovecot can be made using GPLv3; the most convenient would be to say that particular portions can be used under the Apache License 2.0. -- Asheesh. -- Why do we have two eyes? To watch 3-D movies with.

2 1