July 2008 - dovecot - dovecot.org

Re: [Dovecot] litte problems upgrade from 1.0.x to 1.1.1
by Andre Hübner 21 Jul '08

21 Jul '08

Hi, > Dovecot does not use mail messages to store folder meta-data as far as I > know > so I highly doubt this message was created by Dovecot (does Dovecot even > send > out messages except when going over quota?). Also notice the date of > 2006-09-18, which is almost two years in the past. The message was > probably > created by some client and was somehow (willingly) ignored or flagged as > deleted. Could be that upgrading Dovecot to 1.1 made the message visible > again for whatever reason. > and > Anyway, this is most certainly not a Dovecot-internal message. > this case is really suspicious to me. don't hang on the old date 2006-09-18. I can recreate it with dovecot 1.1.1 running on my machine. I create completly new mbox, write to it and when i view mbox in console i see just this mail. After deleting (pop3) this mail with our webmailer or OutLook Express etc. I see this internal message with current date. I do not belive in Clients that put internal mesages by pop3-protocol, but what should it be else? pop/imapserver is dovecot 1.1.1 And why this case just happens by updateing from 1.0.x to 1.1.1 and not during further updates from 1.0.x to 1.0.x+1 ? If you say this is not dovecot related i have to accept this but i am a little bit doubtful... Unfortunately i have now a more annoying error in imap processing. Sometimes it happens that dovecot seems to be out of sync. My Log says: Jul 7 11:22:44 servername dovecot: IMAP(loginname): Next message unexpectedly lost from 156756352 Jul 7 11:22:44 servername dovecot: child 21652 (imap) killed with signal 11 Jul 4 13:41:09 servername dovecot: imap-login: Login: user=<loginname>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Jul 4 13:41:10 servername dovecot: IMAP(loginname): Next message unexpectedly lost from 156715931 Jul 4 13:41:10 servername dovecot: IMAP(loginname): Disconnected: Logged out bytes=459/3359 Jul 4 13:41:32 servername dovecot: imap-login: Login: user=<loginname>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Jul 4 13:41:32 servername dovecot: IMAP(loginname): Next message unexpectedly lost from 156715931 Jul 4 13:41:32 servername dovecot: IMAP(loginname): Next message unexpectedly lost from 156715931 Jul 4 13:41:32 servername dovecot: Panic: IMAP(loginname): file message-parser.c: line 770 (message_parser_parse_next_block): assertion failed: (ctx->input->eof || ctx->input->closed || ctx->input->stream_errno != 0 || ctx->broken) Jul 4 13:41:32 dd10636 dovecot: IMAP(loginname): Raw backtrace: imap [0x80c2cf0] -> imap [0x80c2d4a] -> imap [0x80c265c] -> imap(message_parser_parse_body+0) [0x80bbfa0] -> imap(index_mail_cache_parse_continue+0x22) [0x8087172] -> imap(mbox_save_continue+0x9c) [0x807054c] -> imap(mail_storage_copy+0xe4) [0x8091684 ] -> /usr/lib/dovecot/imap/lib20_mail_log_plugin.so [0xb7f5ed1a] -> imap(cmd_copy+0x1d2) [0x805a1c2] -> imap [0x805edfc] -> imap [0x805eea5] -> imap [0x805f65 5] -> imap(client_input+0x5e) [0x805f86e] -> imap(io_loop_handler_run+0x100) [0x80ca590] -> imap(io_loop_run+0x28) [0x80c9738] -> imap(main+0x46b) [0x806736b] -> /lib/libc.so.6(__libc_start_main+0xdc) [0xb7e4887c] -> imap [0x8059211] Jul 4 13:41:32 dd10636 dovecot: child 10768 (imap) killed with signal 6 Hmm, if we got more errors with 1.1.1 on our servers we have to downgrade to 1.0.15 and stop installing new version and wait for 1.1.x alltogether we have ~2000 servers, but most of them are running still 1.0.x This is my configure-line, dovecot is packaged by my self ./configure \ --prefix=/usr \ --sysconfdir=/etc \ --localstatedir=/var \ --mandir=/usr/share/man \ --with-ssl=openssl \ --with-storages=mbox,maildir,raw \ --with-pam \ --with-passwd This is my dovecot.conf ## Dovecot configuration file #protocols = imap imaps pop3 pop3s protocols = imap imaps pop3 pop3s ssl_disable = no ssl_cert_file = "/path/*.domainname.crt" ssl_key_file = "/path/*.domainname.com.key" ssl_ca_file = "/path/*.domainname.com.bundle.crt" disable_plaintext_auth = no syslog_facility = mail login_user = dovecot login_process_per_connection = no login_processes_count = 1 login_greeting = domainname.com mailserver ready. login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c login_log_format = %$: %s max_mail_processes = 100 verbose_proctitle = yes auth_verbose = yes mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u #default_mail_env = mbox:~/mail:INBOX=/var/spool/mail/%u mail_cache_min_mail_count = 30 mmap_disable=no mail_debug=no lock_method = flock mbox_read_locks = dotlock mbox_write_locks = dotlock fcntl mbox_dirty_syncs = yes mbox_very_dirty_syncs = yes mbox_lazy_writes = no ## ## IMAP specific settings ## protocol imap { login_executable = /usr/libexec/dovecot/imap-login imap_client_workarounds = outlook-idle netscape-eoh tb-extra-mailbox-sep delay-newmail mail_plugins = mail_log } ## ## POP3 specific settings ## protocol pop3 { ssl_disable = no login_executable = /usr/libexec/dovecot/pop3-login mail_executable = /usr/libexec/dovecot/pop3 pop3_no_flag_updates = no pop3_uidl_format = %08Xu%08Xv pop3_client_workarounds = oe-ns-eoh outlook-no-nuls } System is suse 10.1 Thank you Andre

2 5

[Dovecot] recursive acl problem
by Robert Schetterer 21 Jul '08

21 Jul '08

Hi, i ve got a problem with recursive acl, using not a vfile global backend. ( no default acl) In my understanding every folder(directory) needs a seperate dovecot-acl files with permissions. This works fine, but my tests showed using a shared namespace like i.e. namespace shared { separator = / prefix = "users/%d/" location = dbox:/usr/local/virtual/%d/ inbox = no list = yes subscriptions = yes hidden = no } and have dovecot-acl in usr/local/virtual/%d/ with authenticated l which means lookup, leads that all folders and subfolders of /usr/local/virtual/%d/%u/ are imap browseable, which means its recursive somekind. ( people will not like seeing folder names of their mailboxes until they dont gave permissions explicit to others) In my meaning this shouldnt be so only names of ( names of directories) at /usr/local/virtual/%d/%u/ should be shown , subfolders in them should only be imap browseable if there is another dovecot-acl in them which permits lookup i may fail here , anyone which has some enlightment for me outside? -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 3

[Dovecot] Mails "invisible" (index corrupted?)
by Patrick Nagel 21 Jul '08

21 Jul '08

Hi, I got a complaint from a user today, that a few mails "disappeared" from her Inbox, both when accessing via IMAP with Thunderbird and in the IMAP Webmail client (RoundCube Webmail, caching deactivated). Searching (in Subject or From header) within the Inbox turned up the missing messages though. After checking all relevant client settings (filter rules etc.), restarting Thunderbird multiple times, etc., I tried deleting her dovecot.index.cache file, restarting Thunderbird again, but that didn't change anything. Only after deleting dovecot.index.*, everything went back to normal. I can't find anything useful in the log. Setup: x86, CentOS Linux, dovecot 1.1.1 (current stable binary from ATrpms), maildir storage, mail_debug is turned on Any hints on what could have caused this? Where to look? I backed up dovecot.index, dovecot.index.cache and dovecot.index.log before I deleted them, but they probably contain sensitive information, so I won't post them to the list. Thanks, Patrick. -- STAR Software (Shanghai) Co., Ltd. http://www.star-group.net/ Phone: +86 (21) 3462 7688 x 826 Fax: +86 (21) 3462 7779 PGP key: https://stshacom1.star-china.net/keys/patrick_nagel.asc Fingerprint: E09A D65E 855F B334 E5C3 5386 EF23 20FC E883 A005

2 3

[Dovecot] Multiple quota roots with quota-fs backend
by Ralf Becker 21 Jul '08

21 Jul '08

Today I've tried to configure multiple filesystem quotas, with some strange results. These are my two filesystems; both using quotas: * /dev/mail mounted to /var/spool/mail using AIX quotas for all users. Mailbox format is 'mbox' and they are named '/var/spool/mail/<logname>' * filer0:/vol/home mounted to /home/f0 via nfs using netapp quotas for all users. Mailboxes are all 'mbox' and located in '~<logname>/Mail' I've configured _two_ quota roots as described here: http://wiki.dovecot.org/Quota/FS?highlight=(two%20filesystems) plugin { quota = fs:Home:mount=/home/f0 quota2 = fs:Spool:mount=/var/spool/mail } This works like a charm, but when testing the configuration, the result was just surprising: * OK [CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS UIDPLUS LIST-EXTENDED I18NLEVEL=1 QUOTA AUTH=PLAIN] Dovecot ready. . login rfttest XXX . OK Logged in. . getquotaroot "INBOX" * QUOTAROOT "INBOX" "Home" "Spool" * QUOTA "Home" (STORAGE 310360 1048576) * QUOTA "Spool" (STORAGE 89708 1000000) . OK Getquotaroot completed. . getquotaroot "Trash" * QUOTAROOT "Trash" "Home" "Spool" * QUOTA "Home" (STORAGE 310360 1048576) * QUOTA "Spool" (STORAGE 89708 1000000) . OK Getquotaroot completed. . logout * BYE Logging out . OK Logout completed. You see, that _always_ both quota roots are reported, whether the references mailbox is actually placed on this filesystem or not. However reading RFC2087 confirms me in the idea, that just the _related_ quota roots should be listed: -------------------------------8<----------------------------------------- 4.3. GETQUOTAROOT Command Arguments: mailbox name Data: untagged responses: QUOTAROOT, QUOTA Result: OK - getquota completed NO - getquota error: no such mailbox, permission denied BAD - command unknown or arguments invalid The GETQUOTAROOT command takes the name of a mailbox and returns the list of quota roots for the mailbox in an untagged QUOTAROOT response. For each listed quota root, it also returns the quota root's resource usage and limits in an untagged QUOTA response. Example: C: A003 GETQUOTAROOT INBOX S: * QUOTAROOT INBOX "" S: * QUOTA "" (STORAGE 10 512) S: A003 OK Getquota completed ------------------------------->8----------------------------------------- So in my opinion correctly reported quota roots should look like this: * OK [CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS UIDPLUS LIST-EXTENDED I18NLEVEL=1 QUOTA AUTH=PLAIN] Dovecot ready. . login rfttest XXX . OK Logged in. . getquotaroot "INBOX" * QUOTAROOT "INBOX" "Spool" * QUOTA "Spool" (STORAGE 89708 1000000) . OK Getquotaroot completed. . getquotaroot "Trash" * QUOTAROOT "Trash" "Home" * QUOTA "Home" (STORAGE 310360 1048576) . OK Getquotaroot completed. . logout * BYE Logging out . OK Logout completed. Now I known what I want... but how to get it :-) While I see no way to use namespaces and/or quota rules to configure this behavior, patching quota.c, quota-fs.c and quota-private.h seems to be an option. A downside of this is, that I've to extend the quota plugin interface (quota_backend_vfuncs) defined in quota-private.h by adding an new callback function. Since all other quota backends don't have this new function, they have to initialize it with NULL. So there are side effects to other quota backends. This is the reason why I want to discuss the above described problem (and solution) before posting my patch :-) Regards, Ralf -- ______________________________________________________________________ Dipl.-Inform. (FH) Ralf Becker Rechenzentrum (r/ft) der FH Trier (Network|Mail|Web|Firewall) University of applied sciences Administrator Schneidershof, D-54293 Trier Mail: beckerr(a)fh-trier.de Fon: +49 651 8103 499 WWW: http://www.fh-trier.de/~beckerr Fax: +49 651 8103 214 ______________________________________________________________________

2 9

[Dovecot] v1.1.1: Some files not created with dovecot-shared permissions
by Eduardo M KALINOWSKI 21 Jul '08

21 Jul '08

Hi, I use dovecot-shared to add read permissions to the group in my mail server, which uses virtual users. This is only to ease backups. However, a few files are not created with the permissions in dovecot-shared. I've seen this happen to 'subscriptions', 'maildirfolder' (when dovecot-shared exists; the change to correctly create maildirfolder in this case is very recent), and possibly 'maildirsize' (I'm not sure about this one, it might be exim that is creating it with wrong permissions.) This has been tested in recent snapshot package, from the Debian repository listed at http://wiki.dovecot.org/PrebuiltBinaries. Here's dovecot -n for reference: # 1.1.1: /etc/dovecot/dovecot.conf log_path: /var/log/dovecot/main.log info_log_path: /var/log/dovecot/info.log log_timestamp: %Y-%m-%d %H:%M:%S login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_processes_count: 1 first_valid_uid: 100 mail_privileged_group: mail mail_location: maildir:/home/vmail/%d/%n/INBOX:INDEX=/home/vmail/%d/%n/dovecotidx mail_plugins: quota imap_quota auth default: mechanisms: plain login cram-md5 passdb: driver: passwd-file args: username_format=%n /home/vmail/%d/db/passwd passdb: driver: pam userdb: driver: static args: uid=104 gid=8 home=/home/vmail/%d/%n userdb: driver: passwd socket: type: listen client: path: /var/run/dovecot/auth-client mode: 438 plugin: quota: maildir

2 3

[Dovecot] Upgrade to 1.1 maildir & shared folders problems
by sami＠medusa.tutka.fi 21 Jul '08

21 Jul '08

Hello, We recently upgraded to Dovecot 1.1 from 1.0.5 and we are having few issues: 1) Maildir's are not created anymore for new users if they dont excits, the directories where created before, is this a configuration issue? 2) Cannot subscribe to shared folders, if currently subscribed they work fine but cannot re-subscribe, also i noticed that the control directory for the namespace is not created anymore, before it was, any ideas? //sami conf: 1.1.1: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: ready. login_processes_count: 5 verbose_proctitle: yes first_valid_uid: 1000 mail_location: maildir:~/:INDEX=/var/dovecot/index/%u:CONTROL=/var/dovecot/control/%u mail_nfs_storage: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_process_size: 1024 mail_plugins(default): acl quota imap_quota mail_plugins(imap): acl quota imap_quota mail_plugins(pop3): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle, delay-newmail imap_client_workarounds(imap): outlook-idle, delay-newmail imap_client_workarounds(pop3): namespace: type: private separator: / location: maildir:~/:INDEX=/var/dovecot/index/%u:CONTROL=/var/dovecot/control/%u inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: shared/ location: maildir:/var/mail/jaetut:INDEX=/var/dovecot/jaetut/index/%u:CONTROL=/var/dovecot/jaetut/control/%u list: yes subscriptions: yes auth default: passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: prefetch plugin: quota: fs acl: vfile:/usr/local/etc/dovecot-acls

2 8

[Dovecot] How can i get original mail subject in sieve vacation?
by Zhang Huangbin 21 Jul '08

21 Jul '08

Hi, all. I want to mix some new words and original mail subject as vacation subject, how can i get original mail subject in sieve vacation? Original subject: Hello. Vacation subject: Auto-Reply msg: Hello. ^^^^^ New ^^^^^ ^Orig^ Thanks very much. -- Best Regards. Zhang Huangbin - iRedMail: Mail Server Solution for Red Hat(R) Enterprise Linux & CentOS 5.x: http://iRedMail.googlecode.com/

3 4

[Dovecot] AIX: mntctl implementation for NFS quota support
by Ralf Becker 21 Jul '08

21 Jul '08

Hi Timo, Hello list, I've played around with dovecot-1.1.1 on AIX to get quotas (especially NFS quotas) to work. I've found that dovecot doesn't implement handling of 'mntctl' and so it is unable to determine filesystem mountpoints on AIX correctly. Your'll find more information about 'mntctl' here: http://publib.boulder.ibm.com/infocenter/systems/index.jsp?topic=/com.ibm.a… Okay... I've added mntctl support to 'lib/mountpoint.c' today. My tests are looking good and so I'd like to share the patch. While I'm still not really familiar with dovecots memory management, I need someone who is familiar with it to have a look on my lines of code. Especially the usage or p_new, t_strconcat and p_free should be checked. :-) To activate the patch you have to add "#define HAVE_VMOUNT_H 1" do 'config.h'. Maybe someone wants to alter configure* to do this automatically? And of course Timo, if you find it useful, you may include the code in one of the next dovecot releases. Regards, Ralf -- ______________________________________________________________________ Dipl.-Inform. (FH) Ralf Becker Rechenzentrum (r/ft) der FH Trier (Network|Mail|Web|Firewall) University of applied sciences Administrator Schneidershof, D-54293 Trier Mail: beckerr(a)fh-trier.de Fon: +49 651 8103 499 Web: http://www.fh-trier.de/~beckerr Fax: +49 651 8103 214 PubKey: http://www.fh-trier.de/~beckerr Crypto: GnuPG, S/MIME ______________________________________________________________________ Wenn Gott gewollt haette, dass E-Mail in HTML geschrieben wuerden, endeten Gebete traditionell mit </amen>. (Tom Listen)

2 4

Re: [Dovecot] fs quota check with server does not support rquotad
by Grandy Fu 20 Jul '08

20 Jul '08

> > > So my understanding for now is this: > > /var/mail > --------- > * has quotas > * for mailboxes hosted by this file system 'getrootquota' should > report used/total quota sizes. > > /home/h1 > -------- > * has or has not quotas. This is the same, because if 'homesvr' > doesn't support rquota, you can't check or even ignore > them. > * for mailboxes hosted by this file system 'getrootquota' should > report nothing. > > Yes, this is my situation. > If this is correct, this problem should be covered by a patch I've send > to Timo two days ago. You may have a look at this: > > http://dovecot.markmail.org/message/7e6bev4l3hen57ii?q=Multiple+quota+roots… > > Great. d/led "dovecot-*quota*-*root*-matching.patch.gz " and patched. Here is my current configuration: mail_location = mbox:~/mail:INBOX=/var/mail/%u plugin { quota = fs:INBOX:mount=/var/mail } I don't know if I patched correctly or not. I have got this error when I login: ----------------------- dovecot: Jul 15 18:13:20 Info: imap-login: Login: user=<01234567g>, method=PLAIN, rip=158.132.10.68, lip=158.132.10.13 dovecot: Jul 15 18:13:21 Info: IMAP(01234567g): Loading modules from directory: /usr/local/.dovecot111.test/lib/dovecot/imap dovecot: Jul 15 18:13:21 Info: IMAP(01234567g): Module loaded: /usr/local/.dovecot111.test/lib/dovecot/imap/lib10_quota_plugin.so dovecot: Jul 15 18:13:21 Info: IMAP(01234567g): Module loaded: /usr/local/.dovecot111.test/lib/dovecot/imap/lib11_imap_quota_plugin.so dovecot: Jul 15 18:13:21 Info: IMAP(01234567g): Effective uid=3475, gid=70, home=/home/h1/sc/01234567g dovecot: Jul 15 18:13:21 Info: IMAP(01234567g): Quota root: name=INBOX backend=fs args=mount=/var/mail dovecot: Jul 15 18:13:21 Info: IMAP(01234567g): mbox: data=/home/h1/sc/01234567g/mail:INBOX=/var/mail/01234567g:INDEX=/localdisk/dovecot.cache/cache/01234567g dovecot: Jul 15 18:13:21 Info: IMAP(01234567g): fs: root=/home/h1/sc/01234567g/mail, index=/localdisk/dovecot.cache/cache/01234567g, control=, inbox=/var/mail/01234567g dovecot: Jul 15 18:13:21 Info: IMAP(01234567g): fs quota add storage dir = /home/h1/sc/01234567g/mail dovecot: Jul 15 18:13:21 Info: IMAP(01234567g): fs quota block device = homesvr:/h1 dovecot: Jul 15 18:13:21 Info: IMAP(01234567g): fs quota mount point = /home/h1 dovecot: Jul 15 18:13:21 Error: IMAP(01234567g): fcntl(0, F_GETFL) failed: Bad file number dovecot: Jul 15 18:13:21 Fatal: IMAP(01234567g): fd_set_nonblock(0) failed: Bad file number ------------------------------------------------------------

3 2

Re: [Dovecot] folder deletion fails dbox /more debug /solved
by Robert Schetterer 20 Jul '08

20 Jul '08

Patrick Nagel schrieb: > On Thu, 17 Jul 2008 00:19:34 +0200, Robert Schetterer > <robert(a)schetterer.org> wrote: >> as stated in http://wiki.dovecot.org/Clients >> with mbox and thunderbird >> >> You should enable tb-extra-mailbox-sep workaround for IMAP >> >> this fixes the problem for dbox too, >> wiki should be upgraded that way > > You could have just changed it yourself - it's a wiki. I made the change > just now (see > http://wiki.dovecot.org/Clients#head-a222c4ed77a12db48e855e2dccb24113b955c2…) > Hi Patrick, i wanted to wait until a statement from Timo, dbox should be more near to maildir ( in my understanding ) ,then to mbox , so i am a little suprised that this mbox fix works for dbox perhaps its simply a bug with dbox, meanwhile reading the list should be enough for info to dbox users, but anyway as its a wiki , if this info is somekind of false Timo is able to delete it in the future -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 1