September 2009 - dovecot

[Dovecot] fixing deleted-to-trash-plugin
by Lex Brugman 15 Sep '09

15 Sep '09

Hi, I'm currently trying to make the deleted-to-trash-plugin work with dovecot v1.2.4, without this plugin the trash mailbox is pretty useless with mail clients like Evolution and Outlook, I still can't believe this functionality isn't intergrated into dovecot since it doesn't even influence the operation of other mail clients that do support this option theirselfs (even when turned on, the plugin detects this and doesn't break the client's functionality). I have modified the plugin to run without errorsin 1.2.4, when using a mail client which doesn't support this feature in the client itself, (according to my debug and the mail-log plugin output) everything works, but the mails are deleted as expected but not visible in the Trash box, it looks like they where copied to /dev/null :P (even though the log output makes me think otherwise). Log output: Sep 09 20:21:09 IMAP(xxx(a)xxx.xxx): Info: opening Trash succeeded Sep 09 20:21:09 IMAP(xxx(a)xxx.xxx): Info: from INBOX to Trash, previous action from (null) Sep 09 20:21:09 IMAP(xxx(a)xxx.xxx): Info: copy: uid=11, dest=Trash, msgid=<7706BCE6-6882-473C-B7F3-62AE3F75F632(a)xxx.xxx>, size=1718 Sep 09 20:21:09 IMAP(xxx(a)xxx.xxx): Info: copying to Trash succeeded Sep 09 20:21:09 IMAP(xxx(a)xxx.xxx): Info: delete: uid=11, msgid=<7706BCE6-6882-473C-B7F3-62AE3F75F632(a)xxx.xxx> The clients I used to test: Evolution and Outlook (they both don't support this feature from the client) and the mail client on an iPhone (which does support this feature, the plugin detects that the client already copied the mail to the Trash box and skips it). I'm really stuck here :( no errors, the logs tell me everything went fine, but it didn't. The source is attached, any help is greatly appreciated! Gr, Lex Brugman

4 6

[Dovecot] Crash: imap process, Dovecot 1.2.4, related to ACLs (backtrace included)
by Andreas Ntaflos 14 Sep '09

14 Sep '09

Hi, I started experimenting with ACLs and found I could reliably and reproducibly crash the IMAP process when trying to create a subfolder of a folder that has has ACLs set. The folder is called "Sent" with an ACL of "owner lrwstipke". I wanted to be able to have certain folders the the user cannot delete but where subfolders can be created freely. Relevant information follows and I hope the backtrace is useful (lots of "value optimized out" entries). You can also find everything from below on <https://daff.pseudoterminal.org/misc/dovecot/>. Please tell me if I can provide more information. dovecot -n: =========== # 1.2.4: /usr/local/etc/dovecot.conf # OS: Linux 2.6.26-2-686 i686 Debian 5.0.2 log_timestamp: %Y-%m-%d %H:%M:%S protocols: managesieve imap imaps pop3 pop3s login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login mail_access_groups: mail mail_privileged_group: mail mail_location: maildir:~/Maildir mail_drop_priv_before_exec: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_plugins(default): autocreate acl mail_plugins(imap): autocreate acl mail_plugins(pop3): mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve namespace: type: public separator: . prefix: Public. location: maildir:/var/mail/public:CONTROL=~/Maildir/control/public:INDEX=~/Maildir/index/public list: yes namespace: type: private separator: . prefix: Backup. location: maildir:~/Maildir-backup hidden: yes list: no namespace: type: private separator: . inbox: yes list: yes subscriptions: yes lda: log_path: info_log_path: auth_socket_path: /var/run/dovecot/auth-master postmaster_address: postmaster(a)mailtest0.rise-s.com mail_plugins: sieve acl auth default: mechanisms: plain login passdb: driver: pam passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: static args: uid=vmail gid=vmail home=/var/vmail/%Ld/%Ln allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: sieve: ~/.dovecot.sieve sieve_dir: ~/sieve sieve_global_path: /etc/dovecot/sieve/default.sieve sieve_global_dir: /etc/dovecot/sieve/global/ sieve_before: /etc/dovecot/sieve/before/ autocreate: Trash autocreate2: Drafts autocreate3: Sent autocreate4: INBOX.Spam autosubscribe: Trash autosubscribe2: Drafts autosubscribe3: Sent autosubscribe4: INBOX.Spam acl: vfile:/etc/dovecot/acl Log entry: ========== Aug 28 01:08:01 mailtest0 dovecot: IMAP(andreas.ntaflos(a)example1.rise-s.com): Panic: file acl-backend-vfile.c: line 1124 (acl_backend_vfile_object_update): assertion failed: (!update->rights.global) Aug 28 01:08:01 mailtest0 dovecot: IMAP(andreas.ntaflos(a)example1.rise-s.com): Raw backtrace: imap [0x80f1ec1] -> imap [0x80f1f42] -> imap [0x80f18c9] -> /usr/local/lib/dovecot/imap/lib01_acl_plugin.so [0xb7dddcf6] -> /usr/local/lib/dovecot/imap/lib01_acl_plugin.so(acl_object_update+0x18) [0xb7ddb1a8] -> /usr/local/lib/dovecot/imap/lib01_acl_plugin.so [0xb7de2ac7] - > imap(cmd_create+0xf9) [0x80618d9] -> imap [0x80679fc] -> imap [0x8067a99] -> imap(client_handle_input+0x2d) [0x8067c0d] -> imap(client_input+0x5f) [0x806856f] -> imap(io_loop_handler_run+0xe0) [0x80fac40] -> imap(io_loop_run+0x20) [0x80fa0b0] -> imap(main+0x5ea) [0x807104a] -> /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5) [0xb7e15455] -> imap [0x8060291] Aug 28 01:08:01 mailtest0 dovecot: dovecot: child 1588 (imap) killed with signal 6 (core dumped) Backtrace: ========== #0 0xb7f70424 in __kernel_vsyscall () No symbol table info available. #1 0xb7e2a640 in raise () from /lib/i686/cmov/libc.so.6 No symbol table info available. #2 0xb7e2c018 in abort () from /lib/i686/cmov/libc.so.6 No symbol table info available. #3 0x080f1ed5 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:160 backtrace = 0x93e5628 "imap [0x80f1ec1] -> imap [0x80f1f42] -> imap [0x80f18c9] -> /usr/local/lib/dovecot/imap/lib01_acl_plugin.so [0xb7dddcf6] -> /usr/local/lib/dovecot/imap/lib01_acl_plugin.so(acl_object_update+0x18) [0xb"... #4 0x080f1f42 in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0xb7de3094 "file %s: line %d (%s): assertion failed: (%s)", args=0xbff8b9c4 "�3޷d\004") at failures.c:440 No locals. #5 0x080f18c9 in i_panic (format=0xb7de3094 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:207 No locals. #6 0xb7dddcf6 in acl_backend_vfile_object_update (_aclobj=0x942c270, update=0xbff8bad0) at acl-backend-vfile.c:1124 dotlock = <value optimized out> path = <value optimized out> i = <value optimized out> fd = <value optimized out> changed = <value optimized out> __PRETTY_FUNCTION__ = "acl_backend_vfile_object_update" #7 0xb7ddb1a8 in acl_object_update (aclobj=0x942c270, update=0xbff8bad0) at acl-api.c:122 No locals. #8 0xb7de2ac7 in acl_mailbox_create (storage=0x93f2c88, name=0x93f9d98 "Sent.2008", directory=false) at acl-storage.c:160 astorage = <value optimized out> ret = <value optimized out> #9 0x080618d9 in cmd_create (cmd=0x93f4ce0) at cmd-create.c:42 ns = <value optimized out> mailbox = 0x93f9d98 "Sent.2008" full_mailbox = 0x93f9d98 "Sent.2008" directory = <value optimized out> #10 0x080679fc in client_command_input (cmd=0x93f4ce0) at client.c:611 client = (struct client *) 0x93f48a0 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #11 0x08067a99 in client_command_input (cmd=0x93f4ce0) at client.c:660 client = (struct client *) 0x93f48a0 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #12 0x08067c0d in client_handle_input (client=0x93f48a0) at client.c:701 _data_stack_cur_id = 3 ret = false remove_io = <value optimized out> handled_commands = false __PRETTY_FUNCTION__ = "client_handle_input" #13 0x0806856f in client_input (client=0x93f48a0) at client.c:752 cmd = <value optimized out> output = (struct ostream *) 0x93f4a54 bytes = <value optimized out> __PRETTY_FUNCTION__ = "client_input" #14 0x080fac40 in io_loop_handler_run (ioloop=0x93ed9b0) at ioloop-epoll.c:208 ctx = (struct ioloop_handler_context *) 0x93edab8 event = (const struct epoll_event *) 0x93edaf8 list = (struct io_list *) 0x93f4ab0 io = (struct io_file *) 0x942c888 tv = {tv_sec = 1799, tv_usec = 999357} t_id = 2 msecs = <value optimized out> ret = 1 i = 0 j = 0 call = <value optimized out> #15 0x080fa0b0 in io_loop_run (ioloop=0x93ed9b0) at ioloop.c:335 No locals. #16 0x0807104a in main (argc=Cannot access memory at address 0x634 ) at main.c:327 No locals.

3 6

[Dovecot] Dovecot+PAM advice please?
by S. A. Woltering 14 Sep '09

14 Sep '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi all, sorry to bother you with this. I'm trying to set up an experimental system (which may become production if it ever gets off the ground) and it's not working. The short version: I'm trying to get Dovecot 1.2.4 to authenticate against a customised PAM module. In short, we're using a specialised OTP radius backend. One of my colleagues has coded up a PAM module for this backend. The IMAP service is on HP-UX11.23, IA64. The module is compiles into /usr/lib/security/hpux32 and is called "pam_cached_radius.so.0.0". The entry in /etc/pam.conf is: cached-radius auth required pam_cached_radius.so.0.0 The PAM module compiles OK, and my colleague's test suite (run, both as root and as our local "dovecot" user) works fine. When I use the following options in dovecot.conf: auth default { user = root mechanisms = plain passdb pam { args = cached-radius } userdb passwd { } } it fails leaving only the log entry below in syslog. Sep 14 09:15:15 elrond syslog: load_modules: can not open module /usr/lib/security/hpux32/pam_cached_radius.so.0.0 Sep 14 09:15:22 elrond syslog: load_modules: can not open module /usr/lib/security/hpux32/pam_cached_radius.so.0.0 (Always 2 entries). I appreciate that this probably isn't a dovecot issue per se, but it is suspicious that our test suite works and divecot can't access the module. I'd be most grateful if anyone could offer some possible avenues of investigation. Thanks, SAW - -- Steven-Ashley Woltering, MBCS, Systems Analyst, ECMWF, Shinfield Park, Reading, RG2 9AX, UK Tel.: +44 1189 499473 (internal x2473) Email: Steven.Woltering(a)ecmwf.int -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4-svn0 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iD8DBQFKrhHch854NVK99FMRAnUiAJ9nOhLkGPFLGhEnhIwbk5V5RvGfPACghZUc 8HWimxrolkqhBkkjPD4AtQw= =WmSS -----END PGP SIGNATURE-----

2 5

[Dovecot] fchown failed
by Frank Bonnet 14 Sep '09

14 Sep '09

Hello I occasionally get the following error in dovecot log I've replaced the username by xxxxxxx /user is the user's home directories place, does this means it must be owned by the "mail" group ? Sep 14 09:20:48 IMAP(xxxxxxx): Error: fchown(/user/xxxxxxx/.imap/INBOX/dovecot.index.tmp, -1, 8(mail)) failed: Operation not permitted (egid=3420(math), group based on /var/mail/xxxxxxx) Thanks

3 2

[Dovecot] Problems getting Dovecot to work.
by Mark Gillespie 14 Sep '09

14 Sep '09

Hi, having a nightmare trying to get dovecot working on my SheevaPlug (flash based ARM embedded device). I need to use virtual users, and I need to store all the mail on an external USB HDD (not in home directories which live in the limited flash space). However I can't even log in via telnet. I've followed the Wiki troubleshooting tips, and still no further forward. logging via telnet, I get: "user sheeva BAD Error in IMAP command received by server." the logs show: ubuntu dovecot: User sheeva is missing UID (see mail_uid setting) What do I need to do? I know basic Linux stuff, but I wouldn't call myself an expert, so please no tech talks!!! -- Using Opera's revolutionary e-mail client: http://www.opera.com/mail/

3 2

[Dovecot] file->buffer_offset + file->buffer->used == file->sync_offset
by Edgar Fuß 14 Sep '09

14 Sep '09

I got the following panic on 1.2.3: Panic: file mail-transaction-log-append.c: line 88 (log_buffer_move_to_memory): assertion failed: (file->buffer_offset + file->buffer->used == file->sync_offset) It's probably related to the file system holding the indexes being full.

2 2

[Dovecot] GSSAPI Authentication in v1.2.1
by Phillip Macey 13 Sep '09

13 Sep '09

In the release notes for v1.2.2, Timo said: > Found and fixes several v1.2-specific bugs. Hopefully it's now stable > for most people's usage. > > * GSSAPI: More changes to authentication. Hopefully good now. > What were the GSSAPI changes? I am having problems with _some_ of my users using GSSAPI auth. I am using version 1.2.1. The client (thunderbird) reports that the server does not support 'secure authentication'. When I switch on auth_debug in dovecot, I see errors such as these in the logs: Aug 3 16:45:57 fury dovecot: auth(default): client in: AUTH 1 GSSAPI service=imap lip=10.1.0.20 rip=10.8.5.72 lport=143 rport=4027 Aug 3 16:45:57 fury dovecot: auth(default): gssapi(?,10.8.5.72): Using all keytab entries Aug 3 16:45:57 fury dovecot: auth(default): client out: CONT 1 Aug 3 16:45:57 fury dovecot: imap-login: Disconnected: Input buffer full (auth failed, 1 attempts): method=GSSAPI, rip=10.8.5.72, lip=10.1.0.20 Other users work perfectly (eg. all of the user accounts I tested against). Would this have been a bug that was fixed in 1.2.2 or is it something else? If it is most likely something else, I will post `dovecot -n`. -- Thanks, Phill Macey

4 11

Re: [Dovecot] Global ACL configuration problems: mailboxes not visible , set ACLs not honoured
by Andreas Ntaflos 13 Sep '09

13 Sep '09

On Tuesday 01 September 2009 12:11:39 Thomas Leuxner wrote: > On Tue, Sep 01, 2009 at 11:34:16AM +0200, Andreas Ntaflos wrote: > > Is there anything more to it? I ask, because I can't seem to get it > > to work correctly using this approach with global ACLs. Problems > > include: > > > > - Can't get the mailboxes "Spam" and "Ham" under the "Public" > > namespace to show up in the mail client (Thunderbird, KMail, > > Horde/IMP) at all. These have the ACL "authenticated lrwstipk" set > > so the should be visible to authenticated clients, shouldn't they? > > All I see is the namespace with no mailboxes beneath it. > > Hi Andreas, > > did you try with enabling the logging option 'mail_debug = yes'? It > should then verbosely log ACLs read while accessing the folders. How > about the files 'dovecot-acl' and 'dovecot-acl-list'? Are they > present in your public root? The latter should have been > automatically created once the subdirs have working ACLs. Hi Thomas, thanks for your helpful reply. I hadn't thought of setting mail_debug, don't know why :) Now I can see more clearly. It seems that ACL files such as "/etc/dovecot/acls/Backup.received" or "/etc/dovecot/acls/Backup.sent" are read, but when accessing the actual mailbox Dovecot looks for a file "/etc/dovecot/acls/received" or "/etc/dovecot/acls/sent". I.e. the mailbox names *without* the namespace prefix. This can't be the desired behaviour, can it? When I create such an ACL file (""/etc/dovecot/acls/sent") the defined restrictions seem to be applied. At least KMail doesn't even offer to "Delete message" anymore. Thunderbird does and messages can apparently be deleted, but they show up again upon reloading the folder. This is probably a Thunderbird issue. Horde/IMP is similar in this regard. The Public namespace however doesn't seem to be given any consideration at all by Dovecot. I can see the namespace root ("Public") in the folder subscription list, but nothing beneath it. Even when I apply the "fix" described in the previous paragraphs I still can't see any of the public folders. The log file doesn't show anything about this either. There are no "dovecot-acl" files at all, anywhere. I want to avoid having to use them, which is why I am trying to get global ACLs to work. The "dovecot-acl-list" files are created in every root directory, i.e. /var/mail/public/dovecot-acl-list, /var/vmail/example.org/username/Maildir/dovecot-acl-list and /var/vmail/example.org/username/Maildir-backup/dovecot-acl-list. All three are empty. So, the second issue (private namespace ACLs) could be a bug in Dovecot, unless I misunderstood how to name ACL files for mailboxes in other private namespaces. The first issue (invisibility of public folders) is still a mystery to me. Ideas? Thanks again for your reply! Andreas -- Andreas Ntaflos Vienna, Austria GPG Fingerprint: 6234 2E8E 5C81 C6CB E5EC 7E65 397C E2A8 090C A9B4

3 2

[Dovecot] Question regarding reverse quota_warning
by jeroen＠intuxicated.org 13 Sep '09

13 Sep '09

Hi Everyone, I have a question regarding reverse quota_warnings. I'm building a new setup, and I would like to block sending messages if a person is over his/her quota limit. Although this can be accomplished using a quota_warning script, I can't find how to accomplish the reverse. Has anyone tried to do something like this? By looking at the source code: ---- quote ---- if ((bytes_before < (uint64_t)warnings[i].rule.bytes_limit && bytes_current >= (uint64_t)warnings[i].rule.bytes_limit) || (count_before < (uint64_t)warnings[i].rule.count_limit && count_current >= (uint64_t)warnings[i].rule.count_limit)) { quota_warning_execute(root, warnings[i].command); break; } ----- /quote ----- I think it could be as simple as adding a second if statement and prefixing a string, but that's not a very clean solution. Best regards, Jeroen Koekkoek

2 1

[Dovecot] [DOVECOT] quota_warning threshold from ldap
by Emmanuel Gonzalez 13 Sep '09

13 Sep '09

Hello all, I'm trying to get dovecot read three different quota_warnings values directly from ldap. I configured correctly the quota_rule value, know I'm trying to override this values: quota_warning = storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2 = storage=80%% /usr/local/bin/quota-warning.sh 80 quota_warning3 = storage=70%% /usr/local/bin/quota-warning.sh 70 reading the values 95, 80 and 70 from ldap. I tried to do this in my dovecot-ldap.conf user_attrs = mailMessageStore=mail=maildir:/maildirs/%$,maildirquota=quota_rule=*:backend, *maildirwarn1*=quota_warning = storage=*maildirwarn1%% */usr/local/bin/quota-warning.sh *maildirwarn1%%* I'm sure that I'm doing something wrong. Any ideas? This is my configuration: # dovecot --version 1.2.4 # dovecot -n # 1.2.4: /etc/dovecot.conf # OS: Linux 2.6.18-128.7.1.el5PAE i686 CentOS release 5.3 (Final) log_path: /var/log/dovecot-deliver.log info_log_path: /var/log/dovecot-deliver.log log_timestamp: %Y-%m-%d %H:%M:%S listen(default): localhost:143 listen(imap): localhost:143 listen(pop3): *, [::] ssl: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login first_valid_uid: 8 first_valid_gid: 12 mail_privileged_group: mail mail_uid: 8 mail_gid: 12 mail_location: maildir:~/Maildir mail_debug: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota acl imap_acl mail_plugins(imap): quota imap_quota acl imap_acl mail_plugins(pop3): mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: shared separator: / prefix: shared/%%u/ location: maildir:/maildirs/%%d/%%u/Maildir list: children lda: postmaster_address: postmaster(a)mydomain.it mail_plugins: quota log_debug: /var/log/dovecot-deliver.log auth_socket_path: /var/run/dovecot/auth-master auth default: default_realm: mydomain.it verbose: yes debug: yes passdb: driver: ldap args: /etc/dovecot-ldap.conf userdb: driver: passwd userdb: driver: ldap args: /etc/dovecot-ldap.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: mail group: mail plugin: quota: maildir acl: vfile acl_shared_dict: file:/maildirs/shared-mailboxes # grep -v '^ *$#.*$\?$' /etc/dovecot-ldap.conf hosts = localhost sasl_bind = no auth_bind = yes ldap_version = 3 base = dc=mydomain,dc=it scope = subtree user_attrs = mailMessageStore=mail=maildir:/maildirs/%$,maildirquota=quota_rule=*:backend user_filter = (&(objectClass=inetOrgPerson)(mail=%u)) pass_attrs = mail=user,userPassword=password,mailMessageStore=userdb_home pass_filter = (&(objectClass=inetOrgPerson)(mail=%u)) Some important values from my ldap # /usr/lib/mozldap/ldapsearch -h localhost -D "cn=Directory Manager" -w XXXXXXXX -b "dc=mydomain,dc=it" "mail=user(a)mydomain.it" version: 1 dn: uid=user,ou=People,dc=mydomain.it,dc=mydomain,dc=it givenName: user mailProgramDeliveryInfo: /maildirs/ vacationMessage: Modificare questo messaggio mailMessageStore: mydomain.it/user(a)mydomain.it/Maildir/ uid: user mail: user(a)mydomain.it cn: user sn: user *maildirQuota: 51200S* *maildirwarn1: 70 maildirwarn2: 80 maildirwarn3: 90* mailHost: localhost mailmaxmessagesize: 10485760

2 1