- dovecot - dovecot.org

[Dovecot] mail_location in namespace
by Vasiliy Tolstov 27 Jul '09

27 Jul '09

Hello! I'm try to build additional 2 private namespaces namespace private { prefix = 1/ #location = ~/mail/1 list = yes subscriptions = yes } namespace private { prefix = 2/ #location = ~/mail/2 list = yes subscriptions = yes } First private namespace contains inbox and mail_location not defined (selects in sql query in userdb). Is dovecot have variable which contains current mail_location like current home? And if i have location = ~/mail/2 and subscrive to namespace in my mail client - i have error like mailbox does not exists. Where i must create folder fo what namespace? in ~/mail or ~/mail/mailboxes? Thank You. -- Vasiliy Tolstov <v.tolstov(a)selfip.ru> Selfip.Ru

2 1

[Dovecot] Newbie: unable to access mailbox more than once
by Matt Petoe 27 Jul '09

27 Jul '09

Hello, I'm using dovecot as a mail relay so that I can back up my providers IMAP mail locally. I'm impressed how easy this was to set up, but I'm having a quirk that I would like help with, if possible. There are many weak links in my set-up chain, if you will, but I think I've narrowed the problem. I'll describe my set-up anyway. I'm running dovecot 1.1.4 on ubuntu 8.10. I have a shared NAS drive running a NFS server. I have chosen to store the .indexes and .control directories on the NAS also, since I want a set-up that will remain backed up and easily replicated if I (accidentally) erase the ubuntu install in the future. I'm using imapsync to copy messages from my email provider. It works once only, and subsequent attempts seem to hang when accessing any local dovecot mailbox folders that were changed last time. I have succeeded in using Thunderbird to access the dovecot mailboxes once. I know the paths are being found, because I can 'list' mailboxes when I telnet locally: b list "" * * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "Drafts" * LIST (\HasNoChildren) "." "indexes" * LIST (\HasNoChildren) "." "control" * LIST (\HasNoChildren) "." "Junk" * LIST (\HasNoChildren) "." "Sent" * LIST (\HasNoChildren) "." "INBOX" * LIST (\HasNoChildren) "." "Trash-1000" b OK List completed. However, a 'select' command will only work for empty folders (such as .Trash). If I try to select a full folder such as ".Sent" then the process just hangs. The logs don't mention anything interesting, even though I have enabled debug_on and auth_debug. However, I attached a trace to the 'imap' process and got something interesting. I think maybe the lock process is failing for some reason? Here's a snip of the failure when selecting the .Sent folder: 12:00:21.190011 gettimeofday({1248141621, 190099}, NULL) = 0 12:00:21.190503 read(0, "f select Sent\r\n", 4034) = 15 12:00:21.190906 stat64("/mnt/Mail/.Sent/tmp", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 12:00:21.241561 stat64("/mnt/Mail/.indexes/.Sent", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 12:00:21.248325 stat64("/mnt/Mail/.Sent/dovecot-shared", 0xbf86c6c8) = -1 ENOENT (No such file or directory) 12:00:21.248847 time(NULL) = 1248141621 12:00:21.249060 open("/mnt/Mail/.indexes/.Sent/dovecot.index.log", O_RDWR|O_LARGEFILE) = 7 12:00:21.286953 fstat64(7, {st_mode=S_IFREG|0600, st_size=26472, ...}) = 0 12:00:21.287423 pread64(7, "\1\0\30\0\264:dJ\4\0\0\0\3\0\0\0\\\200\0\0\374?dJ", 24, 0) = 24 12:00:21.287696 stat64("/mnt/Mail/.indexes/.Sent/dovecot.index.log.2", 0xbf86c5ac) = -1 ENOENT (No such file or directory) 12:00:21.288070 open("/mnt/Mail/.indexes/.Sent/dovecot.index.log.2", O_RDWR|O_LARGEFILE) = -1 ENOENT (No such file or directory) 12:00:21.288614 open("/mnt/Mail/.indexes/.Sent/dovecot.index", O_RDWR|O_LARGEFILE) = 9 12:00:21.296814 alarm(60) = 0 12:00:21.297181 fcntl64(9, F_SETLKW64, {type=F_RDLCK, whence=SEEK_SET, start=0, len=0} I have set the locks to dotlock_try followed by fcntl. The trace above seemed to fail with the dotlock, and proceed to fcntl? Here is the output from dovecot -n # 1.1.4: /etc/dovecot/dovecot.conf log_path: /var/log/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_greeting_capability: yes mail_max_userip_connections: 0 mail_privileged_group: mail mail_location: maildir:/mnt/Mail:INBOX=/mnt/Mail/.INBOX:INDEX=/mnt/Mail/.indexes/:CONTROL=/mnt/Mail/.control mail_debug: yes mail_full_filesystem_access: yes mmap_disable: yes dotlock_use_excl: no mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock maildir_stat_dirs: yes mbox_read_locks: dotlock_try fcntl mbox_write_locks: dotlock_try fcntl imap_client_workarounds: tb-extra-mailbox-sep auth default: verbose: yes debug: yes passdb: driver: pam userdb: driver: passwd Sorry if this is a long post. The summary, I guess, is that I can't access mailbox folders with emails inside. I'm very new at all this, and only got this far from the excellent wiki. But now I'm stumped. Thanks heaps, Matt P

3 4

[Dovecot] lazy expunge - how to unset deleted imap flag
by Colo Colo 27 Jul '09

27 Jul '09

Hello, I am using dovecot 1.1.13 in debian lenny with exim4 and I have Outlook 2007 clients. I have configured lazy expunge plugin. User marks messages in INBOX for deletion then click "delete messages from server" then the messages are moved to .EXPUNGED folder which is correct but they are still marked with IMAP deleted flag which is bad cause when user marks another messages in INBOX for deletion and click again on "delete messages from server" the messages which were in .EXPUNGE are gone forever. Is there any possibility to change this behavior i.e. instead from: move messages tagged for deletion to .EXPUNGE folder to: move messages tagged for deletion to .EXPUNGE folder and UNSET deleted flag ? Thanx

2 1

[Dovecot] Public mailboxes with ACL in 1.2
by sstrickroth＠trg-oha.de 27 Jul '09

27 Jul '09

Hi, I'm new to Dovecot 1.2 and I'd like to replace uw-imap. I'd like to have the following setup: - Personal mailboxes using maildir for all users (no problem) - Public mailboxes for certain people who are in special groups from /etc/group localed in /var/spool/public as a maildir with subfolders for each group (which should only be visible for that group and also secured by filesystem group permissions). At best those folders should be visible for the users below "shared"-folder or parallel to the inbox. The public mailboxes should be secured by custom ACLs (so that not all ppl. can create new folders and so on). How can I make Dovecot authenticate against pam and use groups in /etc/group? When I activate the ACL plugin all public or shared mailboxes are hidden. How can I avoid this for the public mailboxes? Thanks in advance. Sven

3 2

[Dovecot] Search fails on underscores in quoted-printable
by Andreas M. Kirchwitz 27 Jul '09

27 Jul '09

Hi folks, currently I'm running Dovecot 1.2.1. Compiled from source on Fedora 10 Linux 32 Bit (all patches). Clients are Pine 4.64, Thunderbird 2.0.0.22 and Mutt 1.5.20 (using "=b" for server-side searching). When a message contains the text "under_score" and I let the server search for it, Dovecot does not find it in messages with a Content-Transfer-Encoding of "quoted-printable". It works perfectly well with messages without Content-Transfer-Encoding. If I replace the underscore with a space (search for "under score"), it magically matches on "under_score" (no space but underscore). Looks like something goes wrong with the encoding/decoding of quoted-printable (sorry, haven't tried with base64). Example: Dovecot does not find "under_score" | Date: Fri, 24 Jul 2009 02:08:45 +0200 | From: "Andreas M. Kirchwitz" <amk(a)krell.zikzak.de> | To: "Andreas M. Kirchwitz" <amk(a)krell.zikzak.de> | MIME-Version: 1.0 | Content-Type: text/plain; charset=iso-8859-1 | Content-Disposition: inline | Content-Transfer-Encoding: quoted-printable | | test for under_score and dovecot search (=E4=F6=FC=DF) Example: Dovecot find's "under_score" without problems | Date: Fri, 24 Jul 2009 02:10:26 +0200 | From: "Andreas M. Kirchwitz" <amk(a)krell.zikzak.de> | To: "Andreas M. Kirchwitz" <amk(a)krell.zikzak.de> | MIME-Version: 1.0 | Content-Type: text/plain; charset=us-ascii | Content-Disposition: inline | | test for under_score and dovecot search (1234) The problem is not new to Dovecot 1.2.1 but exists in the 1.1 series as well. Greetings, Andreas

2 1

[Dovecot] Handling of file "maildirsize"
by Frank Elsner 26 Jul '09

26 Jul '09

Hello, My "exim" is doing the deliveries, "dovecot" handles POP/IMAP. Exim Log shows: 2009-07-24 14:03:40 1MUJUy-0001Jr-B0 == user(a)domain.tu-berlin.de R=maildir_user T=maildir_delivery defer (2): No such file or directory: while opening or reading /var/Mail/Boxes/u/user/maildirsize 2009-07-24 14:20:32 1MUJUy-0001Jr-B0 => user <user(a)domain.tu-berlin.de> F=<user(a)domain.tu-berlin.de> R=maildir_user T=maildir_delivery S=2061 QT=16m52s DT=0s The user was active using IMAP at 14:03:4*. Therefor there must be a short period of time where no maildirsize exists. Can this really happen? If yes, could this behaviour be changed? Kind regards, Frank Elsner

2 1

[Dovecot] Dovecot 1.2, quota and LDAP
by Stian Jordet 26 Jul '09

26 Jul '09

Hi! I'm in the progress of upgrading from Dovecot 1.0.15 to 1.2.1. This has gone pretty smooth. I just have one question to check wether I have understood the documentation right. I have both system users and virtual users. That's easy to do when using LDAP for userdb. The system users use filesystems quota, the virtual users use maildir quota. I achieved this using the following in LDAP: "fs:" (for system users, obviously) and "maildir:storage=2048000" for virtual users. This has worked fine for years. But after reading the documentation, it seems I now have to use two ldap-fields to achieve the same thing? One "quota" and one "quota_rule"? Is this correct? It's of course not impossible, but it's kinda a hassle to hand craft a new schema, deploy, and update all the user's entries. If my users didn't have two kind of quotas, it would be easy, but with two quota methods, I don't see any other way than to use two ldap-fields. Which I hope I don't have to :) Thanks. Regards, Stian

2 1

[Dovecot] configure performs checks for not needed sasl headers
by Pascal Volk 26 Jul '09

26 Jul '09

Hi, I'm always surprised when I see output from configure like checking for really_not_needed.h... no The configure script is always 'checking sasl.h usability' even when the --without-ldap option was specified. The attached patch checks the presence of sasl.h / sasl/sasl.h only when using the --with-ldap option && all required LDAP headers and libs are available. Regards, Pascal -- The trapper recommends today: 5e1f1e55.0920700(a)localdomain.org

2 1

[Dovecot] dovecot-1.2 changeset: 9238:1eb00fd62d1c causes a compiler warning
by Pascal Volk 26 Jul '09

26 Jul '09

Hi Timo, gcc tells me: main.c: In function ‘main_init’: main.c:182: warning: suggest parentheses around comparison in operand of & src/imap/main.c:182: if (username == NULL & IS_STANDALONE()) Regards, Pascal -- The trapper recommends today: cafebabe.0920623(a)localdomain.org

2 1

[Dovecot] dovecot-1.2 with managesieve patch: imap crash with backtrace
by Ralf Hildebrandt 25 Jul '09

25 Jul '09

Log: Jul 25 10:18:18 postamt dovecot: IMAP(virus-al): /home/v/i/virus-al/Maildir/dovecot-uidlist: next_uid was lowered (216 -> 2) Jul 25 10:18:18 postamt dovecot: IMAP(virus-al): Panic: file index-sync.c: line 25 (index_mailbox_set_recent_uid): assertion failed: (seq_range_exists(&ibox->recent_flags, uid)) Jul 25 10:18:18 postamt dovecot: IMAP(virus-al): Raw backtrace: imap [0x80efdb1] -> imap [0x80efe22] -> imap [0x80ef7c9] -> imap [0x80ac371] -> imap(index_mailbox_set_recent_seq+0x40) [0x80ac3c0] -> imap(maildir_sync_index+0xa8a) [0x808799a] -> imap [0x80860d9] -> imap(maildir_storage_sync_init+0x125) [0x8086495] -> imap(imap_sync_init+0x54) [0x806fe14] -> imap(cmd_sync_delayed+0x1fb) [0x80700eb] -> imap(client_handle_input+0x1b4) [0x8067874] -> imap(client_input+0x5f) [0x806802f] -> imap(io_loop_handler_run+0xe0) [0x80f8980] -> imap(io_loop_run+0x20) [0x80f7df0] -> imap(main+0x5dd) [0x807093d] -> /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5) [0xb7e9f775] -> imap [0x805ffa1] Jul 25 10:18:19 postamt dovecot: dovecot: child 20255 (imap) killed with signal 6 (core dumped) Backtrace: ----- Forwarded message from root <root(a)postamt.charite.de> ----- GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu"... Reading symbols from /lib/i686/cmov/libdl.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libdl-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libdl.so.2 Reading symbols from /lib/i686/cmov/libc.so.6...Reading symbols from /usr/lib/debug/lib/i686/cmov/libc-2.9.so...done. done. Loaded symbols for /lib/i686/cmov/libc.so.6 Reading symbols from /lib/ld-linux.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.9.so...done. done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /usr/local/lib/dovecot/imap/lib10_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib10_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib11_trash_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib11_trash_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_autocreate_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_autocreate_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_fts_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_fts_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_zlib_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_zlib_plugin.so Reading symbols from /usr/lib/libz.so.1...done. Loaded symbols for /usr/lib/libz.so.1 Reading symbols from /lib/libbz2.so.1.0...done. Loaded symbols for /lib/libbz2.so.1.0 Reading symbols from /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so Reading symbols from /lib/libgcc_s.so.1...done. Loaded symbols for /lib/libgcc_s.so.1 Core was generated by `imap [virus-al 127.0.0.1]'. Program terminated with signal 6, Aborted. [New process 20255] #0 0xb7ff9424 in __kernel_vsyscall () #0 0xb7ff9424 in __kernel_vsyscall () No symbol table info available. #1 0xb7eb4680 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 resultvar = <value optimized out> pid = -1208070156 selftid = 20255 #2 0xb7eb7d68 in *__GI_abort () at abort.c:88 act = {__sigaction_handler = {sa_handler = 0x9481170, sa_sigaction = 0x9481170}, sa_mask = {__val = {3214601656, 135190698, 3086894816, 0, 3214601776, 3214601764, 512, 0, 0, 3214601840, 3087103600, 134566434, 639, 0, 0, 0, 1, 135263774, 512, 1, 3214601764, 155717968, 69, 3214601892, 3214601736, 135192294, 155718639, 3214601764, 3214601768, 640, 155718000, 3086337251}}, sa_flags = 640, sa_restorer = 0x81052c9 <write_full+57>} sigs = {__val = {32, 0 <repeats 31 times>}} #3 0x080efdc5 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:160 backtrace = 0x9480d40 "imap [0x80efdb1] -> imap [0x80efe22] -> imap [0x80ef7c9] -> imap [0x80ac371] -> imap(index_mailbox_set_recent_seq+0x40) [0x80ac3c0] -> imap(maildir_sync_index+0xa8a) [0x808799a] -> imap [0x80860d9] ->"... #4 0x080efe22 in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0x8107dec "file %s: line %d (%s): assertion failed: (%s)", args=0xbf9aef04 "�W\021\b\031") at failures.c:440 No locals. #5 0x080ef7c9 in i_panic ( format=0x8107dec "file %s: line %d (%s): assertion failed: (%s)") at failures.c:207 No locals. #6 0x080ac371 in index_mailbox_set_recent_uid (ibox=0x9494e48, uid=1) at index-sync.c:25 __PRETTY_FUNCTION__ = "index_mailbox_set_recent_uid" #7 0x080ac3c0 in index_mailbox_set_recent_seq (ibox=0x9494e48, view=0x94a5398, seq1=2, seq2=2) at index-sync.c:42 uid = 1 #8 0x0808799a in maildir_sync_index (ctx=0x9497868, partial=true) at maildir-sync-index.c:554 mbox = (struct maildir_mailbox *) 0x9494e48 view = (struct mail_index_view *) 0x9497750 view2 = (struct mail_index_view *) 0x94a5398 iter = (struct maildir_uidlist_iter_ctx *) 0x0 trans = (struct mail_index_transaction *) 0x94cda78 hdr = (const struct mail_index_header *) 0x94a4860 empty_hdr = {major_version = 1 '\001', minor_version = 0 '\0', base_header_size = 0, header_size = 7687, record_size = 100, compat_flags = 0 '\0', unused = "\000\000", indexid = 0, flags = 0, uid_validity = 82, next_uid = 0, messages_count = 4096, unused_old_recent_messages_count = 8, seen_messages_count = 0, deleted_messages_count = 1248509898, first_recent_uid = 0, first_unseen_uid_lowwater = 1248509898, first_deleted_uid_lowwater = 0, log_file_seq = 1248509898, log_file_tail_offset = 0, log_file_head_offset = 6334852, sync_size = 13806612332261933056, sync_stamp = 155806360, day_stamp = 3214602280, day_first_uid = {135194511, 155806360, 155812344, 3214602456, 134786544, 3214602436, 0, 0}} rec = <value optimized out> seq = 1 seq2 = 2 uid = 216 prev_uid = 216 uflags = MAILDIR_UIDLIST_REC_FLAG_RECENT filename = 0x94c96a0 "1248509847.M937495P31850.postamt.charite.de,S=3162,W=3225" uid_validity = 1248509847 next_uid = <value optimized out> hdr_next_uid = 217 first_recent_uid = 1 first_uid = 1 changes = 0 ret = 0 time_before_sync = 1248509898 st = {st_dev = 120259084608, __pad1 = 1, __st_ino = 36200, st_mode = 135423264, st_nlink = 156032456, st_uid = 155714056, st_gid = 3214602360, st_rdev = 581638490132765024, __pad2 = 65024, st_size = 0, st_blksize = 6334504, st_blocks = 8589951424, st_atim = { tv_sec = 7687, tv_nsec = 100}, st_mtim = {tv_sec = 0, tv_nsec = 0}, st_ctim = {tv_sec = 0, tv_nsec = 274432}, st_ino = 17592186044416} expunged = 9 full_rescan = false __PRETTY_FUNCTION__ = "maildir_sync_index" #9 0x080860d9 in maildir_sync_context (ctx=0x9480208, forced=false, find_uid=0x0, lost_files_r=0xbf9af15b) at maildir-sync.c:857 sync_flags = 155805056 flags = 135317216 new_changed = true cur_changed = false lock_failure = false fname = 0x9494fe0 "/home/v/i/virus-al/Maildir" ret = <value optimized out> __PRETTY_FUNCTION__ = "maildir_sync_context" #10 0x08086495 in maildir_storage_sync_init (box=0x9494e48, flags=0) at maildir-sync.c:926 _data_stack_cur_id = 3 ctx = (struct maildir_sync_context *) 0x9480208 lost_files = <value optimized out> ret = 0 __PRETTY_FUNCTION__ = "maildir_storage_sync_init" #11 0x0806fe14 in imap_sync_init (client=0x948d350, box=0x9494e48, imap_flags=IMAP_SYNC_FLAG_SAFE, flags=0) at imap-sync.c:146 ctx = (struct imap_sync_context *) 0x94cea28 __PRETTY_FUNCTION__ = "imap_sync_init" #12 0x080700eb in cmd_sync_delayed (client=0x948d350) at imap-sync.c:591 cmd = <value optimized out> first_expunge = <value optimized out> first_nonexpunge = <value optimized out> __PRETTY_FUNCTION__ = "cmd_sync_delayed" #13 0x08067874 in client_handle_input (client=0x948d350) at client.c:728 ret = false remove_io = false handled_commands = true __PRETTY_FUNCTION__ = "client_handle_input" #14 0x0806802f in client_input (client=0x948d350) at client.c:752 cmd = <value optimized out> output = (struct ostream *) 0x948d504 bytes = <value optimized out> __PRETTY_FUNCTION__ = "client_input" #15 0x080f8980 in io_loop_handler_run (ioloop=0x9489d78) at ioloop-epoll.c:208 ctx = (struct ioloop_handler_context *) 0x9488a80 event = (const struct epoll_event *) 0x9488ac0 list = (struct io_list *) 0x948d588 io = (struct io_file *) 0x948d560 tv = {tv_sec = 1799, tv_usec = 999280} t_id = 2 msecs = <value optimized out> ret = 1 i = 0 j = 0 call = <value optimized out> #16 0x080f7df0 in io_loop_run (ioloop=0x9489d78) at ioloop.c:338 No locals. #17 0x0807093d in main (argc=) at main.c:323 No locals. $1 = {prev = 0x0, next = 0x0, client = 0x948d350, pool = 0x948d5c8, tag = 0x948d658 "a0398", name = 0x948d660 "NOOP", args = 0x0, cmd_flags = COMMAND_FLAG_BREAKS_SEQS, func = 0, context = 0x0, module_contexts = {arr = {buffer = 0x948d620, element_size = 4}, v = 0x948d620, v_modifiable = 0x948d620}, parser = 0x94925d0, state = CLIENT_COMMAND_STATE_WAIT_SYNC, sync = 0x948d668, uid = 0, cancel = 0, param_error = 0, search_save_result = 0, temp_executed = 0} (gdb) quit ----- End forwarded message ----- -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

1 0