January 2010 - dovecot

[Dovecot] Courier-to-Dovecot-migration: Outlook downloads all Mails again
by Werner 29 Jan '10

29 Jan '10

Hi everybody, I'm currently playing through the migration from Courier to dovecot. I've converted the User's Maildir with 'courier-dovecot-migrate.pl'. Outlook 2003 is configured to access the Mailbox via POP3, the option "Leave a copy of messages on the server" is activated. But: after the migration Outlook 2000 redownloads all mails again :-( Could it be, that Outlook 2000 "thinks" (after changing the POP3/SMTP-Server in the Outlook configuration pointing to my testsystem) this is a new system and starts to download the messages again? If so, Outlook 2000 won't download all messages again if we do the migration because POP3/SMTP-Server remains the same. Can anybody confirm this? We do not experience this issue with Thunderbird for example. Thank you, Werner

2 2

[Dovecot] virtual users with mysql
by Andre Hübner 28 Jan '10

28 Jan '10

Hello List, we use in our system cryptical Usernames for dovecot etc. and authenticate users against shadow/passwd User abcde is loging in and gets data from /var/spool/mail/abcde and /home/popuser/abcde Now we want to make it possible that users can log in also with emailadresses. I tried dovecot-mysql authentication which works fine but i do not find a way to use 2 different login-formats in my queries. login with abcde and also testname(a)example.com should return ok and lead to /var/spool/mail/abcde. Is this possible or i have to make a decision which format to use? Thanks, Andre

2 2

[Dovecot] assertion mail-transaction-log-view.c
by David Halik 28 Jan '10

28 Jan '10

I'm not sure how useful this is with optimization turned back on, but here it is anyway. This was just a one off that happened last night: Jan 27 20:49:05 gehenna17.rutgers.edu dovecot: IMAP(user): fscking index file /rci/nqu/rci/u2/user/dovecot/.INBOX/dovecot.index Jan 27 20:49:05 gehenna17.rutgers.edu dovecot: IMAP(user): Panic: file mail-transaction-log-view.c: line 108 (mail_transaction_log_view_set): assertion failed: (min_file_seq <= max_file_seq) Jan 27 20:49:05 gehenna17.rutgers.edu dovecot: IMAP(user): Raw backtrace: /usr/libexec/dovecot/imap [0x49ede0] -> /usr/libexec/dovecot/imap [0x49ee43] -> /usr/libexec/dovecot/imap [0x49e4a6] -> /usr/libexec/dovecot/imap(mail_transaction_log_view_set+0x4ac) [0x486e1c] -> /usr/libexec/dovecot/imap(mail_index_sync_have_any+0x8f) [0x47c2bf] -> /usr/libexec/dovecot/imap [0x43cb8a] -> /usr/libexec/dovecot/imap(maildir_storage_sync_init+0x14e) [0x43cf0e] -> /usr/libexec/dovecot/imap(imap_sync_init+0x67) [0x4283e7] -> /usr/libexec/dovecot/imap(cmd_sync_delayed+0x174) [0x428634] -> /usr/libexec/dovecot/imap(client_handle_input+0x19e) [0x420c5e] -> /usr/libexec/dovecot/imap(client_input+0x5f) [0x42164f] -> /usr/libexec/dovecot/imap(io_loop_handler_run+0xf8) [0x4a6c68] -> /usr/libexec/dovecot/imap(io_loop_run+0x1d) [0x4a5d7d] -> /usr/libexec/dovecot/imap(main+0x620) [0x428f30] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x3ba081d994] -> /usr/libexec/dovecot/imap [0x419ad9] #0 0x0000003ba0830265 in raise (sig=<value optimized out>) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 pid = <value optimized out> selftid = <value optimized out> #1 0x0000003ba0831d10 in abort () at abort.c:88 act = Could not find the frame base for "abort". sigs = Could not find the frame base for "abort". #2 0x000000000049eded in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:160 backtrace = 0x12be38a8 "/usr/libexec/dovecot/imap [0x49ede0] -> /usr/libexec/dovecot/imap [0x49ee43] -> /usr/libexec/dovecot/imap [0x49e4a6] -> /usr/libexec/dovecot/imap(mail_transaction_log_view_set+0x4ac) [0x486e1c] -> /us"... #3 0x000000000049ee43 in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=<value optimized out>, args=<value optimized out>) at failures.c:443 No locals. #4 0x000000000049e4a6 in i_panic (format=0x6 <Address 0x6 out of bounds>) at failures.c:207 args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fff2d949840, reg_save_area = 0x7fff2d949780}} #5 0x0000000000486e1c in mail_transaction_log_view_set (view=0x12c56ee0, min_file_seq=<value optimized out>, min_file_offset=9520, max_file_seq=95, max_file_offset=24636, reset_r=0x7fff2d9498cf) at mail-transaction-log-view.c:108 file = <value optimized out> files = <value optimized out> start_offset = <value optimized out> i = <value optimized out> seq = <value optimized out> ret = <value optimized out> __PRETTY_FUNCTION__ = "mail_transaction_log_view_set" #6 0x000000000047c2bf in mail_index_sync_have_any (index=<value optimized out>, flags=<value optimized out>) at mail-index-sync.c:506 view = (struct mail_index_view *) 0x12c56c40 #7 0x000000000043cb8a in maildir_sync_context (ctx=0x12be3728, forced=false, find_uid=0x0, lost_files_r=0x7fff2d949967) at maildir-sync.c:697 sync_flags = <value optimized out> flags = 314502464 new_changed = false cur_changed = false lock_failure = <value optimized out> fname = 0x49d85b "L\211�H\213\\$\bL\213d$\020H\203�\030�\017\037" ret = <value optimized out> __PRETTY_FUNCTION__ = "maildir_sync_context" #8 0x000000000043cf0e in maildir_storage_sync_init (box=0x12bf2a98, flags=0) at maildir-sync.c:924 _data_stack_cur_id = 3 mbox = <value optimized out> ctx = (struct maildir_sync_context *) 0x12be3728 lost_files = <value optimized out> ret = 0 __PRETTY_FUNCTION__ = "maildir_storage_sync_init" #9 0x00000000004283e7 in imap_sync_init (client=0x12beed40, box=0x12bf2a98, imap_flags=IMAP_SYNC_FLAG_SAFE, flags=0) at imap-sync.c:146 ctx = (struct imap_sync_context *) 0x12bf78b0 __PRETTY_FUNCTION__ = "imap_sync_init" #10 0x0000000000428634 in cmd_sync_delayed (client=<value optimized out>) at imap-sync.c:592 cmd = <value optimized out> first_expunge = <value optimized out> first_nonexpunge = (struct client_command_context *) 0x80 __PRETTY_FUNCTION__ = "cmd_sync_delayed" #11 0x0000000000420c5e in client_handle_input (client=0x12beed40) at client.c:729 remove_io = false handled_commands = true __PRETTY_FUNCTION__ = "client_handle_input" #12 0x000000000042164f in client_input (client=0x12beed40) at client.c:753 cmd = <value optimized out> output = (struct ostream *) 0x12bf00e8 bytes = 15 __PRETTY_FUNCTION__ = "client_input" #13 0x00000000004a6c68 in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:208 ctx = <value optimized out> event = (const struct epoll_event *) 0x12bec350 list = (struct io_list *) 0x12bf01c0 io = (struct io_file *) 0x12bfb760 tv = {tv_sec = 1799, tv_usec = 999417} events_count = <value optimized out> t_id = 2 msecs = <value optimized out> ret = 1 i = 0 call = <value optimized out> #14 0x00000000004a5d7d in io_loop_run (ioloop=0x12bec0f0) at ioloop.c:335 No locals. #15 0x0000000000428f30 in main (argc=<value optimized out>, argv=<value optimized out>, envp=0x7fff2d949c18) at main.c:327 No locals. -- ================================ David Halik System Administrator OIT-CSS Rutgers University dhalik(a)jla.rutgers.edu ================================

1 0

[Dovecot] Question about Pigeonhole for Dovecot v2.0 revision 1223:67f7f59671e8
by Jonathan Siegle 28 Jan '10

28 Jan '10

I'm looking for documentation on the testsuite program. The most useful piece would be a sample scriptfile.

2 4

[Dovecot] failed to stat user's sieve script
by Nick Lunt 28 Jan '10

28 Jan '10

Hi # dovecot --version 1.2.10 ==> /var/log/dovecot.log <== Jan 28 13:26:15 deliver(root): Info: Loading modules from directory: /usr/lib/dovecot/lda Jan 28 13:26:15 deliver(root): Info: Module loaded: /usr/lib/dovecot/lda/lib90_sieve_plugin.so Jan 28 13:26:15 deliver(root): Error: chdir(/root) failed: Permission denied Jan 28 13:26:15 deliver(root): Info: maildir: data=/root/Maildir Jan 28 13:26:15 deliver(root): Info: maildir++: root=/root/Maildir, index=, control=, inbox=/root/Maildir Jan 28 13:26:15 deliver(root): Error: sieve: failed to stat user's sieve script: stat(/root/.dovecot.sieve) failed: Permission denied (euid=99(nobody) egid=99(nobody) missing +x perm: /root) (using global script path in stead) Jan 28 13:26:15 deliver(root): Info: sieve: user has no valid personal script Jan 28 13:26:15 deliver(root): Info: sieve: no scripts to execute: reverting to default delivery. Jan 28 13:26:15 deliver(root): Error: stat(/root/Maildir) failed: Permission denied Jan 28 13:26:15 deliver(root): Info: Namespace : Using permissions from /root/Maildir: mode=0700 gid=-1 Jan 28 13:26:15 deliver(root): Error: stat(/root/Maildir/tmp) failed: Permission denied (euid=99(nobody) egid=99(nobody) missing +x perm: /root) Jan 28 13:26:15 deliver(root): Info: msgid=<201001281326.o0SDQFMO018304(a)psl-dev.patech-solutions.com>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2010-01-28 13:26:15] I cannot send email to the root user on the box. I can send email to other users on the box. Root user does not have a .dovecot.sieve. Dovecot created ~user/Maildir fine, but will not create /root/Maildir. Permissions on ~user directory: drwx------ 6 nickl nickl 4096 Jan 28 13:07 /home/nickl/ Permissions on /root directory: drwxr-x--- 20 root root 4096 Jan 28 13:24 /root/ Running dovecot with postfix, mailbox_command = /usr/libexec/dovecot/deliver . This is all running fine for the user but not for root. I don't want dovecot-sieve to work on root's emails anyway, just the users. Dovecot settings: # dovecot -n # 1.2.10: /etc/dovecot.conf # OS: Linux 2.6.18-128.el5 x86_64 Red Hat Enterprise Linux Server release 5.3 (Tikanga) log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot.log ssl: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_access_groups: mail mail_privileged_group: mail mail_location: maildir:~/Maildir mail_debug: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 lda: postmaster_address: root@localhost mail_plugins: sieve auth default: debug: yes passdb: driver: pam userdb: driver: passwd plugin: sieve: ~/.dovecot.sieve sieve_dir: ~/ log_path: /var/log/dovecot.log Any help appreciated, I only started using dovecot yesterday and it's a learning curve trying to get dovecot-sieve to work. Thanks Nick. __________ Information from ESET NOD32 Antivirus, version of virus signature database 4813 (20100128) __________ The message was checked by ESET NOD32 Antivirus. http://www.eset.com

3 4

[Dovecot] Cannot get dovecot-sieve to work
by Nick Lunt 28 Jan '10

28 Jan '10

Hi all # dovecot --version 1.2.10 # dovecot -n # 1.2.10: /etc/dovecot.conf # OS: Linux 2.6.18-128.el5 x86_64 Red Hat Enterprise Linux Server release 5.3 (Tikanga) log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot.log ssl: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: mbox:~/mail:INBOX=/var/mail/%u mail_debug: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 lda: mail_plugins: sieve auth default: debug: yes passdb: driver: pam userdb: driver: passwd plugin: sieve: ~/.dovecot.sieve sieve_dir: ~/ log_path: /var/log/dovecot.log Here is my ~/.dovecot.sieve $ cat .dovecot.sieve require "fileinto"; if not header :contains "subject" "GRE:99" { discard; stop; } else { keep; } I only want to accept emails with GRE:99 as the subject, I'm not interested in any other mails. However when I send myself an email via the mail command all emails go into my INBOX whatever the subject is. I don't really get any info in the logs either: Jan 27 17:34:20 dovecot: Info: Dovecot v1.2.10 starting up (core dumps disabled) Jan 27 17:34:21 auth(default): Info: new auth connection: pid=495 Jan 27 17:34:21 auth(default): Info: new auth connection: pid=496 Jan 27 17:34:21 auth(default): Info: new auth connection: pid=497 Jan 27 17:34:21 auth(default): Info: new auth connection: pid=498 Jan 27 17:34:21 auth(default): Info: new auth connection: pid=499 Jan 27 17:34:21 auth(default): Info: new auth connection: pid=500 Jan 27 17:34:32 auth(default): Info: client in: AUTH 1 PLAIN service=imap lip=192.168.10.208 rip=192.168.10.207 lport=143 rport=22688 resp=<hidden> Jan 27 17:34:32 auth-worker(default): Info: pam(nickl,192.168.10.207): lookup service=dovecot Jan 27 17:34:32 auth-worker(default): Info: pam(nickl,192.168.10.207): #1/1 style=1 msg=Password: Jan 27 17:34:32 auth(default): Info: client out: OK 1 user=nickl Jan 27 17:34:32 auth(default): Info: master in: REQUEST 1 500 1 Jan 27 17:34:32 auth(default): Info: passwd(nickl,192.168.10.207): lookup Jan 27 17:34:32 auth(default): Info: master out: USER 1 nickl system_groups_user=nickl uid=503 gid=503 home=/home/nickl Jan 27 17:34:32 imap-login: Info: Login: user=<nickl>, method=PLAIN, rip=192.168.10.207, lip=192.168.10.208 Jan 27 17:34:32 IMAP(nickl): Info: Effective uid=503, gid=503, home=/home/nickl Jan 27 17:34:32 IMAP(nickl): Info: mbox: data=~/mail:INBOX=/var/mail/nickl Jan 27 17:34:32 IMAP(nickl): Info: fs: root=/home/nickl/mail, index=, control=, inbox=/var/mail/nickl Jan 27 17:34:32 auth(default): Info: new auth connection: pid=513 Im sure my .dovecot.sieve is not getting processed but I cannot prove it. Any help would be appreciated. Many thanks Nick .

3 8

[Dovecot] Dovecot 2.0 authentication will not work with Exim [patch]
by Kirill Miazine 28 Jan '10

28 Jan '10

Just a notice to those of you who use Dovecot authentication with Exim. In Dovecot 2.0 authentication server will send a new keyword, COOKIE. This will cause Exim to abort it's authentication request. I submitted a bug and patch to Exim to fix this, the patch is here: http://km.krot.org/code/exim-dovecot-1.1.diff BR, Kirill

1 1

[Dovecot] virtual mailbox / INTHREAD use case, issues, questions
by David Abrahams 27 Jan '10

27 Jan '10

For over a year now, I've been trying to acquire the ability to review the thread history of a message in my INBOX while still deleting messages as soon as I believe I'm done with them. Suddenly I'm gratified to see that several approaches have been right under my nose all along! One is the INTHREAD imap extension, which I see is implemented by dovecot. Another (related) is dovecot's virtual folders. When I saw the GMail-style "conversation view" described at http://wiki.dovecot.org/Plugins/Virtual I was elated, so I tried it out, with exactly that configuration (almost -- my separator is '.'). I ran into several problems (using Dovecot 1.2.8 with http://hg.dovecot.org/dovecot-1.2/rev/9cccb8617820 applied): 1. I had to manually create the virtual folder for all my users or they couldn't access their mail at all. Is this fixed in 2.0? 2. My users were getting errors when accessing via POP3. The possible meaning of such a virtual folder under POP3 is lost on me, but I had to enable the virtual plugin for that protocol too. I think that should at least be in the documentation, or better yet the requirement should that it be enabled for POP3 should be dropped. 3. I couldn't get the virtual "conversation view" inbox to show any messages. But maybe that's because of a possible issue I describe below with x-mailbox 4. At some point I ended up with an empty mailbox called "private.virtual" --- I have no idea how. Probably user error. 5. The "all" virtual mailbox would only show 89 messages. I switched it to be a mirror of my "archive" mailbox and the number started to look more reasonable. This could be the "lots of mailboxes" bug describe in http://dovecot.org/list/dovecot-news/2009-December/000145.html 6. I got the impression that looking at the virtual INBOX didn't cause the "all" mailbox to be updated, which I'd guess that it should be. 7. I tried to create an IMAP search, rather than a virtual folder, that looked for x-mailbox INBOX header like the virtual folder does. It too came up empty. It doesn't exactly surprise me because I don't see an x-mailbox header in any of these messages. In fact, I can't find one in /any/ of my messages. When I look for a description of the x-mailbox header, I don't find much information on where it comes from or what it represents. http://www.dovecot.org/list/dovecot/2009-June/040619.html seems to indicate it's synthesized by the server. If it's really supposed to represent the message's "original" mailbox as implied by http://wiki.dovecot.org/Plugins/Virtual then I'm not sure what that means for messages that are filed twice by sieve and never moved. Lastly, I want to report that for me, the speed of these IMAP searches doesn't begin to approach what I can do with mairix if I want a message's entire thread. I'm happy to use mairix, although it would be nicer not to duplicate that capability if it's already in the server. But it needs to be fast. Is there something I can do to make it go faster? Thanks in advance for any advice, hints, fixes, workarounds, etc. -- Dave Abrahams Meet me at BoostCon: http://www.boostcon.com BoostPro Computing http://www.boostpro.com

4 12

Re: [Dovecot] Seen Flag doesn't work using imapflags
by Stephan Bosch 27 Jan '10

27 Jan '10

Ronny Reiher wrote: > Hi Stephan, > > many thanks for your great work on Sieve ! > > Since I have upgraded to Sieve v0.1.15 and ManageSieve v0.11.11 the "Seen Flag" doesn't work anymore. With your previous Version it was working fine. Maybe you can give me an hint how to solve this issue ? > > # Sieve Filter > # Erzeugt von Ingo (http://www.horde.org/ingo/) > > require ["imapflags", "fileinto"]; > > # spam > if anyof ( header :comparator "i;ascii-casemap" :contains "Delivered-To" "xxx(a)xxx.de", header :comparator "i;ascii-casemap" :contains "Subject" "*****SPAM*****" ) { > addflag "\\Seen"; > fileinto "spam"; > removeflag "\\Seen"; > stop; > } > Interesting. Looks like my bugfix exposed yet another bug. Your script worked previously because the removeflag command did not work properly. With 0.1.15 I fixed the removeflag command, thus breaking your script. The essence of the bug we face now is that for the deprecated imapflags extension (that you are using now) only the flag state at the end of the script is used for storing messages. This is now fixed: http://hg.rename-it.nl/dovecot-1.2-sieve/rev/a890258aa5a9 You can work around this issue by substituting "imapflags" with "imap4flags" in the script above. I've added some proper tests to the test suite to prevent this problem from re-occuring in the future. Regards, Stephan.

1 0

[Dovecot] STATUS command and total/read message count
by Florian Effenberger 27 Jan '10

27 Jan '10

Hello, I'm running Dovecot 1.0.15 with Thunderbird 3.0.1. TB can query folders for messages in two ways: Either by using the STATUS command, or by opening the folder (don't know the respective IMAP commands, sorry...). Querying via opening the folder is reliable, but via the STATUS command, only new/unread messages are shown. If I want to have the total number of (unread) mesages in a folder, I have to manually open it, so the headers are loaded. Is this a Dovecot issue, or a problem with Thunderbird? In other words: Does the STATUS command only return new/unread messages, or can this be configured on the server side? Thanks, Florian

3 6