October 2008 - dovecot

[Dovecot] batch convert mbox to maildir
by Netlink Tech 18 May '26

18 May '26

Hello, I have used mb2md for an individual user like this: su ~username cd ~ ./mb2md -m This converted /var/spool/mail/username mbox to /home/users/username/Maildir just as I expected. To convert 100s of users the same way would be a chore (su as each user for permissions, etc.). Is there a way to batch process all /var/spool/mail/$USER to /home/users/$USER/Maildir with the correct permissions/file owners for each user?

4 4

[Dovecot] [PATCH, RFC] add APOP authentication mechanism
by Andrey Panin 14 Aug '17

14 Aug '17

Hello all, this patch add APOP authentication mechanism to dovecot 1.0-test23. Please take a look. Best regards. -- Andrey Panin | Linux and UNIX system administrator pazke(a)donpac.ru | PGP key: wwwkeys.pgp.net

3 2

[Dovecot] Connecting to dovecot
by Grant Lowe 06 Jul '09

06 Jul '09

Hi All, I've got a brand new dovecot installation. I'm new to dovecot, so please be gentle :-) Anyway, I'm getting some errors when I try to connect to dovecot. I've tried searching the web and haven't been able to find a lot of information. Here's the config info: # dovecot --version 1.1.2 # dovecot -n sudo dovecot -n # 1.1.2: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/dovecot.log ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable: /usr/local/libexec/dovecot/imap-login mail_location: /var/mail/%u auth default: verbose: yes passdb: driver: passwd-file args: /etc/dovecot/passwd userdb: driver: static args: uid=vmail gid=vmail home=/var/mail/%u # Here are the errors I'm getting. dovecot: Sep 16 18:44:15 Info: imap-login: Login: user=<wfoatst>, method=PLAIN, rip=172.20.58.4, lip=172.20.8.215 dovecot: Sep 16 18:44:15 Error: IMAP(wfoatst): mail_location not set and autodetection failed: Mail storage autodetection failed with ho me=/var/mail/wfoatst Thanks!

3 3

[Dovecot] Spliting Folders for Efficiency
by Daniel Watts 28 Jun '09

28 Jun '09

Dear Timo, Would there be any sense in giving Dovecot the option to split folders into multiple subfolders when they reached a specified size (probably message count) limit? Dovecot would monitor folders and when they reached, say, 10,000 messages, silently split the folder on the filesystem to ensure that access remains fast. I know that Dovecot scales very well but this would give practically unlimited storage capability and also keep things fast. You could even have it so that the latest 100 messages are kept in their own folder for fast access. .Folder.new .Folder.cur .Folder.tmp could become: .Folder__1.new .Folder__1.cur .Folder__1.tmp and .Folder__2.new .Folder__2.cur .Folder__2.tmp with Dovecot merging them before display as just "Folder" within the mail client. This could be further extended so that Dovecot could be configured to store 'old' message folders in a separate location. We could then have slower+cheaper+larger storage mounted so that 'old mail' does not take up the expensive local SCSI disks on the machine. Mail from 2 years ago is much less likely to be accessed than mail from the last week. This would provide very neat behind-the-scenes archiving functionality. Looking forward to hearing your thoughts. Best, Daniel -- Squirrelmail Stable 1.4.8 (and developing on 1.5.2) PHP 5.x Hardened with Eaccelerator Apache 2.x Mysql 5.0.x Imapproxy over Dovecot 1.0.rc27 with Maildir all running on Gentoo Linux for ~5,000 users.

7 11

[Dovecot] compressed mbox patch
by Axel Thimm 16 Jun '09

16 Jun '09

Some ages ago there existed a compressed mbox patch, but now all I can find are posting about it. Does such a beast exist and would it remotely apply to today's dovecot? If not, is there any hope that something like that emerges? Thanks! -- Axel.Thimm at ATrpms.net

3 5

[Dovecot] Authentication cache, failure to login after changed password
by Tom Sommer 16 Jun '09

16 Jun '09

Hi, I have an issue with the authentication cache. When a user changes his password, the cache doesn't seem to get flushed. Meaning the user is unable to log in to his IMAP account after changing his password. Flow: - Log into IMAP account using pass1 - Approved - Stored in auth cache - Change password to pass2 in MySQL - Log into IMAP account using pass2 - Access is denied - Restart dovecot - Log into IMAP account using pass2 - Approved I'd really like to continue to use the auth cache, is there any solution to the above? perhaps a way to debug the cache and auth process? I wasn't able to activate auth_debug without restarting Dovecot and solving the problem. Using version 1.1.1, MySQL userdb, with "nopassword=Y". Maybe it's due to nopassword? Thanks -- Tom

2 16

[Dovecot] Feature Missing OUTBOX Folder
by Frank Doege 01 Jun '09

01 Jun '09

Hi Dovecot People, i have switched my system from courier-imap to dovecot and iam quite happy with it, the performance is well and i had nearly no problems. One little feature iam missing is in Courier i had a folder called "Outbox" there i could paste mails which i want to sent out. In some networks its not always available to sent mails via port 21, i know i could just set up my email server to another port but it was a nice feature. Is this a big afford or is it just alittle hack ? could it done via a little plugin ? Thanks Timo & all others for the great work ! Frank

5 7

[Dovecot] Dovecot performance on GFS clustered filesystem
by Allen Belletti 06 Feb '09

06 Feb '09

Hello All, We are using Dovecot 1.1.3 to serve IMAP on a pair of clustered Postfix servers which share a fiber array via the GFS clustered filesystem. This all works very well for the most part, with the exception that certain operations are so inefficient on GFS that they generate significant I/O load and hurt performance. We are using the Maildir format on disk. We're also using Dovecot's deliver from Postfix to handle local delivery. As best I can determine, the worst problems occur when certain users with very large Inboxes (~10k messages) receive new mail and their client looks up information about that message. GFS doesn't seem to efficiently handle the large directories that contain folders like this. As a result, lots of I/O ops are generated and performance suffers for everyone. I am beginning to wonder if it might be more efficient to revert to the old mbox format, with one file per folder (plus whatever indices are creates.) It seems that this ought to work better with GFS which is geared toward smaller numbers of larger files. Is anyone on the list currently doing that? Alternately, any thoughts regarding tuning or other options would be appreciated. Thanks, Allen -- Allen Belletti allen(a)isye.gatech.edu 404-894-6221 Phone Industrial and Systems Engineering 404-385-2988 Fax Georgia Institute of Technology

3 4

[Dovecot] Panic 1.1.4
by Andre Hübner 14 Jan '09

14 Jan '09

Hi List, try 1.1.4 and have new Panics in Log. Hoped that 1.1.3 finishes this errors... Oct 8 21:56:28 dd10636 dovecot: IMAP(username): Loading modules from directory: /usr/lib/dovecot/imap Oct 8 21:56:28 dd10636 dovecot: IMAP(username): Module loaded: /usr/lib/dovecot/imap/lib20_mail_log_plugin.so Oct 8 21:56:28 dd10636 dovecot: IMAP(username): Effective uid=857, gid=628, home=/home/popuser/username Oct 8 21:56:28 dd10636 dovecot: IMAP(username): mbox: data=~/mail:INBOX=/var/spool/mail/username Oct 8 21:56:28 dd10636 dovecot: IMAP(username): fs: root=/home/popuser/username/mail, index=, control=, inbox=/var/spool/mail/username Oct 8 21:56:28 dd10636 dovecot: imap-login: Login: user=<username>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Oct 8 21:56:28 dd10636 dovecot: Panic: IMAP(username): file istream-limit.c: line 84 (i_stream_limit_read): assertion failed: (ret != -1 || stream->istream.e of || stream->istream.stream_errno != 0) Oct 8 21:56:28 dd10636 dovecot: IMAP(username): Raw backtrace: imap [0x80c3a30] -> imap [0x80c3a8a] -> imap [0x80c338c] -> imap [0x80c9d04] -> imap(i_stream_ read+0x28) [0x80c7e28] -> imap(i_stream_read_data+0x1d) [0x80c7edd] -> imap(message_parse_header_next+0x7c) [0x80bbcdc] -> imap [0x80b9385] -> imap [0x80b9aa7 ] -> imap [0x80b9bb4] -> imap [0x80b9c95] -> imap(i_stream_seek+0x69) [0x80c7db9] -> imap [0x8071763] -> /usr/lib/dovecot/imap/lib20_mail_log_plugin.so [0xb7f a3aec] -> /usr/lib/dovecot/imap/lib20_mail_log_plugin.so [0xb7fa3d56] -> imap(cmd_copy+0x1d2) [0x805a142] -> imap [0x805edfc] -> imap [0x805eea5] -> imap [0x8 05f665] -> imap(client_input+0x5e) [0x805f87e] -> imap(io_loop_handler_run+0x100) [0x80cb590] -> imap(io_loop_run+0x28) [0x80ca6a8] -> imap(main+0x4ac) [0x806 73bc] -> /lib/libc.so.6(__libc_start_main+0xdc) [0xb7e8d87c] -> imap [0x8059191] Oct 8 21:56:28 dd10636 dovecot: child 9120 (imap) killed with signal 6 dovecot -n # 1.1.4: /etc/dovecot.conf protocols: imap imaps pop3 pop3s ssl_ca_file: /path/to/*hostname.com.bundle.crt ssl_cert_file: /path/to/*.hostname.com.crt ssl_key_file: /path/to/*.hostname.com.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_greeting: hostname.com mailserver ready. login_process_per_connection: no login_processes_count: 1 max_mail_processes: 100 verbose_proctitle: yes mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u mail_cache_min_mail_count: 30 mail_debug: yes lock_method: flock mbox_read_locks: dotlock mbox_very_dirty_syncs: yes mail_drop_priv_before_exec: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): mail_log mail_plugins(imap): mail_log mail_plugins(pop3): mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle netscape-eoh tb-extra-mailbox-sep delay-newmail imap_client_workarounds(imap): outlook-idle netscape-eoh tb-extra-mailbox-sep delay-newmail imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): oe-ns-eoh outlook-no-nuls auth default: verbose: yes passdb: driver: shadow userdb: driver: passwd gdb /usr/libexec/dovecot/imap /home/popuser/username/core GNU gdb 6.4 Copyright 2005 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i586-suse-linux"...Using host libthread_db library "/lib/libthread_db.so.1". Core was generated by `imap [username 127.0.0.1]'. Program terminated with signal 6, Aborted. warning: Can't read pathname for load map: Eingabe-/Ausgabefehler. Reading symbols from /lib/libdl.so.2...done. Loaded symbols for /lib/libdl.so.2 Reading symbols from /lib/libc.so.6...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /usr/lib/dovecot/imap/lib20_mail_log_plugin.so...done. Loaded symbols for /usr/lib/dovecot/imap/lib20_mail_log_plugin.so Reading symbols from /lib/libnss_files.so.2...done. Loaded symbols for /lib/libnss_files.so.2 Reading symbols from /lib/libgcc_s.so.1...done. Loaded symbols for /lib/libgcc_s.so.1 #0 0xffffe410 in __kernel_vsyscall () (gdb) bt full #0 0xffffe410 in __kernel_vsyscall () No symbol table info available. #1 0xb7ea07d0 in raise () from /lib/libc.so.6 No symbol table info available. #2 0xb7ea1ea3 in abort () from /lib/libc.so.6 No symbol table info available. #3 0x080c3a3d in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:150 backtrace = 0x80f1ae8 "imap [0x80c3a30] -> imap [0x80c3a8a] -> imap [0x80c338c] -> imap [0x80c9d04] -> imap(i_stream_read+0x28) [0x80c7e28] -> imap(i_stream_read_data+0x1d) [0x80c7edd] -> imap(message_parse_header_next+0x7c"... #4 0x080c3a8a in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0x80d71ac "file %s: line %d (%s): assertion failed: (%s)", args=0xbf941da4 "Sj\016\bT") at failures.c:430 No locals. #5 0x080c338c in i_panic (format=0x80d71ac "file %s: line %d (%s): assertion failed: (%s)") at failures.c:197 args = 0xbf941da4 "Sj\016\bT" #6 0x080c9d04 in i_stream_limit_read (stream=0x8118cc8) at istream-limit.c:83 left = <value optimized out> ret = -1 pos = 65 __PRETTY_FUNCTION__ = "i_stream_limit_read" #7 0x080c7e28 in i_stream_read (stream=0x8118cf0) at istream.c:73 _stream = (struct istream_private *) 0x0 ret = <value optimized out> __PRETTY_FUNCTION__ = "i_stream_read" #8 0x080c7edd in i_stream_read_data (stream=0x8118cf0, data_r=0xbf941e68, size_r=0xbf941e64, threshold=65) at istream.c:299 ret = -1080811928 read_more = false __PRETTY_FUNCTION__ = "i_stream_read_data" #9 0x080bbcdc in message_parse_header_next (ctx=0x81118f0, hdr_r=0xbf941ec0) at message-header-parser.c:89 msg = ( const unsigned char *) 0x811292f "qan4iKSQ1jgszBF7yO1N1FgdflELgOSeaEzr+P+aEXdIbk/ooMFh+wew7C5rzd2W+AfY+P7e\n3el1/64bLf+hadyHUxkt3auVaT3Y6zcoxZaSmY1gEydp4JcyEVNapSNbsWFKYUTSJiju10VF\nkBLd+JYm8PvXkDSplAEe9MRASmX2Jzt/zG6b39O5byfU5IA6JiBj/5"... i = 6 size = 65 startpos = 64 colon_pos = 4294967295 parse_size = 64 value_pos = <value optimized out> ret = 6 continued = false continues = <value optimized out> crlf_newline = false #10 0x080b9385 in read_header (mstream=0x8118da8) at istream-header-filter.c:163 hdr = (struct message_header_line *) 0x0 highwater_offset = <value optimized out> pos = <value optimized out> ret = <value optimized out> matched = false hdr_ret = <value optimized out> __PRETTY_FUNCTION__ = "read_header" #11 0x080b9aa7 in i_stream_header_filter_read (stream=0x8118da8) at istream-header-filter.c:293 mstream = (struct header_filter_istream *) 0x0 ret = <value optimized out> pos = <value optimized out> #12 0x080b9bb4 in parse_header (mstream=0x8118da8) at istream-header-filter.c:333 pos = 73 #13 0x080b9c95 in i_stream_header_filter_seek (stream=0x8118da8, v_offset=1904, mark=false) at istream-header-filter.c:347 mstream = (struct header_filter_istream *) 0x0 #14 0x080c7db9 in i_stream_seek (stream=0x8118dd0, v_offset=1904) at istream.c:144 _stream = (struct istream_private *) 0x8118da8 ---Type <return> to continue, or q <return> to quit--- #15 0x08071763 in mbox_mail_get_physical_size (_mail=0x81142b8, size_r=0xbf942058) at mbox-mail.c:255 mail = <value optimized out> data = (struct index_mail_data *) 0x8114334 input = (struct istream *) 0x8118dd0 hdr_size = {physical_size = 1738, virtual_size = 1771, lines = 33} old_offset = 1904 body_offset = 151200709 body_size = <value optimized out> next_offset = 148393877 #16 0xb7fa3aec in mail_log_action (dest_trans=<value optimized out>, mail=0x81142b8, event=<value optimized out>, data=0x810f4f8 "Trash") at mail-log-plugin.c:305 lt = (struct mail_log_transaction_context *) 0x811c708 msgid = 0x8114bb4 "<20081008182128.D148E68E1BECD(a)relay1.senderdomain.net>" size = <value optimized out> str = (string_t *) 0x80f1858 pool = <value optimized out> #17 0xb7fa3d56 in mail_log_copy (t=0x810ff00, mail=0x81142b8, flags=MAIL_SEEN, keywords=0x0, dest_mail=0x0) at mail-log-plugin.c:400 _data_stack_cur_id = 4 name = <value optimized out> #18 0x0805a142 in cmd_copy (cmd=0x80fb9c8) at cmd-copy.c:66 client = (struct client *) 0x80fa548 storage = (struct mail_storage *) 0x80fb108 destbox = (struct mailbox *) 0x810f358 t = (struct mailbox_transaction_context *) 0x810ff00 search_arg = <value optimized out> messageset = 0x80ffac0 "737" mailbox = 0x80ffac8 "Trash" src_uidset = <value optimized out> msg = <value optimized out> sync_flags = <value optimized out> imap_flags = <value optimized out> copy_count = 1 uid_validity = <value optimized out> uid1 = <value optimized out> uid2 = <value optimized out> ret = 1 __PRETTY_FUNCTION__ = "cmd_copy" #19 0x0805edfc in client_command_input (cmd=0x80fb9c8) at client.c:580 client = (struct client *) 0x80fa548 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #20 0x0805eea5 in client_command_input (cmd=0x80fb9c8) at client.c:629 client = (struct client *) 0x80fa548 command = (struct command *) 0x23a0 __PRETTY_FUNCTION__ = "client_command_input" #21 0x0805f665 in client_handle_input (client=0x80fa548) at client.c:670 _data_stack_cur_id = 3 ret = <value optimized out> remove_io = <value optimized out> handled_commands = false #22 0x0805f87e in client_input (client=0x80fa548) at client.c:725 cmd = <value optimized out> output = (struct ostream *) 0x80fb904 bytes = 23 __PRETTY_FUNCTION__ = "client_input" #23 0x080cb590 in io_loop_handler_run (ioloop=0x80f99b0) at ioloop-epoll.c:203 ctx = <value optimized out> event = (const struct epoll_event *) 0x80f9ae8 list = (struct io_list *) 0x80fa5b8 ---Type <return> to continue, or q <return> to quit--- io = (struct io_file *) 0x80fb960 tv = {tv_sec = 1799, tv_usec = 999127} t_id = 2 msecs = <value optimized out> ret = 1 i = 0 j = 0 call = <value optimized out> #24 0x080ca6a8 in io_loop_run (ioloop=0x80f99b0) at ioloop.c:320 No locals. #25 0x080673bc in main (argc=Cannot access memory at address 0x23a0 ) at main.c:293 No locals. Thanks Andre

2 2

[Dovecot] allow_nets overridden by cache
by Guy 08 Jan '09

08 Jan '09

Hi, I've just started trying allow_nets on one of my servers. I have auth_debug and auth_verbose both enabled and the output is as follows: Oct 28 13:05:48 mink dovecot: auth-worker(default): auth(user(a)domain.net,x.x.x.x): allow_nets: Matching for network 127.0.0.1/8 Oct 28 13:05:48 mink dovecot: auth-worker(default): auth(user(a)domain.net,x.x.x.x): allow_nets: Matching for network 10.0.7.176/28 Oct 28 13:05:48 mink dovecot: auth-worker(default): passdb(user(a)domain.net,x.x.x.x): allow_nets check failed: IP not in allowed networks Oct 28 13:05:50 mink dovecot: auth(default): client out: FAIL 1265 user=username(a)aluminati.net Oct 28 13:05:50 mink dovecot: auth(default): cache(user(a)domain.net,x.x.x.x): hit: <hidden> user=user(a)domain.net Oct 28 13:05:50 mink dovecot: auth(default): client out: OK 1266 user=user(a)domain.net auth_cache_ttl is set to 300. If I set it to 1 then the allow_nets successfully rejects. Once I set it back up to 300 the cache overrides the result from the allow_nets check and let's the account log in even though the allow_nets check fails. I've tried waiting for longer than the 300 seconds and then logged in again, but I still get the same result as above. Is there a gotcha that I'm unaware of or have I done something stupid (which seems the most likely :P)? Thanks Guy -- Don't just do something...sit there!

2 4