January 2011 - dovecot

[Dovecot] dsync crash
by Pavel Volkovitskiy 17 Jan '11

17 Jan '11

Hello! I'm converting mailboxes from maildirs to mdbox and dsync crashes on two of them /var/mail-nfs-1 - nfs mount /var/mail-nfs-indexes - local fs /usr/bin/dsync -f -u user(a)site.ru mirror mdbox:/var/mail-nfs-1/mail/site.ru/user/mail:INDEX=/var/mail-nfs-indexes/site.ru/user dsync(user(a)site.ru): Panic: file istream-limit.c: line 79 (i_stream_limit_seek): assertion failed: (v_offset <= lstream->v_size) gdb bt: #0 0xb7fe1424 in ?? () #1 0xb7d66e42 in abort () from /lib/libc.so.6 #2 0xb7ee6f55 in default_fatal_finish (type=<value optimized out>, status=<value optimized out>) at failures.c:187 #3 0xb7ee7057 in default_fatal_handler (ctx=0xbfffef84, format=0xb7f08c78 "file %s: line %d (%s): assertion failed: (%s)", args=0xbfffefa4 "\312\361\360\267O") at failures.c:201 #4 0xb7ebd79a in i_panic (format=0xb7f08c78 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:259 #5 0xb7ef1159 in i_stream_limit_seek (stream=0x82277e8, v_offset=25769827482, mark=false) at istream-limit.c:79 #6 0xb7eede77 in i_stream_skip (stream=0x8227818, count=197) at istream.c:202 #7 0xb7eedf07 in i_stream_seek (stream=0x8227818, v_offset=5630) at istream.c:224 #8 0xb7f93c1f in dbox_attachment_file_get_stream_from (file=0x81ef248, stream=0xbffff10c) at dbox-attachment.c:168 #9 dbox_attachment_file_get_stream (file=0x81ef248, stream=0xbffff10c) at dbox-attachment.c:223 #10 0xb7f96a79 in get_mail_stream (_mail=0x81993a8, hdr_size=0x0, body_size=0x0, stream_r=0xbffff17c) at dbox-mail.c:234 #11 dbox_mail_get_stream (_mail=0x81993a8, hdr_size=0x0, body_size=0x0, stream_r=0xbffff17c) at dbox-mail.c:253 #12 0xb7f3d4f7 in mail_get_stream (mail=0x0, hdr_size=0x0, body_size=0x0, stream_r=0xbffff17c) at mail.c:179 #13 0xb7d1a66a in zlib_mail_save_finish (ctx=0x81d3ee8) at zlib-plugin.c:253 #14 0xb7f43438 in mailbox_save_finish (_ctx=0x808edf0) at mail-storage.c:1410 #15 0x08056898 in local_worker_save_msg_continue (worker=0x808ed08) at dsync-worker-local.c:1670 #16 0x08056a37 in local_worker_msg_save (_worker=0x808ed08, msg=0x80ee6c8, data=0xbffff350, callback=0x8050b80 <msg_save_callback>, context=0x80b2c60) at dsync-worker-local.c:1729 #17 0x08055dea in dsync_worker_msg_save (worker=0x808ed08, msg=0x80ee6c8, data=0xbffff350, callback=0x8050b80 <msg_save_callback>, context=0x80b2c60) at dsync-worker.c:234 #18 0x08050c69 in msg_get_callback (result=DSYNC_MSG_GET_RESULT_SUCCESS, data=0xbffff350, context=0x80b2c60) at dsync-brain-msgs-new.c:78 #19 0x080563a1 in local_worker_msg_get_next (worker=0x80832d0, get=0xbffff394) at dsync-worker-local.c:1825 #20 0x080565ed in local_worker_msg_get (_worker=0x0, mailbox=0x80d6ba1, uid=15, callback=0x8050bd0 <msg_get_callback>, context=0x5c9a) at dsync-worker-local.c:1846 #21 0x08055a09 in dsync_worker_msg_get (worker=0x80832d0, mailbox=0x80d6ba1, uid=15, callback=0x8050bd0 <msg_get_callback>, context=0x80b2c60) at dsync-worker.c:261 #22 0x08050a31 in dsync_brain_msg_sync_add_new_msg (iter=0x80d6ce0) at dsync-brain-msgs-new.c:180 #23 dsync_brain_mailbox_add_new_msgs (iter=0x80d6ce0) at dsync-brain-msgs-new.c:210 #24 dsync_brain_msg_sync_add_new_msgs (iter=0x80d6ce0) at dsync-brain-msgs-new.c:309 #25 0x0805023f in dsync_brain_msg_sync_more (sync=0x80d6a48) at dsync-brain-msgs.c:430 #26 0x0804eb60 in dsync_brain_sync_msgs (brain=0x8092140) at dsync-brain.c:726 #27 dsync_brain_sync (brain=0x8092140) at dsync-brain.c:847 #28 0x0804f970 in dsync_brain_subs_list_finished (context=0x80c62b8) at dsync-brain.c:170 #29 dsync_worker_subs_input (context=0x80c62b8) at dsync-brain.c:223 #30 0x0804ee97 in dsync_brain_sync (brain=0x8092140) at dsync-brain.c:832 #31 0x0804f7f8 in dsync_brain_mailbox_list_finished (context=0x8098d20) at dsync-brain.c:99 #32 dsync_worker_mailbox_input (context=0x8098d20) at dsync-brain.c:126 #33 0x0804ecf5 in dsync_brain_sync (brain=0x8092140) at dsync-brain.c:823 #34 0x0804f698 in dsync_brain_sync_all (brain=0x8092140) at dsync-brain.c:887 #35 0x0804db76 in main (argc=6, argv=0x80651c0) at dsync.c:303 doveconf -n: # 2.0.9 (d8179b523116): /etc/dovecot/dovecot.conf # OS: Linux 2.6.35-24-generic-pae i686 Ubuntu 10.10 auth_default_realm = mtx.ru auth_mechanisms = plain login digest-md5 cram-md5 apop ntlm auth_realms = mtx.ru disable_plaintext_auth = no first_valid_uid = 1 info_log_path = /var/log/dovecot/dovecot-main.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot/dovecot-main-errors.log log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Server ready. mail_attachment_dir = /var/mail-nfs-1/mail/attachments mail_attachment_min_size = 16 k mail_fsync = never mail_location = maildir:%Lh:INDEX=/var/mail-indexes/%Ld/%Ln mail_plugins = " lazy_expunge zlib" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mdbox_rotate_size = 32 M mmap_disable = yes namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes list = no location = mdbox:/var/mail-nfs-1/mail-backup/%Ld/%Ln prefix = .EXPUNGED/ separator = / type = private } passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } plugin { lazy_expunge = .EXPUNGED/ lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes quota = maildir quota_rule = *:storage=0 sieve = ~/dovecot.sieve sieve_global_path = /etc/dovecot/scripts/dovecot.sieve sieve_storage = /var/mail/%d/%n/sieve } protocols = imap pop3 sieve service anvil { unix_listener anvil { group = mail mode = 0660 user = root } } service auth { unix_listener auth-client { mode = 0666 } unix_listener auth-master { group = mail mode = 0660 user = Debian-exim } unix_listener auth-userdb { group = mail mode = 0660 user = root } user = root } service imap-login { process_limit = 256 process_min_avail = 5 } service imap { executable = /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap process_limit = 1024 } service managesieve-login { process_limit = 256 process_min_avail = 5 } service managesieve { process_limit = 1024 } service pop3-login { process_limit = 256 process_min_avail = 5 } service pop3 { process_limit = 1024 } ssl_cert = </etc/ssl/certs/mail.mtx.ru.crt ssl_key = </etc/ssl/private/mail.mtx.ru.key userdb { args = username_format=%n /var/mail/userdb/userdb-%Ld driver = passwd-file } userdb { args = uid=8 gid=8 home=/var/mail/%d/%n driver = static } verbose_proctitle = yes protocol lda { debug_log_path = /var/log/dovecot/dovecot-lda-debug.log info_log_path = /var/log/dovecot/dovecot-lda.log log_path = /var/log/dovecot/dovecot-lda-errors.log mail_debug = no mail_plugins = " lazy_expunge zlib sieve" } protocol imap { imap_capability = +NAMESPACE } -- Pavel

1 0

[Dovecot] IMAP V4 Rev.1 supported in dovecot 1.0.rc7
by Antonio Manogué 17 Jan '11

17 Jan '11

Hi. I'm running dovecot 1.0.rc7 in a RHEL. I need to know if this version supports IMAPV4 rev1 and IDLE for a new project. Thanks. [root@pony mail]# uname -a Linux pony.sabeco.es 2.6.18-1.2798.fc6 #1 SMP Mon Oct 16 14:37:32 EDT 2006 i686 i686 i386 GNU/Linux [root@pony mail]# dovecot --version 1.0.rc7 [root@pony mail]# dovecot -n # /etc/dovecot.conf login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd -- Antonio Manogué Saiz Técnico de Sistemas Dpt. Sistemas y Comunicaciones email: amanogue(a)sabeco.es Tlf: 976 188 184

2 2

Re: [Dovecot] SSD drives are really fast running Dovecot
by Joseph Tam 17 Jan '11

17 Jan '11

On Sat, 15 Jan 2011, Charles Marcus wrote > Doing this will also help train users in proper email management - > treating their INBOX just like they would a physical INBOX tray on their > desk. They wouldn't just let paper pile up there, why do so in their > INBOX (because they 'can')? Ie, it should be something they should > always strive to keep totally EMPTY. Of course this practically never > happens, but the point is, they need to learn to make a decision once > they are finished with it, and most importantly, take said action - > either delete it, or file it. This is pretty much what I do with the mail domain I administer. I've set the INBOX with a modest quota, and a personal mail folder with a generous quota. I encourage users to keep their INBOX as a "working set", and archive the rest using any method they prefer. It forces users to process their Email (or at least their INBOX). and keeps packratting in check. Super-big INBOX quotas seem to encourage wasteful habits. I've helped some users clean out their mailboxes and was surpised at the amount of junk being kept for years and years. Apart from a few users moaning about their meager INBOX, this policy works out fairly well. Joseph Tam <jtam.home(a)gmail.com>

2 1

[Dovecot] Virtual mailboxes do not look into subfolders
by Paul Provost 17 Jan '11

17 Jan '11

Hi all, I have virtual mailboxes set up as "Smart Folders" to show me messages tagged with certain keywords. For example: # ~/Maildir-virtual/fwp/dovecot-virtual File MailingLists/* KEYWORD @fwp Messages get picked up from the File mailbox, but not for the sub-mailboxes inside the MailingLists mailbox. What am I doing wrong? Wrong separator? And how can I debug this? Everything else is working fine. Thanks a lot! Paul

3 2

[Dovecot] Index files size calculation
by Patrick Westenberg 17 Jan '11

17 Jan '11

Hi guys, 2 or 3 weeks ago, one of you explained how to calculate the size of the index files for an user. Can somebody explain this again please? Thx Patrick

3 3

Re: [Dovecot] dovecot lda and quota plugin with mysql
by J4 17 Jan '11

17 Jan '11

On 01/17/2011 11:53 AM, J4 wrote: > On 01/16/2011 08:42 PM, Timo Sirainen wrote: >> On Thu, 2011-01-13 at 17:22 +0100, J4 wrote: >> >>> I have postfix delivering to dovecot lda (via spamassinassin). I >>> have configured the quota plugin, but it does not seem to respect the >>> details in the quota table in mysql. The query I have used looks >>> correct to me, and the user can connect to the database. >> .. >>> # Relevant portions of dovecot -n: >> This output doesn't show a quota_rule. If you don't have any, everyone >> has unlimited quota. >> >>> mysql> select * from quota; >>> +-----------------------------+-----------+----------+ >>> | username | bytes | messages | >>> +-----------------------------+-----------+----------+ >>> | root(a)test.info | 19524 | 18 | >>> | bob(a)test.info | 9420 | 6 | >>> | test(a)klunky.co.uk | 4662 | 4 | >>> | bob1(a)test.info | 19284 | 13 | >>> | bob2(a)test.info | 173906172 | 5702 | >>> | postmaster(a)test.info | 10587 | 9 | >>> | bob3(a)test.info | 3695 | 2 | >>> +-----------------------------+-----------+----------+ >>> 7 rows in set (0.00 sec) >> Looks like it's counting the quota, so I guess you're just missing the >> limits. > Hi Timo, > Many thanks for getting back to me. This has led me to look more into > the mailbox and quota tables. > > I think the limits are inserted into the mailbox table, > mysql> select * from mailbox; > +----------------------------+------------------------------------+----------------------------+-----------------------------+----------+------------+------------------+---------------------+---------------------+--------+ > | username | password | name > | maildir | quota | > local_part | domain | created | modified > | active | > +----------------------------+------------------------------------+----------------------------+-----------------------------+----------+------------+------------------+---------------------+---------------------+--------+ > | test(a)test.info | $1$1xxxxxxxxx | Fred TEST > | test.info/test/ | 10240000 | test | test.info | > 2011-01-07 17:47:25 | 2011-01-07 17:47:25 | 1 | > > +----------------------------+------------------------------------+----------------------------+-----------------------------+----------+------------+------------------+---------------------+---------------------+--------+ > > ... while the actual usage is inserted into the quota table (as shown in > the original Email). I think that Dovecot should read the limits from > mailbox.quota and retrieve the usage from the quota.bytes and > quota.messages. > > Somehow, I have to tell Dovecot to use these values in mailbox.quota. I > think that I have to add a reference to the file in the dovecot.conf, > and add an entry into the appropriate sql.conf file. > > Regards, J. > I updated the /etc/dovecot/dovecot-sql.conf file to include this modifed query, that I hoped would check the quota, but this failed. I think dovecot simply ignored this. I wonder if the alias quota_rule makes any sence to Dovecot as I only see : quota = dict:user::proxy::quotadict defined in the dovecot.conf and not quota_rule. # cat /etc/dovecot/dovecot-sql.conf password_query = SELECT username as user, password FROM mailbox WHERE email='%u'; user_query = SELECT 5000 AS uid, 5000 AS gid,'/home/vmail/%d/%n' as home, concat('*:storage= ', quota) AS quota_rule FROM mailbox WHERE user = '%n';

1 0

[Dovecot] BUG:v2.0.9 + expire plugin segfault
by Nikita Koshikov 17 Jan '11

17 Jan '11

Hello list, New version of dovecot segfaulting with expire plugin(sqlite db). Steps to reproduce: 1)DB file has permitions: -rw-r--r-- 1 mail mail 87040 Янв 17 10:04 /var/mail/expire.db 2)Dict dovecot config section: service dict { # If dict proxy is used, mail processes should have access to its socket. # For example: mode=0660, group=vmail and global mail_access_groups=vmail unix_listener dict { mode = 0600 user = mail } #user = mail } 3)Trying to add new record to database I get: Jan 17 10:03:12 dict: Error: sqlite: exec(INSERT INTO expires (expire_stamp,username,mailbox) VALUES ('1294852805','user(a)domain.com','Trash')) fail ed: attempt to write a readonly database (8) Jan 17 10:03:12 IMAP(user(a)domain.com 192.168.2.252): Error: read(/var/run/dovecot/dict) failed: Remote disconnected Jan 17 10:03:12 master: Error: service(dict): child 13957 killed with signal 11 (core not dumped) This crash has gone after service dict got enough permission to access db file(user mail in my case). Don't know how to get backtrace with dict service, but can reproduce crash any time.

1 0

[Dovecot] vpopmail disabled services fix
by Calvin 17 Jan '11

17 Jan '11

I noticed that disabling services using vpopmail was not being recognized by dovecot. Using "vmoduser -swip user(a)domain.com" should disable all services, but both pop and imap logins were still allowed. After a bit of digging in the code and confirming with a few debug lines, it appears that lines 38 and 52 of src/auth/passdb-vpopmail.c are the issue (dovecot 2.0.8). These two lines do a strcmp on request->service. It appears that request->service is in lower case, but the comparison values are in upper case. Either updating the values to lowercase or using strcasecmp should fix the issue. Calvin _________________________________________________ Scanned on 27 Dec 2010 23:05:02 This e-mail message is confidential, intended only for the named recipient(s) above and may contain information that is privileged, attorney work product or exempt from disclosure under applicable law. If you have received this message in error, or are not the named recipient(s), please immediately notify the sender at 425-336-0480 and delete the e-mail message from your computer. Thank you.

3 2

[Dovecot] Share: How to share IMAP folder with Dovecot and Roundcube webmail
by Zhang Huangbin 17 Jan '11

17 Jan '11

Hi, all. I achieved mailbox sharing with Dovecot & Roundcube webmail in iRedMail[1] today, just want to share you my experience, hope it helps. Although it's for iRedMail, but it doesn't depend on it. http://www.iredmail.org/wiki/index.php?title=IRedMail/FAQ/Share.IMAP.Folder It describes: - How to enable mailbox sharing in Dovecot - How to enable mailbox sharing in Roundcube webmail. - How to test mailbox sharing with telnet Requirements: - Dovecot >= 1.2 - Roundcube webmail >= 0.5 -stable release [1] iRedMail - Free, Open Source Email Server Solution: http://www.iredmail.org/

1 0

[Dovecot] Web Based User Management
by Matt 17 Jan '11

17 Jan '11

Does anyone know of a web GUI type application that would allow the creation and deletion of email accounts on an email server?

9 12