- dovecot - dovecot.org

[Dovecot] Current state of mulit-server NFS setups
by Justin McAleer 23 Jan '07

23 Jan '07

Hi list, I've been perusing the list archives, but I couldn't find a recent, definitive answer to what I'd like to know. I'm looking to set up a new batch of servers to migrate ~160,000 accounts, spread across several domains, onto (from CommuniGate). Last year I worked with the earlier beta/RC versions of Dovecot, so I'm generally familiar with the setup required. However, a lot of development has been done since I was last dealing with it. So, what I'd like to end up with is a load balanced group of servers providing pop and imap access with quota support using an NFS filesystem. We have a new Netapp device (forget the actual model) that can do SAN/iSCSI/NFS. We tried using various clustered filesystems previously, but the performance/stability issues were a nightmare, so I've fallen back to NFS (or perhaps SAN if users can't hit any server in the group). So, what does my dovecot setup need to be? I've seen some people say they disable indexing in the LDA, but allow pop/imap to index. Some say the attribute cache needs to be disabled, which I'd think would be worse than just disabling indexes. Some say indexes should be kept on local disk (dedicated server for users), and others seem to report problems even when doing so. Is there a general consensus? I was also wondering if dovecot's sanity checking on the indexes would allow each server in a balanced group to keep indexes on local disk (so if the maildir has changed on another server, dovecot rebuilds it). If so, does that take away all performance gains from having indexes at all? Thanks for any info you all can provide.

2 1

[Dovecot] Maildir Quota backend
by Ioannis Zachariadis 23 Jan '07

23 Jan '07

Hi, I've noticed that in the maildir backend for the quota plugin the quota limit is being read in kilobytes. In the quota-maildir.c at maildir_quota_init() , line 550 (rc18) if (strncmp(*args, "storage=", 8) == 0) { size = strtoull(*args + 8, NULL, 10) * 1024; if (size != 0) root->message_bytes_limit = size; root->master_message_limits = TRUE; } The value that's being read from storage is supposed to be in kB, at least that's what I understand from the wiki, and then the value of size is stored in bytes. thanks -- giannis.

2 1

[Dovecot] LDAP authentication stops working...
by Adrian Close 23 Jan '07

23 Jan '07

Hi all, I'm running dovecot-1.0.rc17 on OpenBSD 3.9, using userdb and passdb methods of "ldap" (SSL on 636/tcp) in addition to "passwd". Occasionally (generally after a few hours of operation, but not always), LDAP-based logins stop working (e.g. hang/timeout after POP3 PASS command). Accounts with local passwords (as opposed to accounts with a password field of "x") still work fine at this point. 'tcpdump' shows the persisient 636/tcp connection still with bidirectional traffic (PUSH/ACKs and ACKs like normal). After restarting Dovecot, things are fine until next time. I guess I could try and get login_ldap working with bsdauth, but if there's an issue in the Dovecot LDAP support I'd like to see it fixed. Any ideas? Thanks, Adrian Close P.S. I note the LDAP timeout logging patch but it won't apply easily to rc17 and I'm hoping the issue has progressed since then anyway...

7 14

[Dovecot] X-UID: 4085788205 != 2147483647
by Stephen Gowing 23 Jan '07

23 Jan '07

Hi, Dovecot (at least versions 0.99.10.4, 0.99.11, 1.0rc15, rc17 and rc18) allows message Unique Identifiers to be an unsigned 32 bit value, so something like "X-UID: 4085788205" is allowed. Some IMAP clients I've tested (Thunderbird 1.5.0.9, SquirrelMail 1.4.9a/PHP 4.3.2) appear to use signed 32 bit identifiers and request the above message as UID 2147483647 (max signed 32 bit integer). Evolution 2.0.2 fetches 4085788205 without complaint. Is there any chance Dovecot could decide to invalidate and renumber a folder when identifiers greater than 2147483647 are found? sbg

2 1

[Dovecot] mysteriously disappearing RECENT flag
by Vadim Zeitlin 22 Jan '07

22 Jan '07

Hello, I've decided to switch from UW-IMAP to Dovecot and so installed 1.0.rc15-2 on a Debian/Etch system and started using it with the existing MBOX folders. My configuration is pretty much the default one, in particular I didn't touch to any of mbox_xxx options. The (hoped for) performance improvements were indeed quite noticeable and mostly it works just fine but I seem to have one strange problem with the recent messages: Dovecot seems to reset the RECENT flag on the message right *before* the mailbox is opened. So even if a message was just copied to a folder (e.g. by email client filtering), it doesn't have RECENT flag when the mailbox is opened. Here is an example of what I see: % telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS STARTTLS AUTH=PLAIN] Dovecot ready. 1 login user password 1 OK Logged in. 2 status test (messages recent unseen) * STATUS "test" (MESSAGES 41 RECENT 0 UNSEEN 0) 2 OK Status completed. [--- switch to another window and copy a message to the test folder ---] 3 status test (messages recent unseen) * STATUS "test" (MESSAGES 42 RECENT 1 UNSEEN 0) 3 OK Status completed. 4 select test * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 42 EXISTS * 0 RECENT * OK [UIDVALIDITY 1048987099] UIDs valid * OK [UIDNEXT 407] Predicted next UID 4 OK [READ-WRITE] Select completed. 5 status test (messages recent unseen) * STATUS "test" (MESSAGES 42 RECENT 0 UNSEEN 0) 5 OK Status completed. 6 fetch 42 flags * 42 FETCH (FLAGS (\Seen)) 7 logout * BYE Logging out 7 OK Logout completed. Connection closed by foreign host. Why does Dovecot send "0 RECENT" when the mailbox is opened when it had just told that there was a recent message in it? And why is the message effectively old (no \Recent in the FETCH reply)? Notice that if I look at the MBOX file I see "Status: R" until command number 7, it becomes "Status: RO" only when I log out -- but internally Dovecot clearly considers it to be old long before that. Am I doing something wrong? Or is this the expected behaviour and, in this case, is there any way to change it to the more expected one (UW-IMAP-like)? Thanks in advance, VZ

2 3

[Dovecot] RC18 core dumps
by Cassidy B. Larson 22 Jan '07

22 Jan '07

Still seeing a few core dumps via the deliver process and corrupted transaction log files with RC18: Jan 22 10:46:36 zahara deliver(user(a)host.com): Corrupted transaction log file /data/mail/host.com/us/user(a)home.com/dovecot.index.log: start_offset (71680) > file size (71520) Jan 22 10:46:36 zahara deliver(user(a)host.com): seq = 6, rec->uid = 0, first_new_seq = 6, records = 5 Jan 22 10:46:36 zahara kernel: pid 41186 (deliver), uid 127: exited on signal 6 (core dumped) Jan 22 10:50:17 zahara deliver(user(a)host.com): Corrupted transaction log file /data/mail/host.com/us/user(a)host.com/dovecot.index.log: Append with UID 512, but next_uid = 513 However, if the user gets another email, it appears deliver doesnt core dump again. Thoughts? -c

2 1

[Dovecot] mail_log plugin in RC18
by Roger Weeks 22 Jan '07

22 Jan '07

On Jan 22, 2007, at 8:37 AM, Timo Sirainen wrote: > + Added mail_log plugin to log various mail operations. Currently it > logs mail copies, deletions, expunges and mailbox deletions. Hi Timo - I saw this addition and it sounds very useful in our enviroment. Can the plugin be enabled for specific users? Or is is a system-wide only plugin? -- Roger J. Weeks Systems & Network Administrator Mendocino Community Network

3 2

[Dovecot] Logging
by Ioannis Zachariadis 22 Jan '07

22 Jan '07

I use the syslog facility for logging purposes. I was wondering if there is a way to redirect all logs to mail.* For example, there are user.* messages.. can I change all of them to mail.* ? thanks. -- giannis.

3 9

[Dovecot] Dovecot rc15 crash in mbox-sync-update.c
by Steven F Siirila 22 Jan '07

22 Jan '07

Here is another crash we've been seeing recently in rc15 on Solaris 10. (gdb) bt full #0 0xff1c12a4 in ?? () No symbol table info available. #1 0xff140040 in ?? () No symbol table info available. #2 0x000786a8 in t_buffer_alloc (size=688976) at data-stack.c:346 __PRETTY_FUNCTION__ = "file %s: line %" #3 0x00078190 in t_pop () at data-stack.c:149 frame_block = (struct stack_frame_block *) 0x7fffffff #4 0x00042a90 in mbox_sync_update_status (ctx=0x8f7e0) at mbox-sync-update.c:267 No locals. #5 0x00041730 in mbox_sync_rewrite (sync_ctx=0xffbff548, mail_ctx=0x39d5, end_offset=14098141, move_diff=27645, extra_space=1, first_seq=45, last_seq=163) at mbox-sync-rewrite.c:552 mails = (struct mbox_sync_mail *) 0xcf238 offset = 1 dest_offset = 4294967295 next_end_offset = 14079696 next_move_diff = 6 start_offset = 1275633 expunged_space = 0 idx = 185 first_nonexpunged_idx = 0 padding_per_mail = 50 count = 542 ret = 0 __PRETTY_FUNCTION__ = "mktime(today) fail" #6 0x0003db84 in mbox_sync (mbox=0xc09c0, flags=32407386) at mbox-sync.c:1375 index_sync_ctx = (struct mail_index_sync_ctx *) 0xc1d58 sync_view = (struct mail_index_view *) 0xc1d90 sync_ctx = {mbox = 0xc09c0, flags = 0, input = 0xc5878, file_input = 0xc5750, write_fd = 10, index_sync_ctx = 0xc1d58, sync_view = 0xc1d90, t = 0xc3340, hdr = 0xc1dd8, header = 0xb6900, from_line = 0xb68d8, base_uid_validity = 1143728609, base_uid_last = 5161, base_uid_last_offset = 1538, mails = {buffer = 0xb6928, element_size = 56}, syncs = {buffer = 0xb6950, element_size = 20}, sync_rec = {uid1 = 0, uid2 = 0, type = 0, add_flags = 0 '\0', remove_flags = 0 '\0', keyword_idx = 0}, mail_keyword_pool = 0xc3598, saved_keywords_pool = 0xc36a0, prev_msg_uid = 5494, next_uid = 5709, idx_next_uid = 1, seq = 586, idx_seq = 587, need_space_seq = 45, expunged_space = 0, space_diff = -27680, dest_first_mail = 0, first_mail_crlf_expunged = 0, delay_writes = 0} seq = 4294967295 offset = 18446744073709551615 lock_id = 3 ret = 0 changed = 1 #7 0x0003e2c8 in mbox_sync (mbox=0xb8128, flags=0) at mbox-sync.c:1312 index_sync_ctx = (struct mail_index_sync_ctx *) 0x7e9 sync_view = (struct mail_index_view *) 0x1ee3429 sync_ctx = {mbox = 0x164d, flags = MBOX_SYNC_LAST_COMMIT, input = 0x24a, file_input = 0x24b, write_fd = 45, index_sync_ctx = 0x0, sync_view = 0x0, t = 0x0, hdr = 0xffffffff, header = 0xffff93e0, from_line = 0x0, base_uid_validity = 0, base_uid_last = 0, base_uid_last_offset = 18428719917034373157, mails = {buffer = 0x10, element_size = 753960}, syncs = {buffer = 0xb7e14, element_size = 753960}, sync_rec = {uid1 = 753104, uid2 = 752648, type = 563200, add_flags = 0 '\0', remove_flags = 8 '\b', keyword_idx = 788928}, mail_keyword_pool = 0x0, saved_keywords_pool = 0x0, prev_msg_uid = 13, next_uid = 2155905152, idx_next_uid = 7, seq = 4290770536, idx_seq = 433948, need_space_seq = 563200, expunged_space = -18024225394221448, space_diff = 2418925581670400, dest_first_mail = 0, first_mail_crlf_expunged = 0, delay_writes = 0} seq = 32386076 offset = 2516850835456 lock_id = 4294967295 ret = 788928 changed = 753960 #8 0x00069f24 in mail_storage_class_register (storage_class=0xb8128) at mail-storage.c:42 No locals. #9 0x00028fe0 in imap_sync_deinit (ctx=0xc09c0) at imap-sync.c:83 status = {messages = 706560, recent = 705536, unseen = 0, uidvalidity = 0, uidnext = 753216, first_unseen_seq = 0, keywords = 0x3e7} #10 0x00021248 in cmd_status (cmd=0xb7e14) at cmd-status.c:91 client = (struct client *) 0xb7dd0 args = (struct imap_arg *) 0xb8078 status = {messages = 745216, recent = 2, unseen = 4290771088, uidvalidity = 0, uidnext = 0, first_unseen_seq = 0, keywords = 0xffbff830} storage = (struct mail_storage *) 0xb7c08 real_mailbox = 0xb8128 "mail/AutoFiled/2006" str = (string_t *) 0x10 #11 0x0002287c in client_handle_input (cmd=0xb7dd0) at client.c:380 client = (struct client *) 0x210e8 __PRETTY_FUNCTION__ = "parameter \0\0\0\0\0\0Inva" #12 0x0007e3bc in timeout_add (msecs=743112, callback=0xab800, context=0xac400) at ioloop.c:152 timeout = (struct timeout *) 0x2 #13 0x0007dcb4 in _seek (stream=0xb56c8, v_offset=3039960672808960, mark=116) at istream-mmap.c:149 No locals. #14 0x0002ab24 in main (argc=-4195379, argv=0xab800, envp=0xac400) at main.c:123 No locals. (gdb) quit -- Steven F. Siirila Office: Lind Hall, Room 130B Internet Services E-mail: sfs(a)umn.edu Office of Information Technology Voice: (612) 626-0244 University of Minnesota Fax: (612) 626-7593

2 9

[Dovecot] can i set "folder alias"?
by John Wong 22 Jan '07

22 Jan '07

when i use mailclientA to send mail, then the mailclientA program default will save it to folder "sendA", when i use mailclientB to send mail, then the mailclientB program default will save it to folder "sendB". i know i can configure the mailclient program to use which folder, but can i set something like "folder alias"? imap { # ln -s sendA sendB folder alias = "sendA = sendB"; folser alias = "draftA = draftB"; ....... } i use dovecot-1.0rc17, imap, maildir sorry, i don't speak english

3 2