- dovecot - dovecot.org

[Dovecot] Problem with domain part in user_query in dovecot 1.1.14
by Konstantin 18 May '09

18 May '09

Hi. I'm using dovecot 1.1.14 with pgsql. I tried to configure dovecot to get the domain part in user_query by specifying different variants of auth_username_format variable such as %Lu, %Lu@%Ld, %Lu-at-%Ld and so on... So dovecot gets domain part in password_query, but not in user_query. I noticed the username is changed like this: kostas(a)mgupb.net->kostas in log. For some reason it happens before user_query so there is no domain part already. So one thing that had worked out for me was commenting the below code in src/auth/auth-request.c: if (strcmp(request->user, value) != 0) { /* remember the original username for cache */ if (request->original_username == NULL) { request->original_username = p_strdup(request->pool, request->user); } auth_request_log_debug(request, "auth", "username changed %s -> %s", request->user, value); request->user = p_strdup(request->pool, value); } I know that it is not so good, but it is working for me, now everything is fine, but I want it working without code deformations. What should I do? Thanks. P.S. Such things were in 1.1.11 from which I upgraded to 1.1.14 last night. Dovecot config: # 1.1.14: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.0-RELEASE amd64 protocols: imap imaps pop3 pop3s ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 0 mail_privileged_group: mail maildir_copy_preserve_filename: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_enable_last(default): no pop3_enable_last(imap): no pop3_enable_last(pop3): yes pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login digest-md5 user: vmail username_format: %Lu verbose: yes debug: yes passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix dovecot-sql.conf: driver = pgsql connect = host=localhost dbname=hosting_db user=hosting_db password=adsfweae password_query = SELECT NULL AS password, 'Y' as nopassword, userid AS user FROM main.mail_base WHERE userid = '%n' AND password = '%w' and domain='%d' #password_query = SELECT password, userid AS user FROM main.mail_base WHERE user id = '%n' and domain='%d' #user_query = SELECT '/var/mail/vhosts/' || domain || '/' || userid as mail, '/v ar/mail/vhosts/' || domain || '/' || userid as home, uid, gid FROM main.mail_bas e WHERE userid = '%n' and domain='%d' user_query = SELECT '/var/mail/vhosts/' || domain || '/' || userid as mail, '/va r/mail/vhosts/' || domain || '/' || userid as home, uid, gid FROM main.mail_base WHERE userid = '%n' and domain='%d' default_pass_scheme = PLAIN -- Konstantin <kostas(a)mgupb.net>

2 2

[Dovecot] "Broken mailbox list" with virtual plugin
by Matthijs Kooijman 18 May '09

18 May '09

Hi, I'm using the virtual plugin for a virtual inbox (with dovecot 1.2, r8980), whose dovecot-virtual file looks as follows: INBOX INBOX/Lists INBOX/Bulk INBOX/MaybeSpam Folders/TODO all Everything seems to work fine, but I get the following error in my logfiles: IMAP(matthijs): virtual /home/matthijs/Mail/virtual/INBOX: Broken mailbox list Some investigation of the source code tells me that this error means that there was corrupt data in the index. In particular, the ext_data read from the index was not long enough to contain all mailbox names. Adding some debug code confirms this: ext_size: 187 ext_data: \b0\5\0\0\5\0\0\0E\0\0\0\17\20w\9c\1\0\0\0\5\0\0\0\e9\af\e4I\92\1\0 \0\e7\2\0\0\0\0\0\0\7\0\0\0\b\0\0\0\e8\af\e4IO\3\0\0\5c\5\0\0\0\0\0 \0\8\0\0\0\a\0\0\0\ed\af\e4I\e6\0\0\0j\1\0\0\0\0\0\0\9\0\0\0\f\0\0 \0\3a\b0\e4I1\0\0\0e\0\0\0\0\0\0\0E\0\0\0\c\0\0\0\eb\af\e4I\c8\0\0 \0e\0\0\0\0\0\0\0INBOXINBOX/ListsINBOX/BulkINBOX/MaybeSpamFolders/TO ext_hdr: change_counter=1456 mailbox_count=5 highest_mailbox_id=69 search_args_crc32=2625052695 mailbox: id=1 name_len=5 uid_validity=1239724009 next_uid=402 higest_modseq=743 mailbox name: INBOX mailbox: id=7 name_len=11 uid_validity=1239724008 next_uid=847 higest_modseq=1372 mailbox name: INBOX/Lists mailbox: id=8 name_len=10 uid_validity=1239724013 next_uid=230 higest_modseq=362 mailbox name: INBOX/Bulk mailbox: id=9 name_len=15 uid_validity=1239724090 next_uid=49 higest_modseq=101 mailbox name: INBOX/MaybeSpam mailbox: id=69 name_len=12 uid_validity=1239724011 next_uid=200 higest_modseq=101 virtual /home/matthijs/Mail/virtual/INBOX: Broken mailbox list As you can see in the ext_data dump, the last mailbox name (Folders/TODO) is cut short. I'm not so sure what caused this error. I've just tried removing the index files, which seems to fix the error message. The index file gets recreated and my debug statements show proper output. Another solution is adding an extra file to the folder list, in which case the index will get fixed as well. Perhaps it would be good to recreate the index file when this error is found, instead of complaining? Also, from the code (virtual_sync_ext_header_read in src/virtual/virtual-sync.c) it seems that the last mailbox should be skipped because of this error, but the mailbox works fine. I'm probably not looking closely enough :-) I haven't been able to reliably break the index file with some quick testing (reconnecting, restarting and modifying the mailbox list), but I did manage to break it once (by removing a mailbox from halfway the list, and then adding it again). I couldn't reproduce that, though, since removing a mailbox doesn't always seem to recreate the index for some reason... I've also just upgraded to the latest version, so if this is a bug fixed between r8980 and r9018, then you'll probably not hear from me again :-) I hope all this info helps a bit, I'm available for further debugging and testing (also on IRC, nick is blathijs). Gr. Matthijs

2 2

Re: [Dovecot] Fail2Ban and the Dovecot log
by Lou Duchez 18 May '09

18 May '09

Re: the "dovecot: " at the beginning of the line in the log. I should mention that other applications encounter a similar issue with Fail2Ban -- for example, if you're running Asterisk, you have to alter the log format such that the timestamp is at the beginning of the line: http://www.voip-info.org/wiki/view/Fail2Ban+(with+iptables)+And+Asterisk

5 16

[Dovecot] Virtual mailbox plugin, crashing?
by Brandon Lamb 18 May '09

18 May '09

Hello, Using virtual mailbox plugin and all of a sudden started getting these. Deleted the indexes from ~/Maildir/virtual/Inboxmail and all was good again. dovecot: 2009-05-10 10:05:44 Error: child 26607 (imap) killed with signal 11 (core dumps disabled) Inboxmail/dovecot-virtual: virtual/All inthread refs x-mailbox INBOX All/dovecot-virtual: * -Archive/ -Drafts/ -Trash/ -Trash/* -Deleted* -Junk* -Spam/ -Sent* all I have had this happen 2 or 3 times now, I thought maybe the first couple were flukes from messing with the dovecot-virtual files, then sometime between last night and now this started to give those errors. I am taking a guess that is it is some kind of indexing issue since just deleting those seems to fix it. Not sure what other info I could send, turning mail_debug = yes didnt give any useful info in dovecot.log

2 2

[Dovecot] Backtrace error
by Brandon Lamb 18 May '09

18 May '09

I noticed i had mail_location wrong, i was specifying INDEX=/dovecot-index instead of INDEX=~/dovecot-index so i modifed and restarted dovecot, one of my techs that happens to have thousands of emails reopened her mail and this showed up in the log. Not sure if this is critical or if more info/dovecot -n is needed dovecot: 2009-05-05 14:06:38 Panic: imap <REMOVED>: file mail-search.c: line 712 (mail_search_args_equal): assertion failed: (args1->simplified == args2->simplified) dovecot: 2009-05-05 14:06:38 Error: imap <REMOVED>: Raw backtrace: imap [0x4a3042] -> imap [0x4a30c3] -> imap [0x4a2796] -> imap [0x467ffa] -> imap(mail_thread_init+0xaa) [0x463a5a] -> imap(index_storage_search_init+0x132) [0x45e222] -> /usr/local/lib/dovecot/imap/lib20_virtual_plugin.so(virtual_search_init+0x13) [0x7fedbd5d1d73] -> imap(index_search_result_update_appends+0xac) [0x4660ec] -> /usr/local/lib/dovecot/imap/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1383) [0x7fedbd5d5123] -> imap(mailbox_sync+0x30) [0x46a7c0] -> imap(cmd_select_full+0x383) [0x420613] -> imap [0x422d8c] -> imap [0x422e4a] -> imap(client_handle_input+0x35) [0x4234b5] -> imap(client_input+0x63) [0x423963] -> imap(io_loop_handler_run+0xcb) [0x4aae9b] -> imap(io_loop_run+0x18) [0x4aa328] -> imap(main+0x52b) [0x42b7fb] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x7fedbde095a6] -> imap [0x41bcf9] dovecot: 2009-05-05 14:06:38 Error: child 18843 (imap) killed with signal 6 (core dumps disabled)

2 1

[Dovecot] Deliver hangs after reloading the Dovecot configuration
by Pascal Volk 17 May '09

17 May '09

Hello Timo, deliver hangs after reloading the Dovecot configuration. How to reproduce: 1. start dovecot 2. deliver a message via deliver 3. modify dovecot.conf:plugin {quota_rule} 4. kill -HUP $PID_of_dovecot 5. deliver the next message via deliver Dovecot v1.2.beta2 died in this case with a panic: file dict-process.c: line 152 (dict_listener_input): assertion failed: (listener->processes == NULL) Raw backtrace: /usr/local/dovecot12/sbin/dovecot [0x411832] -> /usr/local/dovecot12/sbin/dovecot [0x411944] -> /usr/local/dovecot12/sbin/dovecot [0x40acce] -> /usr/local/dovecot12/sbin/dovecot [0x410fc6] -> /usr/local/dovecot12/sbin/dovecot [0x40576a] -> /usr/local/dovecot12/sbin/dovecot [0x414e6b] -> /usr/local/dovecot12/sbin/dovecot [0x414308] -> /usr/local/dovecot12/sbin/dovecot [0x40b29d] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x7f5e508cd5a6] -> /usr/local/dovecot12/sbin/dovecot [0x4032f9] deliver(j.doe(a)example.com): May 11 23:30:45 Error: Internal quota calculation error deliver(j.doe(a)example.com): May 11 23:30:45 Error: sieve: msgid=<000@nobody>: failed to store into mailbox 'INBOX': Internal error occurred. Refer to server log for more information. [2009-05-11 23:30:45] After the panic I have compiled the latest sources from the Mercurial repository (changeset: 9021:e36a9edb5fb0). A full backtrace is attached to this message. # 1.2.rc3: /usr/local/dovecot12/etc/dovecot.conf # OS: Linux 2.6.29.2-1 x86_64 Debian squeeze/sid log_path: /usr/local/dovecot12/var/log/dovecot.log protocols: imap listen: 192.168.111.222:10143 ssl: no disable_plaintext_auth: no login_dir: /usr/local/dovecot12/var/run/dovecot/login login_executable: /usr/local/dovecot12/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 70000 first_valid_gid: 70000 mail_privileged_group: mail mail_location: maildir:~/Maildir mail_debug: yes mail_plugins: quota imap_quota auth default: mechanisms: digest-md5 cram-md5 login plain user: nobody verbose: yes debug: yes passdb: driver: sql args: /usr/local/dovecot12/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/dovecot12/etc/dovecot-sql.conf socket: type: listen master: path: /usr/local/dovecot12/var/run/dovecot/auth-master mode: 384 plugin: quota: dict:user::proxy::quotadict quota_rule: *:storage=10M:messages=111 quota_rule2: Trash:storage=50%% dict: quotadict: pgsql:/usr/local/dovecot12/etc/dovecot-dict-quota.conf /usr/local/dovecot12/etc/dovecot-dict-quota.conf: connect = host=/var/run/postgresql dbname=db user=user password=password map { pattern = priv/quota/storage table = quota12 username_field = username value_field = bytes } map { pattern = priv/quota/messages table = quota12 username_field = username value_field = messages } Regards, Pascal -- The trapper recommends today: beeffeed.0913222(a)localdomain.org .

2 2

[Dovecot] procmail & formail
by Mohsen Pahlevanzadeh 17 May '09

17 May '09

Dear all, i have a mail server & vpopmail. Now, i want to copy from each message to a directory.i find a way to do it. i put following line in .qmail-default : |formail -X "" > ~/text.txt Of course above line is test.Given line doesn't retrieves Return* header field. My question: How i retrieve entire email same itslef? Yours, Mohsen

1 0

[Dovecot] Unable to subscribe to newly created subfolders under public mailboxes with acl plugin enabled
by Max Ivanov 17 May '09

17 May '09

I've "group" namespace and b2b mailbox under it. I'm unable to subscribe to it and deliver emails there. Here is my problem: if I create subfolder (lets name it "subf") under b2b mailbox I'm unable to subscribe to it until acl plugin is enabled. Even if I put dovecot-acl file in .b2b.subf folder with anyone full rights dovecot-acl-list doesn't get populated with new subfoler. If I put it there manually I'm able to see subf folder in subscribe dialog in TB, but dovecot-acl-list is regulary updated, isn't it? Updated file is missing subf entry again. If I disable acl plugin everything works fine, but I'd like to keep it enabled. Is it a bug or misconfiguration? My dovecot version is 1.2 rc3 here is dovecot -n authput protocols: imap managesieve ssl: yes ssl_ca_file: /usr/share/ca-certificates/floristCA-cacert.pem ssl_cert_file: /var/lib/ssl/certs/imap.florist.my-cert.pem ssl_key_file: /var/lib/ssl/private/imap.florist.my-key.pem ssl_cipher_list: ALL:!LOW:!SSLv2 disable_plaintext_auth: yes verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login login_processes_count: 5 verbose_proctitle: yes first_valid_uid: 1000 mail_privileged_group: mail mail_location: maildir:/var/spool/mail/dovecot/%n:INBOX=/var/spool/mail/dovecot/%n/INBOX mail_debug: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_plugins(default): acl fts fts_squat mail_plugins(imap): acl fts fts_squat mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: group/ location: maildir:/var/spool/mail/groupmail list: yes subscriptions: yes auth default: verbose: yes passdb: driver: pam args: session=yes userdb: driver: passwd args: blocking=yes socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 438 plugin: acl: vfile lazy_expunge: .EXPUNGED/ .DELETED/ .DELETED/.EXPUNGED/ sieve: ~/.dovecot.sieve sieve_storage: ~/sieve fts: squat fts_squat: partial=4 full=4

3 2

[Dovecot] Unable to delete folder in public namespace
by Max Ivanov 17 May '09

17 May '09

I use public namespace for group mailboxes. Users are able to create subfolders , but its impossible to delete them. thunderbird 2.0.0.21 complains: "Cant' rename mailbox to another storage type", both namespaces (private and public) use same storage type, so I believe that it's a namespace problem. Is there any way to move folders between namespaces? Or maybe sieve script or plugin which intercept move command and do the move to some unsibscribible folder in public namespace.

2 1

[Dovecot] namespace list not working in dovecot 1.2 revision 9027:421393827a81
by Jonathan Siegle 17 May '09

17 May '09

In my config that has worked for some time I have: namespace private { separator = / prefix = ~/ hidden = yes list = no # for v1.1+ } 1 list "~/" * 1 OK List completed. 2 list "~/" % 2 OK List completed. I _think_ that the last time I tested this was 2 weeks ago but it might have been 1 week ago. Thanks, Jonathan

2 1

[Dovecot] Question about IMAP
by Charles Marcus 17 May '09

17 May '09

Hi Timo, I have a question that you can maybe answer off the top of your head, considering your vast knowledge of the IMAP protocol... There is a Thunderbird bug that is near and dear to my heart, that is trying to address how Thunderbird deals with large messages (ie, messages with large attachments). Current behavior sucks... it downloads the entire message every time the message is clicked on. My question is: Using the IMAP protocol, is there a way, *without* downloading the entire message (specifically, binary attachments), that an IMAP client can do the following: 1. Download *only* the message headers and the text/html/body contents of the body of the message but *not* any binary attachments, 2. Detect that a message *has* one or more binary attachments, *without* downloading them, 3. Grab the names of all of the attachments, 4. Display for the user the email/email headers and text/html body parts, 5. Display the existence of the attachments in whatever manner the client normally shows them (in TBird, they show at the bottom of the message just above the status bar), 6. Download the actual attachment on demand - ie, if/when it is dbl-click > opened, right-click > saved, or the message is forwarded? Pointers to appropriate IMAP protocol docs would be happily passed on to them the Mozilla dev guys. Thanks! -- Best regards, Charles

2 5

[Dovecot] LDAP auth_bind fails to process certain LDAP server responses (Windows AD)
by Konstantin Khomoutov 15 May '09

15 May '09

LDAP auth backend in Dovecot 1.1.5 seemingly fails to handle certain paths of interaction with LDAP server, which is Windows AD running Windows 2003 server machine in my case. The symptoms I observe look exactly as were already reported in [1]: authentication backend "hangs" after logging the fact it has sent the search request, then after a while the IMAP/POP3 connection is teared down by the server due to idle condition. In the mentioned mail thread, it was proposed that if Dovecot doesn't log any LDAP server response, there is no such response, so I dumped the TCP traffic going between the backend and the server, and studied what happens with different settings. The result is that it seems LDAP auth backend doesn't understand the case when the server offerrs one or more "referrals" which the client might want to check. It seems that the backend tries to do something else after it gets such a result from the LDAP server even if the server returned an entry matching the search request. The described behaviour manifests itself with Windows AD only if I specify the domain name alone as the search base, e.g. "dc=mydomain,dc=com". If I also include at least one OU, the server doesn't return its list of referrals and Dovecot LDAP auth backend works OK. I attached two files produced by tcpdump -- one with "hung" search request, and another with successful one. They are: 1) ldap-hung.pcap.gz Captured with /etc/dovecot/dovecot-ldap.conf settings: hosts = domain007.com dn = saslauthd(a)domain007.com dnpass = "secret" auth_bind = yes base = dc=domain007, dc=com pass_filter = (&(objectClass=person)(sAMAccountName=%u)) Packet #8 is of interest in this dump. 2) ldap-ok.pcap.gz Captured with /etc/dovecot/dovecot-ldap.conf settings: hosts = domain007.com dn = saslauthd(a)domain007.com dnpass = "secret" auth_bind = yes base = cn=Users, dc=domain007, dc=com pass_filter = (&(objectClass=person)(sAMAccountName=%u)) The only difference compared to the first case is the "cn=Users" prepended to the base DN, which prevents the server from attaching a list of referrals. In both cases "search result done" is present in the server response. 3) ldap-ldapsearch.pcap.gz This dump captures the conversation of the ldapsearch utility with the same server using the same parameters Dovecot LDAP auth backend uses in the first case. ldapsearch invocation was like this: $ ldapsearch -h domain007.com -x -D saslauthd(a)domain007.com -w secret -a always -b dc=domain007,dc=com '(&(objectClass=person)(sAMAccountName=kostix))' General configuration info (package from Debian stable): # dovecot --version 1.0.15 # dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: verbose: yes debug: yes passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: passwd 1. http://www.mail-archive.com/dovecot@dovecot.org/msg09174.html

1 0

[Dovecot] Possibly dumb questions about DC and user/system limits
by Stewart Dean 15 May '09

15 May '09

Because of user access growth, the number of processes associated with IMAP has increased and I thought to change some of the configured parms. dovecot -n yields: # 1.1.14: /usr/local/etc/dovecot.conf # OS: AIX 1 005A928C4C00 listen: *:143 ssl_listen: *:993 disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_processes_count: 12 login_max_processes_count: 774 max_mail_processes: 1280 mail_max_userip_connections: 12 verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u mbox_write_locks: fcntl mbox_dirty_syncs: no auth default: passdb: driver: pam userdb: driver: passwd The only changes was that max_mail_processes went from 1024 to 1280. Now I get a error message when I start DC: Warning: fd limit 2000 is lower than what Dovecot can use under full load (more than 2054). Either grow the limit or change login_max_processes_count and max_mail_processes settings So I changed the no_size and no_size_hard to 3500 and 4000 respectively in both dovecot and root AIX defines nosize:* *Sets the soft limit for the number of file descriptors a user process may have open at one time. an lsuser dovecot returns: dovecot id=417 pgrp=dovecot groups=dovecot shell=/bin/false daemon=true admin=false ... fsize=2097151 cpu=-1 data=262144 stack=65536 core=2097151 rss=65536 nofiles=3500 nofiles_hard=4000 I kill dovecot and all children and restart it....same error message What am I missing? Does the machine have to be rebooted for the no_size to be updated? -- ==== Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows.... ==== Stewart Dean, Unix System Admin, Bard College, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

3 4

[Dovecot] cmd_append_continue_parsing assertion failure
by Mike Abbott 15 May '09

15 May '09

Dovecot-1.1.14 on Mac OS X. Panic: IMAP(user): file cmd-append.c: line 266 (cmd_append_continue_parsing): assertion failed: (ctx->count == uid2 - uid1 + 1) Trivially reproducible: $ telnet mailserver 143 a login user password b append inbox Backtrace: 0 libSystem.B.dylib 0x00007fff8458aa92 __kill + 10 1 libSystem.B.dylib 0x00007fff84606a1c abort + 83 2 imap 0x0000000100069f3e default_fatal_finish + 70 3 imap 0x0000000100069f8c i_syslog_fatal_handler + 0 4 imap 0x00000001000696eb i_info + 0 5 imap 0x0000000100001406 cmd_append_continue_parsing + 434 6 imap 0x00000001000017a3 cmd_append + 407 7 imap 0x000000010000677e client_command_input + 33 8 imap 0x000000010000693f client_command_input + 482 9 imap 0x0000000100006a3e client_handle_input + 239 10 imap 0x0000000100006bc2 client_input + 148 11 imap 0x0000000100070f83 io_loop_handler_run + 272 12 imap 0x0000000100070348 io_loop_run + 55 13 imap 0x000000010000db95 main + 1635 14 imap 0x0000000100001010 start + 52

2 1

[Dovecot] Filesystems (was Re: Migration questions...)
by Seth Mattinen 15 May '09

15 May '09

Richard Hobbs wrote: > > Trouble is... i've been googling this as well, just now, and loads of > people say XFS has the better performance, but loads of other people say > ReiserFS has the better performance. It starts to become a religious argument at some point. > We have battery backed up RAID controllers too, in this new system, and > the systems are UPSd, so on that basis i'm still none the wiser! lol > > I appreciate your experience with XFS is a positive one, but even the > dovecot web site says XFS might now be a good choice... > > http://wiki.dovecot.org/MailboxFormat/Maildir > > What a tough decision! I know it probably won't make too much difference > in my situation, but i want this to be a very long-term solution, so > want to do it right first time! > > Any other opinions on XFS vs Reiserfs with Dovecot maildir? > > Thanks again! > > Richard. > If you have time to play "tweak the filesystem": http://everything2.com/index.pl?node_id=1479435 It's a good comparison of etx3, xfs, and reiser from a performance standpoint. Also try this if you want to pull the plug or randomly reboot and see what happens: http://brad.livejournal.com/2116715.html ~Seth

1 0

[Dovecot] Filesystem experience question was Migration questions
by Stewart Dean 15 May '09

15 May '09

Doing a cursory Google scan on journaled Linux filesystems, it seems that the three ground-up journaled FSes: XFS, reiser and JFS all have their separate strong points but all compare favorably. Reiser does a better job with many small files...which would seem to be the reality of maildir formatted inboxes. Any comments on that? Any war stories, that is, any comments on reliability, availability and recoverability of them. Support issues? Possible down the road orphaning? Is FS quotaing support and does it work well with a lot (for me that means 4000) users? Anybody using IBM's open source JFS? I currently use AIX and it's been as dependable as a hammer there. In some 20 years with AIX, I can count on the fingers of one hand the number of times that I've had to use fsck. We had one set of machines that would drop hard 2-3x a week due to a bad main electrical trunk splice....2 or 3 years of that and the worst I ever saw was having to BRS once every two months or so. OTOH, I distrust IBM's commitment to the little shop and affordable entry machines: this is fast vanishing in the pSeries/AIX world...or else we wouldn't be moving towards Linux. Thanks! Feel free to contact me offline if you deem this marginally related to DC. -- ==== Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows.... ==== Stewart Dean, Unix System Admin, Bard College, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

2 1

[Dovecot] Migration questions...
by Richard Hobbs 15 May '09

15 May '09

Hi All, We are soon to migrate our mail server from one piece of hardware to another and we would like to take this opportunity to optimize things. As a result, we would like to replace "uw-imapd" and "qpopper" with "dovecot". The version we will be installing is 1.1.13-2, as this is what is available through the latest Debian stable backports. We will also be using exim to deliver mail (through dovecot's deliver mechanism, of course). So... We are currently using the mbox format with uw-imapd, and would like to migrate to the fastest solution possible with dovecot on the new hardware. My understanding is that "multi-dbox" is not an option in this version anyway, maildir is OK, but not great, and "single-dbox" is therefore going to be the highest performing solution. Is single-dbox the fastest way to go, considering we're going to be using email in the following ways: - IMAP connections with all email in the Inbox (Gmail-style). - IMAP connections with email split into many IMAP folders. - POP3 connections with no email left on the server. - POP3 connections with *all* email left on the server. All connections check for new mail every 5 minutes (on average) and there are 50-60 users). Also, we are not able to change user behaviour in this instance, unfortunately. Can anyone see any problems with the above proposal? Hopefully not... One problem that may arise is the fact that when we migrate, all msg UIDs will be lost. If i'm not mistaken, this means that all emails will be treated by the mail client as brand new, and if through IMAP, will all go bold, and if through POP3, will all be downloaded again (if still on the server) and therefore duplicated in the mail client. If this is the case, is there anything we can do to stop this happening? Does the "Convert" plugin does this job well? Finally, I have a rough draft of our migration plan - is there anything horribly wrong in it that's going to cause lots of problems, that anyone can spot by any chance? 1. Install Debian with exim, mysqld (for Horde/IMP) and mailman. 2. Run an online update. 3. Rsync homedirs and inboxes onto new server, ready for initial exim configuration. 4. Configure exim as per existing mail server and test that mailing lists and normal email works. You should now have the existing mail delivery solution on the brand new hardware. 5. Once mail delivery is sorted, add "deb http://www.backports.org/debian lenny-backports main contrib non-free" into "/etc/apt/sources.list" and run "aptitude update && aptitude install debian-backports-keyring && aptitude update". 6. Install dovecot (at the time of writing, this was version 1.1.13-2) and configure to use existing mbox files (inboxes in /var/spool/mail/ and IMAP folders in /home/user/mail/) 7. Setup exim to use dovecot's "deliver" mechanism for interacting with the inboxes (which are still in mbox format). 8. Configure the "convert" plugin to begin converting the mail to dbox format. 9. Run something manually (if possible) to convert mailboxes before people connect, so the task is already done by the time the outage is over. 10. Give staff access to new speedy mail server! Thanks in advance, people - any help is greatly appreciated! :-) Richard. -- Richard Hobbs (IT Specialist) Toshiba Research Europe Ltd. - Cambridge Research Laboratory Email: richard.hobbs(a)crl.toshiba.co.uk Web: http://www.toshiba-europe.com/research/ Tel: +44 1223 436999 Mobile: +44 7811 803377

14 37

[Dovecot] IMAP subfolders and MBOX format
by Frank Bonnet 14 May '09

14 May '09

Hello folks I have a problem related to the mbox format I think First we use MBOX format with Dovecot 1.14 A user's here need to create some subfolders in his Imap space. Due to the use of MBOX format this is impossible from thunderbird as you cannot creat a directory in a file :-) So to help him I created manually on the mail server some directories into his imap space, Doing so we are able to see the folder and subfolders but it is not possible to move some other folders into the subfolder via the thunderdird client. Anyone to help me a bit ? Note : on another machine which use the Maildir format I can do whatever I want without problem. Thanks a lot.

2 1

[Dovecot] id:N13388 Disable storage of messages on server when read (pop3)
by Dimitrios Karapiperis 14 May '09

14 May '09

Hi there Is there any way in dovecot to disable the storage of messages on server when they are read/downloaded by the users (POP3). The server keeps the e-mail when users tick the option on their MUA to keep (leave) messages on server. dovecot 1.0.7 POP3 / maildir Thanks in advance Dimitrios Karapiperis postmaster [at] thessaloniki [dot] gr

3 3

[Dovecot] What's faster for getting mails into Rails: Dbmail & direct MySQL or net/pop with maildir
by Olaf Spaarmann 14 May '09

14 May '09

Hi, it's my first message in this list, so please excuse any mistakes! I have a quite specific problem and nobody in the Ruby on Rails lists could help me, because it is actually more a question for mail- experts. So I hope you can help me. I'm planning to set up a mailserver using dovecot. Users of my Rails App can forward their emails (john(a)doe.com) to an personal address (john.doe(a)myapp.com ). These emails will be received by my mailserver. So far so good, the tricky part is to get the mails into my Rails App for processing them. After that they will be deleted (so I'll never accumulate a big ammount of mails on the mailserver). I thought of 2 different approaches. 1) Just use a normal Dovecot setup, using maildir and get the mails with a mailpoller script, connecting to the server via Pop3 2) Use Dbmail for storing the emails, don't use Pop3 but let the mailpoller script connect to the database directly I understand that Dbmail seems to be slower than maildir (in terms of processing many incoming mails) but I'm not sure if a connection via net/pop (of the mailpoller script) is maybe that much slower than mysql that it wouldn't matter at all. What's your opinion? I'm gratefull for every hint. Thanks

2 1

[Dovecot] X-UIDL Ignored?
by Benjamin Wakefield 14 May '09

14 May '09

Hello! I am trying to migrate from Teapop to Dovecot. I'm using Dovecot 1.1.14. I need to make use of the X-UIDL header so clients don't download messages they've already received. I have the X-UIDL head in the message. I have pop3_reuse_xuidl(pop3): yes My problem is the X-UIDL in the message is being ignored and Dovecot is still generating it's own. The INBOX is an mbx file not Maildir. Should this work? Have I missed something? Thanks! Ben ==== BEGIN dovecot -n ==== # 1.1.14: /usr/local/dovecot-1.1.14/etc/dovecot.conf # OS: Linux 2.6.24.3-smp i686 Slackware 12.0.0 log_path: /usr/local/dovecot-1.1.13/var/log/dovecot.log protocols: imap imaps pop3 listen(default): * listen(imap): * listen(pop3): *:10100 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/dovecot-1.1.14/var/run/dovecot/login login_executable(default): /usr/local/dovecot-1.1.14/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot-1.1.14/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot-1.1.14/libexec/dovecot/pop3-login login_greeting: grape.dcsi.net.au dovecot pop3/imap server, go ahead. mail_location: mbox:~/mail:INBOX=/var/mail/%1u/%u mail_executable(default): /usr/local/dovecot-1.1.14/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot-1.1.14/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot-1.1.14/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/dovecot-1.1.14/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot-1.1.14/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot-1.1.14/lib/dovecot/pop3 pop3_reuse_xuidl(default): no pop3_reuse_xuidl(imap): no pop3_reuse_xuidl(pop3): yes pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %v.%u auth default: passdb: driver: shadow args: /etc/shadow passdb: driver: passwd-file args: /etc/passwd userdb: driver: passwd ==== END ====

2 2

[Dovecot] virtual mailbox users users can send, but can't read e-mail
by Ioan Nemes 13 May '09

13 May '09

Greetings, I am trying to add the second virtual mailbox domain (transco.org.au) to an existing Postfix/Dovecot/MySQL mail server. Users of the first virtual mailbox domain (transylvania.org.au) have no problems sending and receiving mail. Users belonging to the second virtual mailbox domain can successfully send mail to outside, however they won't receive the mail, though Postfix delivers the mail to the mail directories. The configuration: --------------------------------------------------------------------------------------- # dovecot --version 1.0.2 --------------------------------------------------------------------------------------- # dovecot -n # 1.0.2: /etc/dovecot.conf base_dir: /var/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/dovecotcert.pem disable_plaintext_auth: no login_dir: /var/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: _dovecot first_valid_uid: 5000 last_valid_uid: 5000 mail_location: maildir:/var/spool/vmboxbase/%d/%u mbox_write_locks: fcntl mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: bsdauth passdb: driver: sql args: /etc/dovecot-mysql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot-mysql.conf ---------------------------------------------------------------------------------------------------- password_query = SELECT password FROM users WHERE login = '%u' and active = 'Y' ----------------------------------------------------------------------------------------------------- SELECT password FROM users WHERE login = 'dummy(a)transco.org.au' and active = 'Y'; mysql> SELECT password FROM users WHERE login = 'dummy(a)transco.org.au' and active = 'Y'; +---------------+ | password | +---------------+ | Wdrbd5SLusraw | +---------------+ 1 row in set (0.00 sec) ------------------------------------------------------------------------------------------------------ user_query = SELECT home, maildir, uid, gid FROM users WHERE login = 'dummy' AND active = 'Y' ------------------------------------------------------------------------------------------------------ mysql> SELECT home, maildir, uid, gid FROM users WHERE login = 'dummy(a)transco.org.au'; +----------------------+-----------------------+------+------+ | home | maildir | uid | gid | +----------------------+-----------------------+------+------+ | /var/spool/vmboxbase | transco.org.au/dummy/ | 5000 | 5000 | +----------------------+-----------------------+------+------+ 1 row in set (0.00 sec) # more /etc/dovecot-mysql.conf # This file is opened as root, so it should be owned by root and mode 0600. # # http://wiki.dovecot.org/AuthDatabase/SQL # # For the sql passdb module, you'll need a database with a table that # contains fields for at least the userid and password. If you want to # use the user@domain syntax, you might want to have a separate domain # field as well. # # If your users all have the same uig/gid, and have predictable home # directories, you can use the static userdb module to generate the home # dir based on the userid and domain. In this case, you won't need fields # for home, uid, or gid in the database. # # If you prefer to use the sql userdb module, you'll want to add fields # for home, uid, and gid. Here is an example table: # # CREATE TABLE users ( # userid VARCHAR(128) NOT NULL, # password VARCHAR(64) NOT NULL, # home VARCHAR(255) NOT NULL, # uid INTEGER NOT NULL, # gid INTEGER NOT NULL, # active CHAR(1) DEFAULT 'Y' NOT NULL # ); # Database driver: mysql, pgsql, sqlite #driver = driver = mysql # Database connection string. This is driver-specific setting. # # pgsql: # For available options, see the PostgreSQL documention for the # PQconnectdb function of libpq. # # mysql: # Basic options emulate PostgreSQL option names: # host, port, user, password, dbname # # But also adds some new settings: # client_flags - See MySQL manual # ssl_ca, ssl_ca_path - Set either one or both to enable SSL # ssl_cert, ssl_key - For sending client-side certificates to server # ssl_cipher - Set minimum allowed cipher security (default: HIGH) # # You can connect to UNIX sockets by using host: host=/var/run/mysql.sock # Note that currently you can't use spaces in parameters. # # sqlite: # The path to the database file. # # Examples: # connect = host=192.168.1.1 dbname=users # connect = host=sql.example.com dbname=virtual user=virtual password=blarg # connect = /etc/dovecot/authdb.sqlite # #connect = dbname=virtual user=virtual connect = host=localhost dbname=mail user=dovecot password=dovecot # Default password scheme. # # List of supported schemes is in # http://wiki.dovecot.org/Authentication/PasswordSchemes # #default_pass_scheme = PLAIN-MD5 default_pass_scheme = CRYPT # Query to retrieve the password. # # This query must return only one row with "user" and "password" columns. # The query can also return other fields which have a special meaning, see # http://wiki.dovecot.org/PasswordDatabase/ExtraFields # # The "user" column is needed to make sure the username gets used with exactly # the same casing as it's in the database. Note that if you store username and # domain in separate fields, you most likely want to return a combination of # them as the "user" column, otherwise the domain gets stripped. # # Commonly used available substitutions (see # http://wiki.dovecot.org/Variables for full list): # %u = entire userid # %n = user part of user@domain # %d = domain part of user@domain # # Note that these can be used only as input to SQL query. If the query outputs # any of these substitutions, they're not touched. Otherwise it would be # difficult to have eg. usernames containing '%' characters. # # Example: # password_query = SELECT concat(userid, '@', domain) AS user, password FROM users WHERE userid = '%n' AND domain = '% d' # password_query = SELECT pw AS password FROM users WHERE userid = '%u' AND active = 'Y' # password_query = SELECT password FROM users WHERE login = '%u' and active = 'Y' # Query to retrieve the user information. # # The query must return only one row. Commonly returned columns are: # uid - System UID # gid - System GID # home - Home directory # mail - Mail location # # Either home or mail is required. uid and gid are required. If more than one # row is returned or there are missing fields, the login will fail. For a list # of all fields that can be returned, see # http://wiki.dovecot.org/UserDatabase/ExtraFields # # Examples # user_query = SELECT home, uid, gid FROM users WHERE userid = '%n' AND domain = '%d' # user_query = SELECT dir AS home, user AS uid, group AS gid FROM users where userid = '%u' # user_query = SELECT home, 501 AS uid, 501 AS gid FROM users WHERE userid = '%u' # #user_query = SELECT home, uid, gid FROM users WHERE userid = '%u' user_query = SELECT home, maildir, uid, gid FROM users WHERE login = '%u' AND active = 'Y' # If you wish to avoid two SQL lookups (passdb + userdb), you can use # userdb prefetch instead of userdb sql in dovecot.conf. In that case you'll # also have to return userdb fields in password_query prefixed with "userdb_" # string. For example: #password_query = SELECT userid as user, password, home as userdb_home, uid as userdb_uid, gid as userdb_gid FROM users WHERE userid = '%u' --------------------------------------------------------------------------------------- # ps -aux | grep dovecot root 13442 0.0 0.2 676 952 ?? Ss 4:27AM 0:00.04 /usr/local/sbin/dovecot root 10354 0.0 0.4 816 1920 ?? S 4:27AM 0:00.03 dovecot-auth root 8330 0.0 0.4 708 2080 ?? S 4:27AM 0:00.03 dovecot-auth -w _dovecot 29456 0.0 0.4 664 1876 ?? S 4:27AM 0:00.04 pop3-login _dovecot 12636 0.0 0.4 716 1868 ?? S 4:27AM 0:00.04 pop3-login _dovecot 26625 0.0 0.4 696 1896 ?? S 4:27AM 0:00.04 imap-login _dovecot 4709 0.0 0.4 556 1892 ?? S 4:27AM 0:00.04 imap-login _dovecot 10294 0.0 0.4 760 1888 ?? S 4:27AM 0:00.04 imap-login _dovecot 13526 0.0 0.4 596 1888 ?? S 4:59AM 0:00.01 pop3-login root 20523 0.0 0.1 472 748 p1 S+ 5:01AM 0:00.00 grep dovecot ----------------------------------------------------------------------------------------- # ls -ltr /var/spool/vmboxbase/transco.org.au/dummy/new total 40 -rw------- 1 vmail vmail 462 May 3 11:06 1241312770.V8I6be62M630453.vega.transylvania.org.au -rw------- 1 vmail vmail 708 May 3 11:15 1241313359.V8I6be6bM976701.vega.transylvania.org.au -rw------- 1 vmail vmail 658 May 3 11:21 1241313700.V8I6bd8aM30789.vega.transylvania.org.au -rw------- 1 vmail vmail 672 May 4 02:18 1241367523.V8I6be75M268056.vega.transylvania.org.au -rw------- 1 vmail vmail 706 May 4 02:31 1241368314.V8I6be7cM742941.vega.transylvania.org.au -rw------- 1 vmail vmail 658 May 4 02:54 1241369661.V8I6bd9bM991186.vega.transylvania.org.au -rw------- 1 vmail vmail 690 May 4 03:02 1241370177.V8I6bd98M300668.vega.transylvania.org.au -rw------- 1 vmail vmail 672 May 4 03:54 1241373297.V8I6bda1M149877.vega.transylvania.org.au -rw------- 1 vmail vmail 837 May 4 04:35 1241375739.V8I6bdaeM905070.vega.transylvania.org.au -rw------- 1 vmail vmail 842 May 4 04:36 1241375767.V8I6bdb4M496268.vega.transylvania.org.au ------------------------------------------------------------------------------------------------------------- When I try to retreive mail for user dummy(a)tarnsco.org.au, the folovig entry is created in /var/log/maillog, but no mail is retrived. The mail client agent is Thunderbird 2.0.22 ------------------------------------------------------------------------------------------------------------- May 4 06:04:51 vega dovecot: auth(default): client in: AUTH 1 PLAIN service=POP3 lip=192.168.1.212 rip=192.168.1.101 resp= May 4 06:04:51 vega dovecot: auth(default): client out: CONT 1 May 4 06:04:51 vega dovecot: auth(default): client in: CONT 1 AGR1bW15QHRyYW5zY28ub3JnLmF1AGR1bW15 May 4 06:04:51 vega dovecot: auth(default): bsdauth(dummy(a)transco.org.au,192.168.1.101): lookup May 4 06:04:51 vega dovecot: auth(default): bsdauth(dummy(a)transco.org.au,192.168.1.101): unknown user May 4 06:04:51 vega dovecot: auth-worker(default): sql(dummy(a)transco.org.au,192.168.1.101): query: SELECT password FROM users WHERE login = 'dummy(a)transco.org.au' and active = 'Y' May 4 06:04:51 vega dovecot: auth(default): client out: OK 1 user=dummy(a)transco.org.au May 4 06:04:51 vega dovecot: auth(default): master in: REQUEST 31 29200 1 May 4 06:04:51 vega dovecot: auth(default): passwd(dummy(a)transco.org.au,192.168.1.101): lookup May 4 06:04:51 vega dovecot: auth(default): passwd(dummy(a)transco.org.au,192.168.1.101): unknown user May 4 06:04:51 vega dovecot: auth-worker(default): sql(dummy(a)transco.org.au,192.168.1.101): SELECT home, maildir, uid, gid FROM users WHERE login = 'dummy(a)transco.org.au' AND active = 'Y' May 4 06:04:51 vega dovecot: auth(default): master out: USER 31 dummy(a)transco.org.au home=/var/spool/vmboxbase maildir=transco.org.au/dummy/ uid=5000 gid=5000 May 4 06:04:51 vega dovecot: pop3-login: Login: user=<dummy(a)transco.org.au>, method=PLAIN, rip=192.168.1.101, lip=192.168.1.212 May 4 06:04:51 vega dovecot: POP3(dummy(a)transco.org.au): Disconnected: Logged out top=0/0, retr=0/0, del=0/0, size=0 Any suggestion? Regards, Ioan

2 1

[Dovecot] Only specifying lda in protocols?
by Brandon Lamb 13 May '09

13 May '09

protocols = lda Should this give me fatal errors when trying to do a dovecot -n I get # 1.2.rc3: /etc/dovecot/dovecot.conf Error: Invalid protocols given in configuration file Fatal: Invalid configuration in /etc/dovecot/dovecot.conf Dovecot starts and functions fine though

2 1

[Dovecot] Dovecot 1.0.7 domain variable
by elliott＠n.localhost 13 May '09

13 May '09

Hi all, Thanks in advance for any help! I'm trying to configure Dovecot to pull emails from Postfix virtual mailbox domain Maildirs under /var/mail/vhosts/<domain>/<username>. I've set mail_location as such in dovecot.conf: mail_location = maildir:/var/mail/vhosts/%d/%n but from debug output I see the domain is blank: dovecot: May 10 20:49:25 Info: IMAP(elliott): maildir: data=/var/mail/vhosts//elliott I've set elliott(a)n.0o0.bz as my username in Outlook so it is sending the domain (and changed auth_username_format to "auth_username_format = %n" so authentication works fine) Why is %d blank here? Anything else to check?? I'm at a loss. Thanks! -elliott-

5 5

[Dovecot] New messages notification - (IMAP PUSH?)
by Proskurin Kirill 13 May '09

13 May '09

Hello all. I have strange problem. As I understand IMAP use server2client command to tell what new email is arrived. So - all was good, but few weeks ago I notice what my thunderbird not show new messages. I think it was local problem(I switch distro what day) but soon my email clients what uses mostly Outlook-2007-SP1 start to confirm this problem. What can it be and how can I fix it? I use Dovecot on FreeBSD-7.1 #pkg_info | grep dovecot dovecot-1.1.11 dovecot-managesieve-0.10.5 dovecot-sieve-1.1.6 #dovecot -n # 1.1.11: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.1-RELEASE-p3 i386 ufs base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot-debug.log protocols: imap imaps pop3 pop3s managesieve listen(default): * listen(imap): * listen(pop3): * listen(managesieve): *:2000 ssl_ca_file: /usr/local/etc/certs/GlobalSignCA.crt ssl_cert_file: /usr/local/etc/certs/fxclub_org.crt ssl_key_file: /usr/local/etc/certs/fxclub_org.key ssl_cipher_list: ALL:!LOW:!SSLv2 login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_greeting_capability(managesieve): no login_process_size: 128 login_processes_count: 20 login_max_processes_count: 512 mail_max_userip_connections(default): 256 mail_max_userip_connections(imap): 256 mail_max_userip_connections(pop3): 20 mail_max_userip_connections(managesieve): 10 verbose_proctitle: yes first_valid_gid: 0 mail_privileged_group: mail mail_uid: dmail mail_gid: dmail mail_location(default): maildir:/var/spool/dovecot/domains/%d/%n/ mail_location(imap): maildir:/var/spool/dovecot/domains/%d/%n/ mail_location(pop3): maildir:/var/spool/dovecot/domains/%d/%n/ mail_location(managesieve): mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_process_size: 512 mail_plugins(default): quota imap_quota autocreate mail_plugins(imap): quota imap_quota autocreate mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve imap_client_workarounds(default): delay-newmail tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail tb-extra-mailbox-sep imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): sieve_storage(default): sieve_storage(imap): sieve_storage(pop3): sieve_storage(managesieve): % sieve(default): sieve(imap): sieve(pop3): sieve(managesieve): ~/.dovecot.sieve auth default: mechanisms: plain login user: dovecot-auth username_format: %Lu verbose: yes worker_max_count: 100 passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf userdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 user: exim master: path: /var/run/dovecot/auth-master mode: 384 user: dmail plugin: quota: maildir quota_rule: *:storage=1024M quota_rule2: Trash:storage=1256M quota_rule3: SPAM:ignore quota_warning: storage=80%% /usr/local/bin/quota-warning.sh 80 quota_warning2: storage=95%% /usr/local/bin/quota-warning.sh 95 autocreate: Trash autocreate2: Sent autocreate3: Spam autosubscribe: Trash autosubscribe2: Sent autosubscribe3: Spam -- Best regards, Proskurin Kirill

6 15

[Dovecot] Dovecot shared quota with Maildir
by Jorgen Lundman 13 May '09

13 May '09

Hello list, We are in the process of exploring the idea of moving from UFS with fs-quota to using softquotas in Dovecot (probably Maildir type, stored in LDAP, all ontop of NFS). I have it setup, and it works rather well so far. But there is one situation we can currently support, which I can not see a solution for with soft-quotas. Generally customers get 1 email, with 1 quota. But it is also possible for customers to get 1 quota, but create multiple mail accounts, all sharing the same quota. This is done by using the same UID for each account when using fs-quota. (It is not that each account gets a fraction of the quota, but that all accounts add up to the one quota). Is this still possible to do with soft-quotas. To share one set. Dovecot would have to go count files in multiple mail-directories so I would guess no. Lund -- Jorgen Lundman | <lundman(a)lundman.net> Unix Administrator | +81 (0)3 -5456-2687 ext 1017 (work) Shibuya-ku, Tokyo | +81 (0)90-5578-8500 (cell) Japan | +81 (0)3 -3375-1767 (home)

2 4

[Dovecot] dovecot bug (maybe)
by Fernando Bertasso 13 May '09

13 May '09

I believe that dovecot is doing something strange, when it founds a 'corrupted' multipart and using fetch body. Look what I figured out: 1) Sent a message from squirrelmail (it wrongly drop the last \n from epilogue): ------=_20090512171902_78105 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit n ------=_20090512171902_78105 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: 8bit n <--------(squirrelmail didn´t insert an additional \n). ------=_20090512171902_78105-- 2) Sent a correct message, inserting the last '\n': ------=_20090512171902_78105 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit n ------=_20090512171902_78105 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: 8bit n ------=_20090512171902_78105-- 3) Compress both messages 4) Request the messages using: A004 UID FETCH 1 (FLAGS BODYSTRUCTURE) (the correct message): 127.000.000.001.00143-127.000.000.001.35604: * 1 FETCH (UID 1 FLAGS (\Seen) BODYSTRUCTURE (("text" "plain" ("charset" "iso-8859-1") NIL NIL "8bit" 7 3 NIL NIL NIL NIL)("text" "html" ("charset" "iso-8859-1") NIL NIL "8bit" *3 1*NIL NIL NIL NIL) "alternative" ("boundary" "----=_20090512171853_50085") NIL NIL NIL)) A004 OK Fetch completed. 5) Request the broken message: 127.000.000.001.00143-127.000.000.001.43679: * 2 FETCH (UID 2 FLAGS (\Seen) BODYSTRUCTURE (("text" "plain" ("charset" "iso-8859-1") NIL NIL "8bit" 7 3 NIL NIL NIL NIL)("text" "html" ("charset" "iso-8859-1") NIL NIL "8bit" *1 0*NIL NIL NIL NIL) "alternative" ("boundary" "----=_20090512171902_78105") NIL NIL NIL)) A004 OK Fetch completed. >From RFC the red numbers mean: size body, number of line for the body. This makes sense, because stripping the 'control' chars from first message, size and number of lines match. But in the second message, the line number is 0 - this does not make sense. You need to test this using telnet, because outlook and thunderbird did not follow this way, they use body.peek. What do you think? Fernando

1 0

[Dovecot] user_attrs seems not to set 'mail'.
by ian＠comtek.co.uk 12 May '09

12 May '09

Hi, I am using Dovecot 1.1.13 (from a Debian package). I was having problems using user_attrs to set 'mail' and 'home'. Initially I tried: user_attrs = uid=mail=maildir:/var/mail/virtual/users/%$/Maildir/,uid=home=/var/mail/virtual/users/%$/ This appeared to set 'home' but not 'mail'. In the debug lot I see: May 12 15:24:40 alpha dovecot: auth(default): ldap(X(a)Y,10.4.4.113): user search: base=ou=users,dc=Y scope=subtree filter=(& (mail=X@Y) (|(accountStatus=active) (accountStatus=migrate)) ) fields=uid,uid May 12 15:24:40 alpha dovecot: auth(default): ldap(X(a)Y,1.1.1.1): result: uid(home=/var/mail/virtual/users/%$/)=/var/mail/virtual/users/uid/ May 12 15:24:40 alpha dovecot: auth(default): master out: USER 30688 X@Y home=/var/mail/virtual/users/uid/ Note that 'home' seems to be set on the last line, but not 'mail'. I was hoping to see 'mail=/var/mail/virtual/users/uid/Maildir/'. Next I tried: user_attrs = =mail=maildir:~/Maildir/,uid=home=/var/mail/virtual/users/%$/ Now I see: May 12 15:31:28 alpha dovecot: auth(default): ldap(X(a)Y,1.1.1.1): user search: base=ou=users,dc=Y scope=subtree filter=(& (mail=X@Y) (|(accountStatus=active) (accountStatus=migrate)) ) fields=uid May 12 15:31:28 alpha dovecot: auth(default): ldap(X(a)Y,1.1.1.1): result: uid(home=/var/mail/virtual/users/%$/)=/var/mail/virtual/users/uid/ May 12 15:31:28 alpha dovecot: auth(default): master out: USER 30712 X@Y home=/var/mail/virtual/users/uid/ mail=maildir:~/Maildir/ Now both 'home' and 'mail' are set, which is what I want. This means the following lines are not synonymous: user_attrs = uid=mail=maildir:/var/mail/virtual/users/%$/Maildir/,uid=home=/var/mail/virtual/users/%$/ user_attrs = =mail=maildir:~/Maildir/,uid=home=/var/mail/virtual/users/%$/ Either I misunderstand the documentation for user_attrs or there is a bug. Assuming the former, can somebody please explain what I am doing wrong? Thanks, Ian

2 2

[Dovecot] Dovecot auth user lookup patch updated for maildrop 2.1.0
by mr.maX 12 May '09

12 May '09

Hi, an updated version of my patch for maildrop that extends it with the ability to perform user lookups against Dovecot's database made against the latest version of maildrop 2.1.0 can be downloaded from the following location: http://www.max.rs/ozone/maildrop-2.1.0-dovecotauth.patch.txt The patch has just been redone in order to apply cleanly without fuzz and to apply properly against one file that was changed in the latest version of maildrop. There have been no other changes compared to the initial version of the patch. For more information, take a look at my previous post to the Dovecot's mailing list at: http://www.dovecot.org/list/dovecot/2009-April/039121.html -- Best Regards, Marko Njezic - mr.maX @ MAX Interactive corp. Personal: http://www.markonjezic.com/ MAX's Empire: http://www.maxempire.com/ MAX's HTML Beauty++ 2004: http://www.htmlbeauty.com/

1 0

[Dovecot] Fail2Ban and the Dovecot log
by Lou Duchez 12 May '09

12 May '09

Hi, Is there any way to disable the "dovecot: " at the beginning of each line of the log? Fail2Ban responds poorly to it. I know there are a number of sites with "failregex" strings for Fail2Ban and Dovecot, but I've tried them all, and they don't work, at least with the latest Fail2ban and the latest Dovecot. The Fail2Ban wiki is pretty clear about why there will be a problem: "In order for a log line to match your failregex, it actually has to match in two parts: the beginning of the line has to match a timestamp pattern or regex, and the remainder of the line has to match your failregex.". So in other words, Fail2Ban expects that each line of the log will start with a timestamp. Thanks all! Dovecot rocks.

4 4

[Dovecot] Sieve & Regex
by Peregrino "Pipino" Tuc 12 May '09

12 May '09

Hi all I'm trying to create a new sieve rule. What I would like to do is catch "From" addresses that are equal to the rightpart (hostname) of a message-id. For example: Message-ID: <000d01c9d23a$941a7db0$6400a8c0@upwabm> From: "Leanne Crabtree" <upwabm(a)blomberg-co.com> I would like to catch this mail, because it has "upwabm" on the right part of the message-id and "upwabm" on the left part of the sender address. I've done this, but with no success. The error reported is: "Invalid preceding regular expression" on line with the second regex with ${1} More over I would like to add an header with the result of regex, an header like this: "X-MyHeader" "${1}" but it does not work. This is an extract of our sieve: --- require ["regex"]; if header :regex "Message-ID" "^.*(a)(.*)>$" { if header :regex "From" ".*<${1}@.*>$" { addheader "X-MyHeader" "${1}" } } ---

1 1

[Dovecot] Overwriting user Quota
by Thomas Krause 11 May '09

11 May '09

Dear List, I cannot overwrite the default quota. In dovecot.conf I have plugin { quota = maildir:User quota quota = dict:user::proxy::quotadict quota_rule = *:storage=380M:messages=10000 quota_rule2 = Trash:storage=100M } To overwrite, I put in dovecot-sql.conf user_query = SELECT CONCAT('/vmail/', maildir) AS home, \ CONCAT('maildir:/vmail/', maildir) as mail, \ CONCAT('*:bytes=', quota) AS quota_rule \ FROM mailbox WHERE username = '%u' AND active = '1' Debugging dovecot: imap-login: Login: user=<x(a)y.z>, method=PLAIN, rip=a.b.c.d, lip=e.f.g.h IMAP(x(a)y.z): Loading modules from directory: /usr/local/lib/dovecot/imap IMAP(x(a)y.z): Module loaded: /usr/local/lib/dovecot/imap/lib10_quota_plugin.so IMAP(x(a)y.z): Module loaded: /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so IMAP(x(a)y.z): Effective uid=101, gid=6, home=/vmail/x.z/x/ IMAP(x(a)y.z): Quota root: name=user backend=dict args=:proxy::quotadict IMAP(x(a)y.z): dict quota: user=x(a)y.z, uri=proxy::quotadict, noenforcing=0 IMAP(x(a)y.z): Quota rule: root=user mailbox=* bytes=398458880 messages=10000 IMAP(x(a)y.z): Quota rule: root=user mailbox=Trash bytes=104857600 messages=0 IMAP(x(a)y.z): Namespace: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes , subscriptions=yes mysql> select CONCAT('*:bytes=', quota) AS quota_rule FROM mailbox where username="x(a)y.z" and active=1; +-------------------+ | quota_rule | +-------------------+ | *:bytes=800000000 | +-------------------+ 1 row in set (0.00 sec) What is my mistake? I'm using dovecot 1.1.11 Best regards, Thomas.

2 1

[Dovecot] Quota over NFS
by Flavio Costa 11 May '09

11 May '09

Hey, I've been strugling to get quota working on my enviroment. I have one storage server that exports the 'home' dir. My mail server mounts the exported 'home' server at '/home' # dovecot --version > 1.1.14 I'm also running Postfix and using Dovecot/LDA as MDA so that we can use the Dovecot's Quota plugin. The thing is that if the user has exceeded it's quota the LDA detects it and I get a response from postmaster warning me that the INBOX is full. But through IMAP, if I issue : > C: 1 GETQUOTAROOT INBOX > S: * QUOTAROOT INBOX "" > S: 1 OK Getquota complete > > There's no: > * QUOTA "" (STORAGE 10 512) > > I've tried using this plugin for Thunderbird: https://addons.mozilla.org/pt-BR/thunderbird/addon/881 And also tested issuing commands by hand. Running 'quota' on the console works just fine, that means that rpc.rquotad is running smoothly. # quota USER > Disk quotas for user coutinho (uid 1191): > Filesystem blocks quota limit grace files quota limit > grace > home.mail:/home > 166264* 102400 153600 3013 0 > 0 > Thanks in advance for you help. -- Flávio Coutinho da Costa

4 7

[Dovecot] dovecot weird bug
by Fernando Bertasso 11 May '09

11 May '09

Hi, We have a weird bug happening in our dovecot installation. When I send html emails from many clients and compress them, there are no problem. They are opened and correctly formated. When I send an email from Squirrelmail and compress it, dovecot exits with no errors (there are no coredumps or seg fault - dovecot just exits). But the weird is, it just happens when squirrelmail opens an email (compressed) that was sent by squirrelmail (all other clients can open it and squirrel can open all other emails sent by other clients). (Try with this message - compressing too - it occurs with me). Best Regards, Fernando Dovecot version: 1.2.rc3 Dovecot Details: # 1.2.rc3: /usr/local/dovecot/etc/dovecot.conf # OS: Linux 2.6.18-128.el5 i686 Red Hat Enterprise Linux Server release 5.3 (Tikanga) base_dir: /usr/local/dovecot/var/run/dovecot/ protocols: imap pop3 ssl: no disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable(default): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3-login login_greeting: Server ready. login_process_per_connection: no login_processes_count: 1 mail_max_userip_connections: 1024 first_valid_gid: 500 mail_uid: 505 mail_gid: 506 mail_location: maildir:~/Maildir mail_debug: yes mail_max_keyword_length: 128 fsync_disable: yes maildir_copy_preserve_filename: yes mail_drop_priv_before_exec: yes mail_executable(default): /usr/local/dovecot/libexec/dovecot/gdbhelper /usr/local/dovecot/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot/libexec/dovecot/gdbhelper /usr/local/dovecot/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3 mail_process_size: 512 mail_plugins(default): quota imap_quota zlib mail_plugins(imap): quota imap_quota zlib mail_plugins(pop3): quota zlib mail_plugin_dir(default): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot/lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: mechanisms: login plain cache_size: 1024 cache_negative_ttl: 0 worker_max_count: 100 passdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf userdb: driver: prefetch plugin: quota: maildir Imap commands: 127.000.000.001.54022-127.000.000.001.00143: A009 UID FETCH 1 (FLAGS UID RFC822.SIZE INTERNALDATE BODY.PEEK[HEADER.FIELDS (Date To Cc From Subject X-Priority Importance Priority Content-Type X-UOLHost-Filter)]) 127.000.000.001.00143-127.000.000.001.54022: * 1 FETCH (UID 1 FLAGS (\Seen) RFC822.SIZE 1241 INTERNALDATE "10-May-2009 16:37:39 -0300" BODY[HEADER.FIELDS (DAT E TO CC FROM SUBJECT X-PRIORITY IMPORTANCE PRIORITY CONTENT-TYPE X-UOLHOST-FILTER)] {264} Date: Sun, 10 May 2009 16:37:38 -0300 (BRT) Subject: a From: namba234(a)emailnovocluster.com To: "Namba 234" <namba234(a)emailnovocluster.com> Content-Type: multipart/alternative;boundary="----=_20090510163738_24160" X-Priority: 3 (Normal) Importance: Normal ) A009 OK Fetch completed. 127.000.000.001.54026-127.000.000.001.00143: A002 SELECT "INBOX" 127.000.000.001.00143-127.000.000.001.54026: * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 1 EXISTS * 0 RECENT * OK [UIDVALIDITY 1241984317] UIDs valid * OK [UIDNEXT 2] Predicted next UID * OK [HIGHESTMODSEQ 1] A002 OK [READ-WRITE] Select completed. 127.000.000.001.54026-127.000.000.001.00143: A003 EXPUNGE 127.000.000.001.00143-127.000.000.001.54026: A003 OK Expunge completed. 127.000.000.001.54026-127.000.000.001.00143: A004 UID FETCH 1 BODY[2] 127.000.000.001.00143-127.000.000.001.54026: * 1 FETCH (UID 1 BODY[2] {7} 127.000.000.001.54026-127.000.000.001.00143: A005 UID FETCH 1 BODY[] (dovecot finish the process). Here is a copy of the message (uncompressed - opens / compressed - hangs). Return-Path: <namba234(a)emailnovocluster.com> X-Original-To: namba234(a)emailnovocluster.com Delivered-To: namba234(a)emailnovocluster.com Received: from webmail.emailnovocluster.com (localhost.localdomain [127.0.0.1]) by maildev.localdomain (Postfix) with ESMTP id B45ACFE146 for <namba234(a)emailnovocluster.com>; Sun, 10 May 2009 16:37:38 -0300 (BRT) Received: from 189.62.202.143 (SquirrelMail authenticated user namba234(a)emailnovocluster.com) by webmail.emailnovocluster.com with HTTP; Sun, 10 May 2009 16:37:38 -0300 (BRT) Message-ID: < c0b80d709ef3dc829fc06395baca944d.squirrel(a)webmail.emailnovocluster.com> Date: Sun, 10 May 2009 16:37:38 -0300 (BRT) Subject: a From: namba234(a)emailnovocluster.com To: "Namba 234" <namba234(a)emailnovocluster.com> User-Agent: SquirrelMail/1.4.17 MIME-Version: 1.0 Content-Type: multipart/alternative;boundary="----=_20090510163738_24160" X-Priority: 3 (Normal) Importance: Normal ------=_20090510163738_24160 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit a ------=_20090510163738_24160 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: 8bit a<br /> ------=_20090510163738_24160--

2 1

[Dovecot] NTLM configuration
by Cédric Laruelle 11 May '09

11 May '09

Hi again everybody ! Im still stuck with the dovecot ntlm authentication I configured dovecot to use winbind, and I would like winbind to authenticate against samba (samba, winbind and dovecot are running on the same box). Here is the log I have (192.168.0.1 is the server box, 192.168.0.254 the client box) dovecot: May 06 14:52:37 Info: auth(default): new auth connection: pid=25828 dovecot: May 06 14:52:38 Info: auth(default): client in: AUTH 1 NTLM service=imap secured lip=192.168.0.1 rip=192.168.0.254 lport=143 rport=1084 dovecot: May 06 14:52:38 Info: auth(default): client out: CONT 1 dovecot: May 06 14:52:38 Info: auth(default): client in: CONT 1 TlRMTVNTUAABAAAAB4IIogAAAAAAAAAAAAAAAAAAAAAFASgKAAAADw== dovecot: May 06 14:52:38 Info: auth(default): client out: CONT 1 TlRMTVNTUAACAAAADgAOADAAAAAFgomizPYc4ALWKQgAAAAAAAAAAIAAgAA+AAAAQQBMAFYA TlRMTVNTUAACAAAADgAOADAAAAAFgomizPYc4ALWKQgAAAAAAAAAAIAAgAA+QQBS AFUATQACAA4AQQBMAFYAQQBSAFUATQABABAASQBOAFQARQBSAE4AQQBMAAQAHgBhAGkAZABlAHIA ZABvAG4AbgBlAHIALgBjAG8AbQADADAAaQBuAHQAZQByAG4AYQBsAC4AYQBpAGQAZQByAGQAbwBu AG4AZQByAC4AYwBvAG0AAAAAAA== dovecot: May 06 14:52:38 Info: auth(default): client in: CONT 1 TlRMTVNTUAADAAAAGAAYAF4AAAAYABgAdgAAAAAAAABIAAAABgAGAEgAAAAQABAATgAAAAAAAACO AAAABYKIogUBKAoAAAAPZgBmAHMAQQBMAFYAQQBSAFUATQAzABXRN5WNNwAgAAAAAAAAAAAAAAAA AAAAALm1ePVxjdOF1UPe8A/e1D6H0+jlJYQPUA== dovecot: May 06 14:52:38 Info: auth(default): winbind(?,192.168.0.254): user not authenticated: NT_STATUS_NO_LOGON_SERVERS dovecot: May 06 14:52:40 Info: auth(default): client out: FAIL 1 Please help, I really need to set this up and it begins to drive me really crazy Cédric Laruelle

3 5

[Dovecot] dovecot weird bug
by Fernando Bertasso 11 May '09

11 May '09

I found the bug, there are two errors: 1) Squirrelmail is wrongly formating multipart/alternative messages. Look here: ------=_20090510163738_24160 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: 8bit a<br /> *<------ HERE* ------=_20090510163738_24160-- All other clients insert an '\n' here, but squirrelmail. 2) When this king of message (above) is compressed (in order to use zlib plugin), dovecot dies. Best Regards, Fernando

1 0

[Dovecot] Dovecot not accepting connections
by Jim 11 May '09

11 May '09

Hi, new user here, trying to track down an issue. Sometimes, after starting dovecot, I'll attempt to check mail and will not be able to get a connection to my server. I'll kill dovecot, restart it, and usually it will begin working. When I first ran into this, I first tried auth_debug=yes, restarted dovecot, and had no problems. I'd turn set auth_debug=no, restart dovecot, and would be unable to check mail. After a time I determined that setting the debug wasn't really effecting anything, it was just hit or miss if I'd be able to get a connection. Once I was able to get a connection, things were fine until dovecot started again. Nothing unusual in the logs, if it works or not, I'll just see this at startup: Mar 25 21:34:48 mail-web-server dovecot[664]: dovecot v1.1.13 starting up (core dumps disabled) Mar 25 21:34:48 mail-web-server dovecot[664]: auth-worker(default): mysql: Connected to localhost (postfix) If debug is on and connections aren't being accepted, I never see anything in the logs. Below is my config. Running on OS X 10.5.6. Any info on troubleshooting would be appreciated. mail-web-server:~ wright$ sudo /usr/local/sbin/dovecot -n Password: # 1.1.13: /usr/local/etc/dovecot.conf # OS: Darwin 9.6.0 i386 hfs protocols: imap imaps pop3 pop3s ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: _dovecot login_max_processes_count: 64 max_mail_processes: 128 first_valid_uid: 27 last_valid_uid: 27 first_valid_gid: 27 last_valid_gid: 27 mail_privileged_group: postfix mail_uid: 27 mail_gid: 27 mail_location: maildir:/var/mail/vhosts/%d/%n mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 namespace: type: private inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login cram-md5 passdb: driver: sql args: /usr/local/etc/dovecot-mysql.conf userdb: driver: sql args: /usr/local/etc/dovecot-mysql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix

3 11

[Dovecot] Degeneration of CPU Performance
by Thiago Monaco Papageorgiou 11 May '09

11 May '09

Hello everybody! We have a interesting issue about dovecot behavior here. First, the scenario: We have 2 server running with the same load, one with our old pop3 solution (out of date) and other with Dovecot. We realized that dovecot are comsuming more CPU, and this consumption is growing day by day. When we starts dovecot, it runs between 40%-45% of CPU consumption and our old solution runs on 30-35%. This is quite acceptable, so no problem here. The problem is one day after it jumps to 45%-55% of cpu comsunption while the old pop3 solution runs on the same CPU consumption of one day before (30%-35). I attached a graph with this information. In this graph the green line is dovecot CPU consumption and the blue line is the old solution. In this graph we restart dovecot at monday morning. This restart is noticed as a big fall of CPU consumption(green line) in the graph. After that, it stay between 40%-45%, one day after it runs on 45%-55% and next day, it reaches 50%-60%! You can notice that the blue line (old pop3 solution) runs with the same behavior, so we have the same load. We have other monitoring informations that confirm it. I looked for some bugs about this, but I didn't find anything. The question is: Is there any dovecot problem or wrong configuration that could cause this degeneration of CPU performance? Any sugestion about what can be the cause of this? I attached dovecot -n output. Two important information: we store the mailboxes in NFS and we are only using pop3 protocol. Thanks in advance! -- Thiago Monaco Papageorgiou <thiago.monaco(a)corp.terra.com.br> ________________________ Terra Networks Brasil S/A Tel: +55 (51) 3284-4274 # 1.1.6: /usr/local/dovecot/etc/dovecot.conf # OS: Linux 2.6.9-78.0.1.ELsmp i686 CentOS release 4.7 (Final) syslog_facility: local2 protocols: pop3 listen: *:1110 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable: /usr/local/dovecot/libexec/dovecot/pop3-login login_user: nobody login_log_format_elements: user=<%u> idperm=<%i> command=%t method=%m rip=%r lip=%l %c login_process_per_connection: no login_process_size: 32 login_processes_count: 100 login_max_processes_count: 500 login_max_connections: 100 mail_uid: popmgr mail_gid: popmgr mail_cache_min_mail_count: 100 mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock maildir_copy_preserve_filename: yes mail_executable: /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins: hashdir mail_plugin_dir: /usr/local/dovecot/lib/dovecot/pop3 mail_log_prefix: %Us: user %u (%e): pop3_uidl_format: %f pop3_client_workarounds: outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain trrproxy_v1 worker_max_count: 64 passdb: driver: trrpam args: extra_fields=short_name,quota_caixa,mail_folders_limit,id_perm,mail_imap %s_dovecot userdb: driver: prefetch plugin: quota: trrquota uidlist_create_form: 1

6 8

[Dovecot] Unit testing
by Timo Sirainen 10 May '09

10 May '09

Unit testing is slowly going forward in Dovecot. In v2.0 tree all the unit tests are now run when you do "make check". They're also run on "make distcheck", which is what I use when building releases or nightly snapshots. So as soon as I start building nightly v2.0 snapshots I should start getting mails every night if the unit tests fail. And I can no longer make a release if a unit test fails. (Unit tests never get run manually - I once fixed a unit test that had been failing for months.) Besides that, I started trying to add unit tests to lib-index. After some hours of refactoring the code I finally managed to get mail-transaction-log-view and mail-index-transaction to a condition where unit tests could be added to them without too much pain. I didn't really add that many unit tests there yet though. I'll probably slowly continue adding more tests and refactoring the code more to allow more unit tests, but if anyone else finds they have nothing better to do, now's a good time to add more tests :) Especially lib/, lib-mail/ and lib-imap/ should already be easily testable and they're missing a lot of tests.

1 0

[Dovecot] dovecot slowing down
by P.A 08 May '09

08 May '09

Hi, not really a dovecot issue but, im running dovecot 1.0.10 with no issues for awhile now J. However I ran into an issue today where postfix didn't have enough processes to handle incoming smtp connections. This for whatever reason was causing pop/imap (dovecot) to take a long time to respond on the appropriate port. After looking at server and finding nothing wrong I stopped postfix which got rid of the delay on port 110/143. I then turned on postfix again and saw the delay for port 25/110/143. What I then did was adjust/increase the default_process_limit in postfix which took care of the problem. Question is why would not enough processes in postfix slow other services down like dovecot 110/143? There was plenty of bandwith/mem/cpu left.

1 0

[Dovecot] Problem with IMAP (rename and delete non existent folder).
by Lenthir 08 May '09

08 May '09

I don't know if this problem exists only in my version of dovecot, or in all... To reproduce BUG do this (use gdb): telnet localhost 143 o login addr(a)email.sth verystrong_pass o delete "kj-test-folder" o rename "kj-test-folder" o rename "kj-test-folder" "other-folder" SIGABRT Of course kj-test-folder is not exist. BT: #31 0xb7da0022 in free () from /lib/tls/libc.so.6 #32 0x0813313a in pool_system_free (pool=0x8169060, mem=0x8146161) at mempool-system.c:92 #33 0x080de02f in mailbox_list_clear_error (list=0x81885e8) at mailbox-list.c:762 #34 0x080dd5ae in mailbox_list_get_mailbox_name_status (list=0x81885e8, name=0x81a4258 "other-folder", status=0xbfe9cae0) at mailbox-list.c:394 My version of Dovecot is 1.2beta1. Do you know anything about this bug? Please help. -- Konrad

2 5

[Dovecot] Problem with IMAP (rename and delete non existent folder).
by Lenthir 08 May '09

08 May '09

I don't know if this problem exists only in my version of dovecot, or in all... To reproduce BUG do this (use gdb): telnet localhost 143 o login addr(a)email.sth verystrong_pass o delete "kj-test-folder" o rename "kj-test-folder" o rename "kj-test-folder" "other-folder" SIGABRT Of course kj-test-folder is not exist. BT: #31 0xb7da0022 in free () from /lib/tls/libc.so.6 #32 0x0813313a in pool_system_free (pool=0x8169060, mem=0x8146161) at mempool-system.c:92 #33 0x080de02f in mailbox_list_clear_error (list=0x81885e8) at mailbox-list.c:762 #34 0x080dd5ae in mailbox_list_get_mailbox_name_status (list=0x81885e8, name=0x81a4258 "other-folder", status=0xbfe9cae0) at mailbox-list.c:394 My version of Dovecot is 1.2beta1. Do you know anything about this bug? Please help. -- Konrad

3 6

[Dovecot] mailutil?
by Timo Sirainen 08 May '09

08 May '09

dbox format needs at least two tools: 1. Expunging only marks the message having refcount=0. The actual disk space is freed only after calling a tool pointing to the user's dbox dir. 2. Ability to force index resync/rebuild in case it doesn't figure out itself that there's something wrong. I'm starting to think about building a more generic mailutil tool, maybe something similar to what UW-IMAP has. So two questions: - What should the tool be called? Probably not mailutil to avoid confusion. doveutil? dovemail? dovetool? mailtool? - Is there any functionality you'd like it to do?

10 15

[Dovecot] Imap notifications in IDLE
by Jarosław Przybyłowicz 07 May '09

07 May '09

Hi, could you please tell me if there is a way, to make dovecot notify my mail client of new messages in inbox subfolders? I'm using fdm to fetch mails into maildir and proper subfolders. So far, when idleing mozilla gets a notification when new message arrives in INBOX, but if mail is fetched into other folder I have to click on it to see if there is a new message. I've checked thunderbird imap log to check if this is dovecot or TB issue. Is there any way to force dovecot to monitor other folders? Regards, V

5 6

Re: [Dovecot] authentication to IMAP
by punit_j 07 May '09

07 May '09

Hi Daniel, What version of dovecot supports this feature ? I am using dovecot-0.99.11-8.EL4 and gives error : - Starting Dovecot Imap: Fatal: Error in configuration file /etc/dovecot.conf line 495: Unknown setting: master_user_separator Here is what i added : auth_master_user_separator = * auth default { passdb passwd-file { args = /root/passwd.masterusers master = yes } passdb shadow { } userdb passwd { } } Regards, Punit

3 2

[Dovecot] Exim And Dovecot SASL
by Andrew Holway 07 May '09

07 May '09

Hi all, I have been trying to get this to work a couple of ways, please take a look at the links below.http://wiki.dovecot.org/HowTo/EximAndDovecotSASLhttp://rafb.net/p/ipH… rejects every time but if I uncomment;auth_executable = /usr/lib/dovecot/dovecot-auth then thunderbird will ask me for a password but does not agree with me on it.I have dovecot set up to use the unix usernames and passwordsThanks,Andrew  

2 2

[Dovecot] authentication to IMAP
by punit_j 07 May '09

07 May '09

HI All, Is there a way to do admin authentication for a normal user in dovecot IMAP ? I have a user using PAM to store password in /etc/shadow file. I need to authenticate the user in IMAP using that password. I tried using : - I tried all combinations as below [root@mail ~]# cat /etc/shadow| grep -i ajay ajay.lal:CM730q8foSA9A:13545:0:99999:7::: [root@mail ~]# telnet 0 143 Trying 0.0.0.0... Connected to 0 (0.0.0.0). Escape character is '^]'. * OK dovecot ready. a1 login ajay.lal CM730q8foSA9A a1 NO Authentication failed. a1 login ajay.lal "{crypt}CM730q8foSA9A" a1 NO Authentication failed. Also i tried [root@mail ~]# perl -MMIME::Base64 -e 'print encode_base64("\0ajay.lal\0{crypt}CM730q8foSA9A");' AGFqYXkubGFsAHtjcnlwdH1DTTczMHE4Zm9TQTlB [root@mail ~]# telnet 0 143 Trying 0.0.0.0... Connected to 0 (0.0.0.0). Escape character is '^]'. * OK dovecot ready. a1 AUTHENTICATE PLAIN + AGFqYXkubGFsAHtjcnlwdH1DTTczMHE4Zm9TQTlB a1 NO Authentication failed. My dovecot server does PLAIN authentication as can auth_mechanisms = plain Is there a way to do PLAIN auth with crypt password or any means of doing admin authentication on behalf of normal user ? Regards, Punit

2 1

[Dovecot] Solr FTS issues (Was fts-solr plugin issue (Marked invalid))
by Dror Matalon 06 May '09

06 May '09

Hi, Sorry for the change of thread, I just signed up to the list so I couldn't reply to the earlier message. Let me clarify the issue that Nikolai was describing. We're running dovecot 1.1.11 and solr 1.4. The issue is quite simple. 1. I run a search. 2. Dovecot sends a list of emails to solr 3. Solr starts indexing them 4. Solr runs into a "bad" email and we get: SEVERE: java.io.IOException: Mark invalid org.apache.solr.common.SolrException log SEVERE: java.io.IOException: Mark invalid at java.io.BufferedReader.reset(BufferedReader.java:485) at org.apache.solr.analysis.HTMLStripReader.restoreState(HTMLStripReader.java:171) at org.apache.solr.analysis.HTMLStripReader.read(HTMLStripReader.java:728) at org.apache.solr.analysis.HTMLStripReader.read(HTMLStripReader.java:742) at java.io.Reader.read(Reader.java:123) at org.apache.lucene.analysis.CharTokenizer.next(CharTokenizer.java:109) at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:159) at org.apache.lucene.index.DocFieldConsumersPerField.processFields(DocFieldConsumersPerField.java:36) at org.apache.lucene.index.DocFieldProcessorPerThread.processDocument(DocFieldProcessorPerThread.java:234) at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:765) ... 5. All the above email messages that were indexed are rolled back, and we're stuck. I think that the solution should be simple too :-). When solr runs into a bad email, it should just ignore it and keep indexing. This seems much more robust since the emails are coming from a variety of sources, and we can assume that some of them are going to generate badly formated emails. Seems like having a few bad emails not indexed is much better than the current situation of a bad email stopping all searching. I don't understand the architecture enough between fts, fts_solr and solr to know where this should be solved. Ideally, it would be a simple directive to solr. Regards, Dror ----- Dror Matalon President Zapatec Inc 866 522-7941 X 704 1700 MLK Way Berkeley, CA 94709 http://www.6zap.com http://twitter.com/drormata http://www.zapatec.com

1 0

[Dovecot] [OT] two-way IMAP synchronization
by Wolfram Schlich 06 May '09

06 May '09

Hi, I am looking for a tool that does a true two-way synchronization (synchronization of expunges/deletes) of IMAP mailboxes, kind of a mixture of unison and imapsync. Does anyone have any ideas how to accomplish that? TIA. -- Regards, Wolfram Schlich <wschlich(a)gentoo.org> Gentoo Linux * http://dev.gentoo.org/~wschlich/

2 3

Re: [Dovecot] Some POP3 questions
by Nikolai Derzhak 06 May '09

06 May '09

By the way, you can download ready to use open-source mail, calendar, contacts, etc: http://www.6zap.com. I'am sysadm in this project and we use dovecot to. On Wed, 05/06/2009 at 5:28pm, "Brandon Lamb" <brandonlamb(a)gmail.com> wrote: > On Wed, May 6, 2009 at 7:23 AM, Brandon Lamb <brandonlamb(a)gmail.com> wrote: >> On Wed, May 6, 2009 at 5:25 AM, Kenneth Kalmer <kenneth.kalmer(a)gmail.com> >> wrote: >>> On Tue, May 5, 2009 at 11:39 PM, Timo Sirainen <tss(a)iki.fi> wrote: >>> >>>> On Tue, 2009-05-05 at 23:32 +0200, Kenneth Kalmer wrote: >>>>>>> * NFS server which is the same server that houses single Courier-IMAP >>>>>>> installation (Gentoo, 3GB memory) >>>>>>> * 2x Postfix instances delivering to NFS >>>>>>> >>>>>> >>>>>> NFS may be problematic. Dovecot expects a perfectly working NFS setup, >>>>>> which seems to be a bit rare to find. http://wiki.dovecot.org/NFS >>>>>> >>>>> >>>>> Just for the record, dovecot will be access the mail directly on the >>>> disks, >>>>> it will be the LDA's on the postfix instances coming in over NFS. I'm >>>>> reading the NFS again to make sure I understand the risks >>>> >>>> If the LDA is Dovecot deliver, it's the same problem since it also >>>> updates index/control files that cause the problems. But if you're using >>>> something else that does nothing but write the maildir files, then it's >>>> fine. >>>> >>> >>> I'm looking to use the Dovecot LDA so the caches are updated and the >>> filenames are correct, to get good POP3 performance. >>> >>> I'm looking forward to giving Dovecot a go, but I'll rig up a staging >>> environment first. >>> >>> Thanks for the encouraging responses everyone. >>> >>> Best >>> >>> -- >>> Kenneth Kalmer >>> kenneth.kalmer(a)gmail.com >>> http://opensourcery.co.za >>> @kennethkalmer >> >> I moved from a 4 gig nfs server with eight mailheads running exim as >> lda, courier imap/pop3 (over nfs) to an 8 gig nfs server and moved to >> dovecot imap/pop3 running directly on the nfs server and dropped to >> four mailheads running exim with dovecot lda. >> >> At first I tried to keep my imap/pop3 services running on the 4 >> mailheads but over nfs had major weird 500 load spikes randomly, >> moving these to the nfs server solved all of that. The 4 mailheads >> still deliver to maildir over nfs using dovecot as lda. I have been >> pleasantly pleased. Our webmail app in our old setup used to take >> 10-30 seconds to load and now it is instantaneous. Some of it might be >> from upgrading hardware, but I definitely had a HUGE noticeable >> difference and you couldnt convince me to go back. >> >> We did have about a week of sucktastic traffic and my support >> department hating me because all our pop3 leave-messages-on-server >> users had to redownload all their mail, but it was worth the headache. >> Dovecot is just too sweet, with its performance and plugins to ever >> have to even think about a choice between it or software X. >> >> Just my $0.02 > > Oh yea, and I just recently discovered the virtual mailbox plugin and > fell even more in love. I am developing a Gmail clone inhouse for our > new webmail (we're an ISP). It is cool plugins like this that make me > glad I switched to Dovecot. Being able to consolidate various Deleted, > Trash, Deleted Items, Deleted Mails folders all into a single > virtual/Trash folder is GREAT. Powered by the 6zap. Sign up at http://www.6zap.com for an account that provides advanced e-mail, calendar and contacts capabilities.

1 0