- dovecot - dovecot.org

[Dovecot] corrupted transaction log errors causing users mail to disappear temporarily
by Jordan Tardif 26 May '10

26 May '10

So Ive been looking into some problems with users reporting their mail goes missing for a second but then re-apears very soon after. I have tracked it down to happening at the same time these appear in the logs. Seems the transaction logs is getting corrupted somehow and then rebuilding itself (which works fine). The problem is while its re-builing the users think all of their mail is gone. May 3 09:35:52 mailmachine dovecot: IMAP(test(a)domain.com): Corrupted transaction log file usershomedir/Maildir/dovecot.index.log seq 3: Invalid transaction log size (32708 vs 32840): usershomedir/Maildir/dovecot.index.log (sync_offset=32708) We are using load balanced servers and data/index's are stored in their home dir's over nfs. All my config details and nfs options are below. We are currently balancing based on source address so most of the time users imap/pop processes should stick to one machine as much as possible. Does anyone know of a way to rid of this problem, or at least make it so dovecot just returns a server error to the imap/pop client instead of showing them a blank index? #nfs options defaults,intr,vers=3,bg,rsize=8192,wsize=8192,proto=udp 0 0 # 1.2.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.29.2-xenon-mail-ipv6-grsec x86_64 Debian 5.0.1 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 disable_plaintext_auth: no login_dir: /usr/var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_user: dhmail login_process_per_connection: no login_processes_count: 150 login_max_processes_count: 1000 login_max_connections: 3000 max_mail_processes: 2500 mail_max_userip_connections: 7 first_valid_uid: 100 mail_privileged_group: mail mail_location: maildir:~/Maildir mmap_disable: yes mail_nfs_index: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): UID%u-%v -- Jordan Tardif DreamHost

2 1

[Dovecot] Where should I define mail_uid for deliver LDA?
by Alex 26 May '10

26 May '10

Hello folks I'm trying to use Dovecot deliver LDA instead Postfix virtual LDA The last road block I have to resolve is to define mail_uid, becaus dovecot.err log has these error messages: May 04 14:57:19 deliver(user1(a)some_domain.com): Error: User user1(a)some_domain.com is missing UID (set mail_uid) May 04 14:57:19 deliver(user2(a)some_domain.com): Error: User user2(a)some_domain.com is missing UID (set mail_uid) May 04 14:57:25 deliver(user3(a)some_domain.com): Error: User user3(a)some_domain.com is missing UID (set mail_uid) Where exactly should I define mail_uid? Somewhere in Dovecot dovecot.conf file? I tried to set mail_uid in dovecot-sql.conf in user_query as follows: user_query = SELECT maildir as mail, 51 as userdb_uid, 51 as userdb_gid, 51 as mail_uid FROM dovecot_email_maps WHERE email = '%u' But this apparently doesn't provide that mail_uid as I expected. Could somebody please enlighten me on this issue. Thank you in advance, Alex

2 1

[Dovecot] Problem with ACL and rename folder
by DZIOBAK 26 May '10

26 May '10

Hi, I'm using RoundCube and I asked RC team to add ACL support, but there is a problem with renaming ACL protected folders. Users don't have permissions to deleting/renaming some folders. It works well, but every imap talk when renaming folders ends with: OK Rename completed. but the name of folder isn't changed. Here is a log from RC when I tried to rename ACL protected folder: [20-May-2010 10:48:46 +0200]: S: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. [20-May-2010 10:48:46 +0200]: C: cp01 CAPABILITY [20-May-2010 10:48:46 +0200]: S: * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEN D UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=t exk QUOTA AUTH=PLAIN AUTH=LOGIN [20-May-2010 10:48:46 +0200]: S: cp01 OK Capability completed. [20-May-2010 10:48:46 +0200]: C: a001 LOGIN "*******" "*******" [20-May-2010 10:48:46 +0200]: S: a001 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MUL TIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL R IGHTS=texk QUOTA] Logged in [20-May-2010 10:48:46 +0200]: C: lsb LSUB "" "*" [20-May-2010 10:48:46 +0200]: S: * LSUB () "/" "Trash" [20-May-2010 10:48:46 +0200]: S: * LSUB () "/" "Junk" [20-May-2010 10:48:46 +0200]: S: * LSUB () "/" "Sent" [20-May-2010 10:48:46 +0200]: S: * LSUB () "/" "Drafts" [20-May-2010 10:48:46 +0200]: S: * LSUB () "/" "Public/AddressBook" [20-May-2010 10:48:46 +0200]: S: * LSUB () "/" "Public/PublicMails" [20-May-2010 10:48:46 +0200]: S: * LSUB () "/" "Public/" [20-May-2010 10:48:46 +0200]: S: * LSUB () "/" "viruses" [20-May-2010 10:48:46 +0200]: S: * LSUB () "/" "root" [20-May-2010 10:48:46 +0200]: S: * LSUB () "/" "Info" [20-May-2010 10:48:46 +0200]: S: * LSUB () "/" "Archives" [20-May-2010 10:48:46 +0200]: S: * LSUB () "/" "Kalendarz" [20-May-2010 10:48:46 +0200]: S: lsb OK Lsub completed. [20-May-2010 10:48:46 +0200]: C: usub1 UNSUBSCRIBE "Kalendarz" [20-May-2010 10:48:46 +0200]: S: usub1 OK Unsubscribe completed. [20-May-2010 10:48:46 +0200]: C: r RENAME "Kalendarz" "Kalendarz23" [20-May-2010 10:48:46 +0200]: S: r OK Rename completed. [20-May-2010 10:48:46 +0200]: C: sub1 SUBSCRIBE "Kalendarz23" [20-May-2010 10:48:46 +0200]: S: sub1 NO Mailbox doesn't exist: Kalendarz23 [20-May-2010 10:48:46 +0200]: C: lmb LIST "" "*" [20-May-2010 10:48:46 +0200]: S: * LIST (\HasNoChildren) "/" "Trash" [20-May-2010 10:48:46 +0200]: S: * LIST (\HasNoChildren) "/" "Junk" [20-May-2010 10:48:46 +0200]: S: * LIST (\HasNoChildren) "/" "Info" [20-May-2010 10:48:46 +0200]: S: * LIST (\HasNoChildren) "/" "Sent" [20-May-2010 10:48:46 +0200]: S: * LIST (\HasNoChildren) "/" "Drafts" [20-May-2010 10:48:46 +0200]: S: * LIST (\HasNoChildren) "/" "viruses" [20-May-2010 10:48:46 +0200]: S: * LIST (\HasNoChildren) "/" "Archives" [20-May-2010 10:48:46 +0200]: S: * LIST (\HasNoChildren) "/" "root" [20-May-2010 10:48:46 +0200]: S: * LIST (\HasNoChildren) "/" "Kalendarz" [20-May-2010 10:48:46 +0200]: S: * LIST (\HasNoChildren) "/" "INBOX" [20-May-2010 10:48:46 +0200]: S: * LIST (\Noselect \HasChildren) "/" "Public" [20-May-2010 10:48:46 +0200]: S: * LIST (\HasNoChildren) "/" "Public/AddressBook" [20-May-2010 10:48:46 +0200]: S: * LIST (\HasNoChildren) "/" "Public/PublicMails" [20-May-2010 10:48:46 +0200]: S: lmb OK List completed. [20-May-2010 10:48:46 +0200]: C: I LOGOUT Here you have my dovecot config: # 1.2.11: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.2-RELEASE i386 info_log_path: /var/log/dovecot-info.log protocols: acl imap pop3 managesieve ssl: no disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_privileged_group: mail mail_location: maildir:~/Maildir mail_drop_priv_before_exec: yes mail_executable(default): /usr/local/etc/dovecot/unix_groups.sh mail_executable(imap): /usr/local/etc/dovecot/unix_groups.sh mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_plugins(default): acl imap_acl quota imap_quota autocreate fts fts_squat mail_plugins(imap): acl imap_acl quota imap_quota autocreate fts fts_squat mail_plugins(pop3): mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: Public/ location: maildir:/home/public/Maildir:CONTROL=~/Maildir/control/public:INDEX=~/Maildir/index/public list: yes lda: postmaster_address: postmaster(a)test.parsifal.com.pl plugins: quota mail_plugins: acl sieve quota mail_plugin_dir: /usr/local/lib/dovecot/lda deliver_log_format: msgid=%m: %$ sendmail_path: /usr/sbin/sendmail auth default: mechanisms: plain login username_format: %Lu passdb: driver: pam args: session=yes imap userdb: driver: passwd args: blocking=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix plugin: sieve: ~/.dovecot.sieve sieve_dir: ~/sieve sieve_global_path: /var/dovecot/sieve/default.sieve sieve_global_dir: /var/dovecot/sieve sieve_before: /var/dovecot/sieve/default.sieve quota: maildir:User quota quota_rule: *:storage=5G quota_rule2: Trash:storage=20%% quota_rule3: SPAM:storage=20%% quota_warning: storage=80%% /usr/local/bin/quota-warning.sh 80 quota_warning2: storage=90%% /usr/local/bin/quota-warning.sh 90 quota_warning3: storage=95%% /usr/local/bin/quota-warning.sh 95 autocreate: Trash autocreate2: Junk autocreate3: Info autocreate4: Sent autocreate5: Drafts autocreate6: Archives autocreate7: Kalendarz autosubscribe: Trash autosubscribe2: Junk autosubscribe3: Info autosubscribe4: Sent autosubscribe5: Drafts autosubscribe6: Public.AddressBook autosubscribe7: Public.PublicMails autosubscribe8: Archives autosubscribe9: Kalendarz acl: vfile:/usr/local/etc/dovecot/acls fts: squat fts_squat: partial=4 full=10 Here is a global ACL file for mailbox "Kalendarz" cat /usr/local/etc/dovecot/acls/Kalendarz owner lrwstipea My dovecot version: pkg_info | grep dovecot dovecot-1.2.11 dovecot-managesieve-0.11.11_1 dovecot-sieve-1.2+0.1.15 Please help with this problem ---------------- Regards DZIOBAK

5 10

[Dovecot] mixture of virtual and plain users
by Kapetanakis Giannis 26 May '10

26 May '10

Hi, I have a mail server (postfix/dovecot) running so far with normal local /etc/passwd users for domain example.com. mail_location = maildir:~/Maildir passdb pam { } userdb passwd { } Is it possible to add virtual domains/users to my setup without changing example.com to a virtual domain? I can do the postfix part with http://www.postfix.org/VIRTUAL_README.html#virtual_mailbox but I'm not sure if I can mix dovecot (IMAP and maybe smtp auth) for both local and virtual users. Any hint would be appreciated. best regards, Giannis

2 3

[Dovecot] libdovecot not referencing libiconv
by Jonathan Siegle 26 May '10

26 May '10

OS: AIX 5.3 with IBM c compiler. Dovecot revision: 11278:2ead7574bb08 This problem is old for me, I just kept forgetting to report. Trying to start dovecot and I get: exec(): 0509-036 Cannot load program dovecot because of the following errors: rtld: 0712-001 Symbol iconv was referenced from module /usr/local/dovecot2.0beta5/lib/dovecot/libdovecot.so(), but a runtime definition of the symbol was not found. rtld: 0712-001 Symbol iconv_open was referenced from module /usr/local/dovecot2.0beta5/lib/dovecot/libdovecot.so(), but a runtime definition of the symbol was not found. rtld: 0712-001 Symbol iconv_close was referenced from module /usr/local/dovecot2.0beta5/lib/dovecot/libdovecot.so(), but a runtime definition of the symbol was not found. To fix this I did: --- a/src/lib-dovecot/Makefile.am Mon May 10 12:05:58 2010 -0400 +++ b/src/lib-dovecot/Makefile.am Mon May 10 12:31:36 2010 -0400 @@ -16,7 +16,7 @@ libdovecot_la_LIBADD = \ $(libs) \ $(MODULE_LIBS) \ - $(LTLIBICONV) + $(LIBICONV) libdovecot_la_DEPENDENCIES = $(libs)

2 5

[Dovecot] Bug in zlib Plugin (2.0)
by Alex Baule 26 May '10

26 May '10

Hello everyone..... I Made some tests in zlib plugin, and in ostream file (ostream-zlib.c) in o_stream_zlib_sendv function, have it: stream->ostream.offset += bytes; In struct mail_save_context, have saved_physical_size and it can be updated, acording with the observation. /* if non-zero, overrides the physical size that should be saved. for example when using zlib plugin, this would contain the mail's uncompressed size. */ uoff_t saved_physical_size; in file zlib-plugin.c in zlib_mail_save_compress_finish function, have it: ctx->saved_physical_size = ctx->output->offset; It's a update to offset (the size of email) in zlib, but if you update this value with a new number, the W flag in email is NOT updated. This is the original file, without update the or increase offset. 1273155226.M512158P16310.brc,S=435,W=390:2,S This is the file updated with 5000b more. 1273155226.M512158P16310.brc,S=5435,W=390:2,S The S is updated, but W not. OK, this not matter in zlib plugin, because the physical size is the email uncompressed, but if you use the zlib as example, and you use this value (saved_physical_size) to update your saved email size, it can't update the W flag, and the email will not be open, because the W size is wrong.

2 2

[Dovecot] A few questions on shared folders
by Michael Durket 26 May '10

26 May '10

I'm looking at the possibility of using shared folders to solve a particular problem for my employer and I have a few questions: 1) Can shared folders be in mbox format while allowing the user's mail to be in maildir format? (I think the answer is yes, but wanted to check). 2) What version of dovecot should I be running in order to support shared folders? 3) Is there a good overview document that people could recommend I read that describes how best to set up shared folders under dovecot (and perhaps also gives an overview of shared folder usage in IMAP mail clients in general)? Thanks very much, Michael Durket

2 1

Re: [Dovecot] dovecot2 latest beta5 acl not working properly ?
by Robert Schetterer 26 May '10

26 May '10

Am 25.05.2010 22:20, schrieb Timo Sirainen: > On Tue, 2010-05-25 at 21:56 +0200, Robert Schetterer wrote: >>> But I'm still continuing my crusade to get the clients fixed instead. >>> >>> >> >> Hi Timo, dont wanna stop crusaders *g, > > BTW. To help with the crusade, could you report the bug to Imp bug > database? :) > > jep i will do, but it might be a problem for testing developers might have no dovecot2 beta setup any exact tec message for them ? ( like bla bla horde/imp imap acl rfc ....bug with a link ?) in hard case they might will contact you But as far i know a few horde/imp guys are reading this list too so it will find its way anyway to them -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 4

[Dovecot] STARTTLS does not seem to work
by Phil Howard 26 May '10

26 May '10

I believe I have the configuration set to use START TLS on IMAP4 (143) and POP3 (110) ports. However, it does not seem to be working. Yet "STARTTLS" is listed as a capability (which tells me I probably do have it configured right). In the session below, 172.30.0.24 is the mail server I'm putting up. 64.26.60.229 is an outside mail service. A similar thing happens on POP3. The always-SSL/TLS ports (993 and 995) are working. There's very little documentation matching "starttls". ======================================================================== altair/phil /home/phil 162> telnet 172.30.0.24 143 Trying 172.30.0.24... Connected to 172.30.0.24. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS UIDPLUS LIST-EXTENDED I18NLEVEL=1 STARTTLS LOGINDISABLED] AUTHORIZED USERS ONLY -- unauthorized access strictly prohibited STARTTLS STARTTLS BAD Error in IMAP command received by server. ^]quit telnet> quit Connection closed. altair/phil /home/phil 163> telnet 64.26.60.229 143 Trying 64.26.60.229... Connected to 64.26.60.229. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 UIDPLUS CHILDREN NAMESPACE THREAD=ORDEREDSUBJECT THREAD=REFERENCES SORT QUOTA IDLE STARTTLS] Courier-IMAP ready. Copyright 1998-2005 Double Precision, Inc. See COPYING for distribution information. STARTTLS STARTTLS OK Begin SSL/TLS negotiation now. ^]quit telnet> quit Connection closed. altair/phil /home/phil 164> ======================================================================== I do have "disable_plaintext_auth = yes" in my config file even though "dovecot -n" does not show it ... must be a default. ======================================================================== # 1.1.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.31-19-server x86_64 Ubuntu 9.10 ext3 base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/error.log info_log_path: /var/log/dovecot/info.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 imaps pop3s listen: 172.30.0.24, [fc00::18], 127.0.0.1, [::1] ssl_cert_file: /etc/ssl/certs/ssl-mail.pem ssl_key_file: /etc/ssl/private/ssl-mail.key ssl_parameters_regenerate: 24 ssl_cipher_list: ALL:!LOW:!SSLv2:ALL:!aNULL:!ADH:!eNULL:!EXP:RC4+RSA:+HIGH:+MEDIUM login_dir: /var/run/dovecot//login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_greeting: AUTHORIZED USERS ONLY -- unauthorized access strictly prohibited login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no mail_max_userip_connections(default): 10 mail_max_userip_connections(imap): 10 mail_max_userip_connections(pop3): 3 verbose_proctitle: yes first_valid_uid: 250 mail_privileged_group: mail mail_uid: vmail mail_gid: vmail mail_location: maildir:/home/mail/%Ld/%Ln/mail mail_debug: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_process_size: 768 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login username_format: %Ln@%Ld verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd-file args: username_format=%Ln@%Ld /etc/mailauth/deny deny: yes passdb: driver: passwd-file args: username_format=%Ln /etc/mailauth/%Ld/deny deny: yes passdb: driver: passwd-file args: scheme=crypt username_format=%Ln@%Ld /etc/mailauth/passwd passdb: driver: passwd-file args: scheme=crypt username_format=%Ln /etc/mailauth/%Ld/passwd userdb: driver: passwd-file args: username_format=%Ln@%Ld /etc/mailauth/passwd userdb: driver: passwd-file args: username_format=%Ln /etc/mailauth/%Ld/passwd socket: type: listen client: path: /var/spool/postfix/private/dovecot-auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail ========================================================================

5 12

[Dovecot] config file includes
by Tim Traver 26 May '10

26 May '10

Hi all, ok, I couldn't quite find this in any of the documentation, so I figured I would ask here. In preparation to move to version 2.0 to take advantage of the mutiple IP and SSL cert options that are coming, it would be really nice to be able to include other config files in the main config file, so that I don't have to edit the main config in order to add new IP addresses or certs... Does dovecot currently have the ability to include another config file when it is parsing the main config??? If not, is that something that we can put on the wish list? Thanks, Tim.

2 4