- dovecot - dovecot.org

[Dovecot] ZFS Index corruption and Connection reset by peer
by Philippe Chevalier 17 Jun '10

17 Jun '10

Hello, I'm currently using dovecot 1.2.11 on FreeBSD 8.0 with ZFS filesystems. So far, so good, it works quite nicely, but I have a couple glitches. Each user has his own zfs partition, mounted on /home/<user> (easier to set per user quotas) and mail is stored in their home. From day one, when people check their mail via imap, a lot of indexes corruption occured : dovecot: IMAP(<user>@domain.org): Corrupted transaction log file /home/<user>/Mail/Maildir/INBOX/dovecot.index.log seq 13: record size too small +(type=0x0, offset=5560, size=0) (sync_offset=5652) dovecot: IMAP(<user>@domain.org): fscking index file /home/<user>/Mail/Maildir/INBOX/dovecot.index dovecot: IMAP(<user>@domain.org): /home/<user>/Mail/Maildir/INBOX/dovecot.index log position went backwards (13,132 < 13,5560) dovecot: IMAP(<user>@domain.org): Transaction log file /home/<user>/Mail/Maildir/INBOX/dovecot.index.log: marked corrupted etc, etc... After some digging, I "solved" this problem with mmap_disable = yes in dovecot.conf. Index corruption doesn't seem to occur anymore. Is this normal? I thought this problem occured only on NFS filesystem and eventually on old versions of ZFS. Hasn't this been fixed? Is there an option in ZFS that would allow mmap calls without corruption. Has it something to do with compression ? The options of the zfs filesystem are : zhome/username type filesystem - zhome/username creation Thu Mar 18 11:10 2010 - zhome/username used 750M - zhome/username available 61.0G - zhome/username referenced 750M - zhome/username compressratio 1.20x - zhome/username mounted yes - zhome/username quota none default zhome/username reservation none default zhome/username recordsize 128K default zhome/username mountpoint /usr/home/username inherited from zhome zhome/username sharenfs off default zhome/username checksum on default zhome/username compression lzjb inherited from zhome zhome/username atime off inherited from zhome zhome/username devices on default zhome/username exec on default zhome/username setuid on default zhome/username readonly off default zhome/username jailed off default zhome/username snapdir hidden default zhome/username aclmode groupmask default zhome/username aclinherit restricted default zhome/username canmount on default zhome/username shareiscsi off default zhome/username xattr off temporary zhome/username copies 1 default zhome/username version 3 - zhome/username utf8only off - zhome/username normalization none - zhome/username casesensitivity sensitive - zhome/username vscan off default zhome/username nbmand off default zhome/username sharesmb off default zhome/username refquota none default zhome/username refreservation none default zhome/username primarycache all default zhome/username secondarycache all default zhome/username usedbysnapshots 0 - zhome/username usedbydataset 750M - zhome/username usedbychildren 0 - zhome/username usedbyrefreservation 0 - Other problem, that I have been unable to solve so far, is that a lot of entries show up in my logs about : dovecot: imap-login: net_disconnect() failed: Connection reset by peer It doesn't seem to have any adverse effect, except it's filling up the logs. It seem to appear when a client closes the imap connection? Is there a way to suppress this error? Regard P.C.

5 5

[Dovecot] Dovecot SASL
by Tseveendorj Ochirlantuu 17 Jun '10

17 Jun '10

Dear All, I've installed Postfix 2.7.0 and Dovecot 1.2.9 on Ubuntu 10.04. I want to use Dovecot SASL with Postfix and did the following configuration. main.cf smtpd_sasl_auth_enable = yes smtpd_sasl_type = dovecot smtpd_sasl_path = private/dovecot-auth smtpd_sasl_authenticated_header = yes smtpd_sasl_security_options = noanonymous smtpd_sasl_local_domain = $myhostname broken_sasl_auth_clients = yes smtpd_recipient_restrictions = reject_unknown_sender_domain, reject_unknown_recipient_domain, reject_unauth_pipelining, permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination /etc/dovecot/auth.d/01-dovecot-postfix.auth mechanisms = plain login socket listen { client { path = /var/spool/postfix/private/dovecot-auth mode = 0660 user = postfix group = postfix } } I did not see AUTH in the telnet connection. EHLO mail.domain.mn 250-ns1.domain.mn 250-PIPELINING 250-SIZE 10240000 250-VRFY 250-ETRN 250-STARTTLS 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN How to solvet this ? Best regards, Tseveen

2 5

[Dovecot] BUG Dovecot 1.0.15 and Apples Mail.app
by Gerhard Waldemair 17 Jun '10

17 Jun '10

Is there anyone using Apple´s Mail.app to collect the mails via IMAP or IMAPS ? I found a funny bug in Debian Lennys Dovecot Version. (still v. 1.0.15) When I get my Mails via IMAP or IMAPS and define a Rule in Mail.app to move the eMail to s specific folder I will find the mail 2 times in the folder. After a minute or so the double Mail disappears. I have tried it with other programs like Thunderbird. There everything works, v1.0 too. Now I have updatet Dovecot from 1.0 to 1.2 from Backports and everything works great now !!!!! Regards, Gerhard PS in Squeeze Dovecot is Version 1.2

2 1

[Dovecot] dovecot vs. Thunderbird
by Bodo Schulz 17 Jun '10

17 Jun '10

Hello (and Moin Moin) ;) I have currently a straith Problem ... I have our IMAP-Server migrated from an old cyrus the the current stable Version of dovecot. In the old configuration we organized many mails (e.g. root-Stuff) in Public Folders. They structure had nearly 5 folderlevels. After the complete migration an syncronize we switch complete to the dovecot setup. At this moment we have problems with access to the Public Folders. (We use as Client the actualy Thunderbird3 ...) When i want subscribe Folders, i have no access to folder are deeper as second level! Now, i have testet with rawlogs an switch on the debugging in Thunderbird, but a have no more idea! :-( Here an extract of our Public Folders: ,------------------------------------- Shared Folders +- shared +- backup | +- archive | +- warnings +- databases +- WARNINGS +- ERRORS +- archive +- projects +- ... +- ... +- archive `------------------------------------- I can see max. the Folders 'Shared Folders.shared.backup', not they subfolders! :( Now the techs: ,------------------------------------- dovecot --version 1.2.11 dovecot -n # 1.2.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-686 i686 Debian 5.0.4 ext3 log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot.info.log log_timestamp: %Y-%m-%d %H:%M:%S | protocols: imap managesieve lda listen(default): * listen(imap): * listen(managesieve): *:2000 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_greeting: S2B Dovecot ready. login_log_format_elements: user=<%n> method=%m rip=%r lip=%l %c max_mail_processes: 64 verbose_proctitle: yes first_valid_gid: 100 mail_privileged_group: vmail mail_uid: 1101 mail_gid: 1101 mail_location: maildir:/home/vmail/%n/:CONTROL=/home/vmail/%n/control:INDEX=/home/vmail/%n/indexes mailbox_idle_check_interval: 120 mail_debug: yes maildir_stat_dirs: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): autocreate mail_plugins(imap): autocreate mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve mail_log_prefix: %Us(%n): namespace: type: private separator: . location: maildir:/home/vmail/%n/:CONTROL=/home/vmail/%n/control:INDEX=/home/vmail/%n/indexes:LAYOUT=maildir++ inbox: yes list: yes subscriptions: yes namespace: type: public separator: . prefix: Shared Folders. location: maildir:/home/vmail/folder-shared:CONTROL=/home/vmail/%n/shared.control/:INDEX=/home/vmail/%n/shared.indexes/:LAYOUT=maildir++ list: yes lda: postmaster_address: postmaster@.....de mail_plugins: sieve auth_socket_path: /var/run/dovecot/auth-master deliver_log_format: msgid=%m: %$ log_path: /var/log/dovecot/dovecot-deliver.log info_log_path: /var/log/dovecot/dovecot-deliver.log mail_debug: yes auth default: mechanisms: plain login cache_size: 2048 username_format: %Ln worker_max_count: 25 passdb: driver: pam args: session=yes cache_key=%u dovecot passdb: driver: passwd-file args: /etc/dovecot/dovecot-pwd.conf userdb: driver: static args: uid=1101 gid=1101 home=/home/vmail/%Lu socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: autocreate: Trash autocreate2: Spam autosubscribe: Trash autosubscribe2: Spam mail_log_events: delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields: uid box msgid size convert_skip_broken_mailboxes: no convert_skip_dotdirs: no sieve: /home/SIEVE-SCRIPTE/%Ln.sieve mail_debug: yes `------------------------------------- Can you please help me? Bodo PS: sorry about my english :}

7 13

[Dovecot] Ok with a bit more wiki reading ...
by Chuck McManis 17 Jun '10

17 Jun '10

So if I want to run dovecot from tcpserver it seems like I can simply run `pop3-login --ssl` from tcpserver (its sort of like running it from inetd) and it says it will 'talk to dovecot'. Can I disable all listeners in dovecot then? Will is still talk to it? Trying some experiments now ... --Chuck

1 0

[Dovecot] Migrating from CommunigatePro to Dovecot - anyone done this?
by Gavin Lawrie 16 Jun '10

16 Jun '10

Apologies if this is in the archive - did look but couldn't find it. Does anyone have any experience of migrating from CommunigatePro to Dovecot? We currently run CGP 5.3.4, supporting a small system (20 or so users, one domain). We've been using it for years, and have a mixed bag of MailDir and mbox folders accessed via IMAP clients. Some users have large mail accounts (15GB total). We're looking to move as CGP is evolving into a complex "Messaging Centre" application (PBX, SIP, Mail, Groupware, Portals etc.) which we don't need / use. I had a look on the Dovecot Wiki and under migration are discussions about various other mail systems, but I don't know enough about these to tell if they would also apply to CGP. Any thoughts / suggestions would be welcomed. Thanks Gavin. * Balanced Scorecard Training from 2GC: Next course 16th July 2010 in the UK. More information from http://www.2gc.co.uk/balanced-scorecard-training-dates ----------------------------- 2GC Limited is a limited company registered in England and Wales. Address: Albany House, Market Street, Maidenhead, Berkshire, SL6 8BE. Contact: +44 (0) 1628 421506 // info(a)2gc.co.uk Registered number: 3754183. Registered office:16, Wentworth Road, Oxford OX2 7TQ. http://www.2gc.co.uk/

4 4

[Dovecot] Patch to fix leak in imap_refresh_proctitle in beta[5, 6]
by Mike Abbott 16 Jun '10

16 Jun '10

The "imap" process of dovecot-2.0.beta[5,6] grows very large (I impose no system limits), e.g. exceeding 4.8GB on a 64-bit system. These messages appear in the logs: Warning: Growing pool 'imap client' with: 2048 Warning: Growing pool 'Cache fields' with: 2048 Warning: Growing data stack with: 32768 Warning: Growing data stack with: 65536 Warning: Growing data stack with: 131072 [...] Warning: Growing data stack with: 1073741824 Warning: Growing data stack with: 2147483648 Warning: Growing data stack with: 4294967296 Every time the data stack grows, the backtrace ends with either: 2 libdovecot.0.dylib 0x00000001059a35c3 pool_data_stack_realloc + 72 -> 3 libdovecot.0.dylib 0x0000000105994d59 buffer_alloc + 59 -> 4 libdovecot.0.dylib 0x0000000105994ef9 buffer_check_limits + 127 -> 5 libdovecot.0.dylib 0x00000001059950e8 buffer_append + 38 -> 6 imap 0x0000000105867333 imap_refresh_proctitle + 218 -> 7 imap 0x000000010585f18e client_command_input + 190 -> [...] or 2 libdovecot.0.dylib 0x00000001059a35c3 pool_data_stack_realloc + 72 -> 3 libdovecot.0.dylib 0x0000000105994d59 buffer_alloc + 59 -> 4 libdovecot.0.dylib 0x0000000105994ef9 buffer_check_limits + 127 -> 5 libdovecot.0.dylib 0x00000001059950e8 buffer_append + 38 -> 6 imap 0x0000000105867333 imap_refresh_proctitle + 218 -> 7 imap 0x00000001058666ce cmd_sync_continue + 199 -> [...] Here is a patch to fix it: --- a/src/imap/main.c (beta6) +++ b/src/imap/main.c (working copy) @@ -39,11 +39,12 @@ #define IMAP_PROCTITLE_PREFERRED_LEN 80 struct client *client; struct client_command_context *cmd; - string_t *title = t_str_new(128); + string_t *title; if (!verbose_proctitle) return; + title = str_new(default_pool, 128); str_append_c(title, '['); switch (imap_client_count) { case 0: @@ -72,6 +73,7 @@ } str_append_c(title, ']'); process_title_set(str_c(title)); + str_free(&title); } static void client_kill_idle(struct client *client) And perhaps there should be a warning when data is allocated out of the primordial data stack (as opposed to a nested one)?

2 5

[Dovecot] search bug?
by Pozsar Balazs 16 Jun '10

16 Jun '10

Hi all, I have emails with multiple Delivered-To: headers in them. The problem is that the SEARCH command only searches in the first instances. For example: 1 FETCH 14557 BODY[HEADER.FIELDS (Delivered-To)] * 14557 FETCH (BODY[HEADER.FIELDS (DELIVERED-TO)] {85} Delivered-To: pozsy(a)ojjektum.uhulinux.hu Delivered-To: szamlagyar(a)uhusystems.com ) 1 OK Fetch completed. 1 SEARCH HEADER Delivered-To szamlagyar(a)uhusystems.com * SEARCH 14589 1 OK Search completed (0.146 secs). You can see the meesage with the id 14557 _has_ a "Delivered-To: szamlagyar(a)uhusystems.com" header field, but the SEARCH does not find it, only another message. This is with dovecot 1.2.11. For the record, cyrus-imapd behaves as I would have expected, and I could not find anything relevant in the RFCs. Could anyone tell me if this is a bug, or how to search like I would want? Thanks, Balazs Pozsar

3 6

[Dovecot] New admin, not much success
by Chuck McManis 16 Jun '10

16 Jun '10

Hello, I'm trying to set up something fairly simple (famous last words) using Dovecot. I have a very small setup (just a dozen users) I'm using qmail as my MTA. I'm running FreeBSD 8.0 I've got qmail delivering into a file named 'Mailbox' in user's home directories. I prefer not to use Maildir delivery because from a shell its a PITA to get a Maildir aware MUA (I use /bin/mail when I'm attached locally) What I'm trying to do is configure an SSL only POP3 server so that folks can retrieve their email on the road without divulging their passwords. My backup scenario is to put VPN software on my user's clients and having them VPN into the network and then do un-encrypted POP3 from the VPN. I prefer not to do this as it means maintaining the VPN client as well. Users have a mix of MacOS, Windows, and Linux. So, I can't get dovecot to work at all. In an unusual turn about I got the SSL stuff working but not the mailbox handling. I'm running 2.0beta6 Output from dovecot -n ------------------------------------------------------------------------------------ # 2.0.beta6: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.0-RELEASE-p2 i386 nfs auth_debug = yes auth_verbose = yes default_internal_user = nobody default_login_user = nobody listen = * mail_full_filesystem_access = yes mail_location = mbox:/home/%u/:INBOX=/home/%u/ passdb { driver = pam } protocols = pop3 service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service pop3 { process_limit = 1024 } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } ----------------------------------------------------------------------- A typical failure looks like this in maillog: Jun 15 22:19:20 eeebox dovecot: master: Dovecot v2.0.beta6 starting up Jun 15 22:20:29 eeebox dovecot: pop3-login: Login: user=<cmcmanis>, method=PLAIN, rip=66.125.189.27, lip=66.125.189.30, mpid=78871, TLS Jun 15 22:20:29 eeebox dovecot: pop3(cmcmanis): Error: Opening INBOX failed: Mailbox isn't selectable Jun 15 22:20:29 eeebox dovecot: pop3(cmcmanis): Error: Couldn't open INBOX: Mailbox isn't selectable Jun 15 22:20:29 eeebox dovecot: pop3(cmcmanis): Couldn't open INBOX top=0/0, retr=0/0, del=0/0, size=0 -------------------------------------------------------------- Home directories are mounted via NFS and root doesn't have access, but if dovecot accesses the Mailbox as the user it should work fine. I'm about ready to start hacking in additional logging into mail-storage.c to figure out what "mailbox isn't selectable" means. --Chuck

4 12

[Dovecot] Logout after SSL/TLS negociation
by bmfr 16 Jun '10

16 Jun '10

Hi All, I've set up Dovecot to use my signed SSL certificate and IMAP client is using STARTTLS on port 143 without secure authentication. The TLS negociation process seems to go through ok but once the negociation is finished the client sends an IMAP LOGOUT message; he does not try to authenticate, below is the Dovecot's info log: dovecot: 2010-06-15 15:37:01 Info: auth(default): new auth connection: pid=3932 dovecot: 2010-06-15 15:37:03 Info: imap-login: Aborted login (0 authentication attempts): rip=130.100.32.54, lip=10.0.3.3, TLS I've decrypted the TLS negociation thanks to Wireshark (in SSL preferences I added the certificate's private key to decode the stream between client and server) but unfortunately it does not say why the client is sending the LOGOUT command. Do you have an idea of what could be wrong in my server set up? What debugging process would you advise me to follow? Thanks a lot for your precious help. Bastien -- View this message in context: http://old.nabble.com/Logout-after-SSL-TLS-negociation-tp28900688p28900688.… Sent from the Dovecot mailing list archive at Nabble.com.

3 4