- dovecot - dovecot.org

[Dovecot] Various uidlist and index errors with 1.1 on NFS
by Adam McDougall 28 Nov '07

28 Nov '07

Two nights ago I took a leap and extended my testing of dovecot 1.1 by replacing 1.0 for the approx 15 users I had on 1.0. At that time I also for the first time tried dovecot 1.1 in a load balanced 2 server configuration with indexes on NFS. I was hoping I did this right, using the mail_nfs params and 1.1 so fchown etc would flush the access cache, but I am getting a number of messages and errors that indicate things aren't happy. Attaching error logs. Some of the errors were caused by me running multiple mail clients including mutt, Thunderbird, Outlook Express, other users may be using one or more copies of thunderbird, or possibly other clients. Most commonly thunderbird. Any help or advice would be appreciated. My goal is to have shared indexes between servers since I will eventually have 4. I'd prefer to avoid maintaining some kind of user->server preference mapping in a proxy (haven't looked into it yet). Thanks. # 1.1.beta6: /usr/local/etc/dovecot.conf ssl_cert_file: /usr/local/etc/apache2/ssl/mail.pem ssl_key_file: /usr/local/etc/apache2/ssl/mail.pem login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_extra_groups: postlocal mail_location: maildir:%h/Maildir:CONTROL=%h/Maildir/dovecot/private/control:INDEX=%h/Maildir/dovecot/private/indexes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_plugins: acl mail_log_max_lines_per_sec: 0 imap_client_workarounds: delay-newmail netscape-eoh tb-extra-mailbox-sep namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: mail/ hidden: yes subscriptions: yes namespace: type: private separator: / prefix: Mail/ hidden: yes subscriptions: yes namespace: type: public separator: / prefix: #shared/decs/ location: maildir:/egr/mail/shared/decs:CONTROL=%h/Maildir/dovecot/public/control/decs:INDEX=%h/Maildir/dovecot/public/indexes/decs list: yes subscriptions: yes auth default: passdb: driver: pam userdb: driver: passwd args: system_user= socket: type: listen client: path: /var/spool/postfix/private/auth mode: 384 user: postfix group: postfix plugin: acl: vfile:/usr/local/etc/dovecot-acls:cache_secs=10

2 8

[Dovecot] Fwd: Re: Fwd: dovecot bug report (64 bit file offsets)
by markevich＠inbox.lv 27 Nov '07

27 Nov '07

Yes, the problem is the compatibility with the mysql library but I stull can't figure out how this might affect reading/writing. ---------- Forwarded message ---------- No: markevich(a)inbox.lv Kam: Marcus Rueckert <darix(a)opensu.se> Atbildt: markevich(a)inbox.lv Datums: Tue, 27 Nov 2007 14:15:29 +0200 Temats: Re: [Dovecot] Fwd: dovecot bug report (64 bit file offsets) I agree that it’s kind strange behavior. Also I’ve googled that exactly the same errors (unexpected eof found … on file ‘UNOPENED’) were related to mysql. But how mysql compile options might affect configuration file parsing and read/write operations? (indexes for example) Does any one have any idea why this might happen? “any slight change to the main dovecot.conf file can prevent dovecot from starting (segfault with "Unexpected eof found when reading file 'UNOPENED' (Errcode: 0)" message), whereas i386 packages work somewhat better.” http://dovecot.org/list/dovecot/2006-April/012340.html Regards, Andris Quoting Marcus Rueckert : which is funny actually as on opensuse (10.1 -> 10.3 -> factory) has no problem with dovecot running on x86_64. darix -- openSUSE - SUSE Linux is my linux openSUSE is good for you www.opensuse.org -- Tavs bezmaksas pasts Inbox.lv Links: ------ [1] mailto:darix@opensu.se ---------- End of forwarded message ---------- -- Tavs bezmaksas pasts Inbox.lv

1 0

[Dovecot] dovecot imap hangs
by russ 27 Nov '07

27 Nov '07

All, I recently did a fresh install/setup on centos 5 to replace my older courier-imap and all seemed to go well until today I started to notice that it simply hangs. I use thunderbird and squirrel mail and after a while it seems like I"m simply rejected. I'm almost guessing that it has to do with the session timing out and then dovecot is unwilling or unable to renew the session. I can't login and there is little or no information in the logs. I've set up a cron job to restart dovecot every 5 minutes to deal with this for now. I'm new to dovecot, what sort of info should I send to you guys? I'm using centos 5, qmail-ldap and Maildir for my mail format. OpenLDAP: slapd 2.3.27 dovecot-1.0-1.2.rc15.el5 my /etc/dovecot.conf =================== mail_location = maildir:%h namespace private { prefix = INBOX. inbox = yes } mail_debug = yes maildir_copy_with_hardlinks = yes auth default { mechanisms = plain passdb ldap { # Path for LDAP configuration file, see doc/dovecot-ldap.conf for example args = /etc/dovecot-ldap.conf } userdb ldap { args = /etc/dovecot-ldap.conf } } =================== my dovecot-ldap.conf =================== # This file is opened as root, so it should be owned by root and mode 0600. # # NOTE: If you're not using authentication binds, you'll need to give # dovecot-auth read access to userPassword field in the LDAP server. # With OpenLDAP this is done by modifying /etc/ldap/slapd.conf. There should # already be something like this: # access to attribute=userPassword # by dn="<dovecot's dn>" read # add this # by anonymous auth # by self write # by * none # Space separated list of LDAP hosts to use. host:port is allowed too. hosts =127.0.0.1:389 # LDAP URIs to use. You can use this instead of hosts list. Note that this # setting isn't supported by all LDAP libraries. #uris = # Distinguished Name - the username used to login to the LDAP server #dn = dn=cn=Manager,dc=cttechhosting,dc=net dnpass=secret # Password for LDAP server #dnpass = # Use SASL binding instead of the simple binding. Note that this changes # ldap_version automatically to be 3 if it's lower. Also note that SASL binds # and auth_bind=yes don't work together. #sasl_bind = no # SASL mechanism name to use. #sasl_mech = # SASL realm to use. #sasl_realm = # SASL authorization ID, ie. the dnpass is for this "master user", but the # dn is still the logged in user. Normally you want to keep this empty. #sasl_authz_id = # Use authentication binding for verifying password's validity. This works by # logging into LDAP server using the username and password given by client. # The pass_filter is used to find the DN for the user. Note that the pass_attrs # is still used, only the password field is ignored in it. Before doing any # search, the binding is switched back to the default DN. auth_bind = yes # If authentication binding is used, you can save one LDAP request per login # if users' DN can be specified with a common template. The template can use # the standard %variables (see user_filter). Note that you can't # use any pass_attrs if you use this setting. # # If you use this setting, it's a good idea to use a different # dovecot-ldap.conf for userdb (it can even be a symlink, just as long as the # filename is different in userdb's args). That way one connection is used only # for LDAP binds and another connection is used for user lookups. Otherwise # the binding is changed to the default DN before each user lookup. # # For example: # auth_bind_userdn = cn=%u,ou=people,o=org # auth_bind_userdn = uid=%u,ou=accounts,dc=cttechhosting,dc=net # LDAP protocol version to use. Likely 2 or 3. #ldap_version = 2 ldap_version=3 # LDAP base. %variables can be used here. base = ou=accounts,dc=cttechhosting,dc=net # Dereference: never, searching, finding, always #deref = never # Search scope: base, onelevel, subtree #scope = subtree # User attributes are given in LDAP-name=dovecot-internal-name list. The # internal names are: # uid - System UID # gid - System GID # home - Home directory # mail - Mail location # # There are also other special fields which can be returned, see # http://wiki.dovecot.org/UserDatabase/ExtraFields user_attrs = mailMessageStore=home,qmailUID=uid,qmailGID=gid,mailMessageStore=mail # Filter for user lookup. Some variables can be used (see # http://wiki.dovecot.org/Variables for full list): # %u - username # %n - user part in user@domain, same as %u if there's no domain # %d - domain part in user@domain, empty if user there's no domain user_filter = (&(objectClass=qmailUser)(uid=%u)) # Password checking attributes: # user: Virtual user name (user@domain), if you wish to change the # user-given username to something else # password: Password, may optionally start with {type}, eg. {crypt} # There are also other special fields which can be returned, see # http://wiki.dovecot.org/PasswordDatabase/ExtraFields pass_attrs = mail=user,userPassword=password # If you wish to avoid two LDAP lookups (passdb + userdb), you can use # userdb prefetch instead of userdb ldap in dovecot.conf. In that case you'll # also have to include user_attrs in pass_attrs field prefixed with "userdb_" # string. For example: #pass_attrs = uid=user,userPassword=password,homeDirectory=userdb_home,qmailUID=userdb_uid,qmailGID=userdb_gid # Filter for password lookups pass_filter = (&(objectClass=qmailUser)(uid=%u)) # Default password scheme. "{scheme}" before password overrides this. # List of supported schemes is in: http://wiki.dovecot.org/Authentication default_pass_scheme = LDAP-SHA # You can use same UID and GID for all user accounts if you really want to. # If the UID/GID is still found from LDAP reply, it overrides these values. #user_global_uid = ========================= #user_global_gid = ===================

4 6

[Dovecot] Fwd: dovecot bug report (64 bit file offsets)
by markevich＠inbox.lv 27 Nov '07

27 Nov '07

I have found similar problem: http://www.dovecot.org/list/dovecot/2007-January/018623.html "After configure remove HAVE_PREAD from config.h, recompile and see if it works." I think I figured out where might be the problem. If the binary is compiled in the 64bit environment and you want to use 64 bit file offset you must use 64 bit equivalents of the function. Of course if you are using open/pread (which are 32 bit compatible only) the whole program functionality will be broken. You must use open64/pread64 etc. Else macros _LARGE_FILE_API should be defined in order to use large files in other case nothing will work (random parsing errors and dead indexes will appear ). As I can see there is a big issue in the dovecot. http://publib.boulder.ibm.com/iseries/v5r2/ic2924/index.htm?info/apis/pread… Regards, Andris ---------- Forwarded message ---------- No: markevich(a)inbox.lv Kam: tss(a)iki.fi Reply-To: markevich(a)inbox.lv Date: Tue, 27 Nov 2007 10:45:23 +0200 Temats: dovecot bug report (64 bit file offsets) Hello. I found 2 issues while using dovecot in the 64-bit system. Before that I was using it on the Solaris 10 32bit and everything worked fine. First issue is that it's impossible to specify Openssl library directory, there is only possiblity to specify type gnutls/openssl. But if there are 2 versions of openssl installed it's hard to specify which one we want to use, we need to play with AUXLIBS and LD flags to prevent looking in un-needed locations. I'm suggesting to add new ./configure key like --with-ssl-dir like all other programs do (why dovecot hasn't it?). For example in FC8 openssl 0.9.8b is available in the packages but latest is 0.9.8.g, and it's impossible to compile dovecot with 0.9.8b because of the missing function in it which present in 0.9.8.g. Second and most serious bug is that it seems that dovecot is unable to use 64 file offsets correctly. First problem was that I as unable to launch dovecot at all - it gave a lot of configuration file (dovecot.conf) parsing errors (which is working perfectly on the 32 bit Solaris). It was very strange because he complained that he is expecting to see '=' in the line where only comments are located. Deleting some lines at the start of the configuration file produced the error on random lines (I can't describe it in other way) but with the comments too. For example, first error complained that line 42 is incorrect (only comments are there), after deletion of 2 empty lines at the beginning dovecot complained that line 172 has errors but any way there are only comments there too. I've deleted all of the comments from the configuration file but still dovecot randomly is giving such errors. Any way dovecot is UNABLE to parse all my file, I can see it from dovecot -n. He is starting normally (time to time) but only half of the configuration file is read. Similar problems goes with the indexes dovecot.index.log - dovecot is able to create the files but is unable to read them after any access to it dovecot generates errors like unexpected eof found and file is corrupted. From all this I can assume that 64bit file offsets on a 64 bit system aren't working at all. Latest dovecot 1.0.7 (also tried 1.0.5) Fedora core 8 64bit (with latest patches and updates) Intel core duo 6300 (x86_64) XFS (only local filesystem) Regards, Andris

2 3

[Dovecot] dovecot with ldap and allow_nets
by Marc Cuypers 27 Nov '07

27 Nov '07

Hi, I'm using dovecot on debian etch: ||/ Name Version ii dovecot-common 1.0.rc15-2etch1 ii dovecot-imapd 1.0.rc15-2etch1 ii dovecot-pop3d 1.0.rc15-2etch1 # dovecot --version 1.0.rc15 Now here is my question. Some of the mail users may only login from the LAN, while others can login from the LAN and the internet. I've read about allow_nets but i can't find very much info when dovecot is used with ldap. Can someone give me a direction (url, configuration file, ...). Thanks in advance. -- Best regards, Marc

3 9

[Dovecot] quota rewrite patch
by pawel.panek＠inet.pl 27 Nov '07

27 Nov '07

Hi, Can quota-rewrite-1.0.2.diff patch be applied to 1.0.5 or later versions? Anyone has tested it with 1.0.5 or 1.0.7 versions? Pawel --------------------------------------------------------------- Wiadomosc wyslana z panelu pocztowego iNet. http://www.inet.pl

3 3

[Dovecot] telnet virtual users
by jan gestre 27 Nov '07

27 Nov '07

Hi Guys, I've installed postfix + dovecot + postfixadmin + mysql in my CentOS 4.5 box and I would like to test it using telnet however I can't telnet it using the following syntax: $ telnet localhost pop3 Trying 127.0.0.1... Connected to localhost.localdomain (127.0.0.1). Escape character is '^]'. +OK Dovecot ready. user testuser(a)domain.com pass password -ERR Authentication failed. I've also telnet it using imap to no avail. Is there another way to do this? TIA

3 2

[Dovecot] Dovecots Deliver being to verbose
by Dominik Schulz 27 Nov '07

27 Nov '07

Hi, I've got dovecot 1.0rc15 running on a Debian etch box toegether with deliver and exim4 backend by a mysql userdb. Everythin is working fine, except that deliver is much to verbose. It prints lots of information, including the password, for every mail delivered to the syslog. The problem here is that I don't wan't the password to be printed to a log somewhere. How can I turn this off? Relevant log entrys below. Best Regards Dominik Example from delivers logfile: deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: auth input: user(a)host.tld deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: auth input: user=user(a)host.tld deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: auth input: password=password deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: auth input: home=/home/mail/host.tld/user deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: auth input: uid=8 deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: auth input: gid=8 deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: Loading modules from directory: /usr/lib/dovecot/modules/lda deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: Module loaded: /usr/lib/dovecot/modules/lda/lib90_cmusieve_plugin.so deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: maildir: data=/home/mail/host.tld/user/Maildir deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: maildir: root=/home/mail/host.tld/user/Maildir, index=/home/mail/host.tld/user/Maildir, control=, inbox= deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: cmusieve: Using sieve path: /home/mail/host.tld/user/.dovecot.sieve deliver(user(a)host.tld): "2007-11-26 19:37:42 "Info: msgid=<49403.129.98.4.165.1196102178.squirrel(a)mail.host.com>: saved mail to dovecot Dovecot.conf w/o comments: base_dir = /var/run/dovecot/ protocols = imap imaps pop3 pop3s disable_plaintext_auth = no shutdown_clients = yes log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " ssl_disable = no ssl_cert_file = /etc/ssl/certs/cert.crt ssl_key_file = /etc/ssl/certs/key.pem ssl_parameters_regenerate = 168 ssl_cipher_list = ALL:!LOW login_dir = /var/run/dovecot/login login_chroot = yes login_user = dovecot login_process_size = 32 login_process_per_connection = yes login_processes_count = 3 login_max_processes_count = 128 login_max_connections = 256 login_greeting = Mailserver (powered by Dovecot) ready. mail_location = maildir:/home/mail/%d/%n/Maildir namespace private { separator = prefix = location = inbox = yes } mail_extra_groups = mail mail_debug = no first_valid_uid = 8 last_valid_uid = 8 max_mail_processes = 1024 mail_process_size = 256 mail_max_keyword_length = 50 umask = 0077 mbox_read_locks = fcntl mbox_write_locks = dotlock fcntl mbox_dotlock_change_timeout = 120 protocol imap { imap_max_line_length = 65536 login_greeting_capability = yes } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lda { postmaster_address = postmaster(a)host.tld mail_plugin_dir = /usr/lib/dovecot/modules/lda sendmail_path = /usr/lib/sendmail auth_socket_path = /var/run/dovecot/auth-master mail_plugins = cmusieve } auth_process_size = 256 auth_cache_size = 256 auth_cache_ttl = 3600 auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_verbose = no auth_debug = no auth_debug_passwords = no auth default { mechanisms = plain passdb pam { } passdb sql { args = /etc/dovecot/dovecot-sql.conf } userdb passwd { } userdb prefetch { } userdb sql { args = /etc/dovecot/dovecot-sql.conf } user = root socket listen { master { path = /var/run/dovecot/auth-master mode = 0600 } client { path = /var/run/dovecot/auth-client mode = 0600 user = mail group = mail } } } dict { } plugin { }

2 1

[Dovecot] Mailbox is in inconsistent state
by Dion Hollenbeck 27 Nov '07

27 Nov '07

Running on Fedora 7, error happening on both Dovecot 1.05, and now that I upgraded to 1.07, same thing occurs. dovecot -n # 1.0.7: /etc/dovecot.conf login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd Email client(s): Eudora 7.0.1 on XP and 6.2.x on NT both do the same thing. Protocol: POP3 Symptom: 1 - On Linux, fetchmail is bringing mail down from ISP and running it through SpamAssasin to remove spam. 2 - Still on Linux, I use Pine 4.64 to manually remove any spam or viruses not caught by SA. Exit Pine. 3 - On windoze, with Eurora, check for new mail, "ERR Mailbox is in inconsistent state, please relogin" 4 - Check for new mail second time, works perfectly. 5 - Use Pine again with new mail having arrived, same error occurs. 6 - Do not use Pine in between and error does not occur. I have tried searching the mailing list archives for this error, but it only is mentioned in conjunction with IMAP. Noticed that UIDs of some value can cause the problem. My actual user IDs start with 500, which according to dovecot.conf is the default allowable. I have made no changes to dovecot.conf at all. I also tried looking at the log, but it appears to be a binary (located in /home/<username>/mail/.imap/INBOX/dovecot.index.log) not a readable text file. thanks, dion -- Dion Hollenbeck Email: hollen(a)woodsprite.com Home Page: http://www.woodsprite.com Brewing Page: http://hbd.org/hollen Toys: 98 4Runner, 86 4x4 PU

2 5

[Dovecot] Dovecot + Cygwin
by Ronny 26 Nov '07

26 Nov '07

Hey guys, does somebody get dovecot work under cygwin? The compilation finish without any problems. But after trying to run dovecot i got this in my log: dovecot: Nov 17 02:40:18 Info: Dovecot v1.0.7 starting up dovecot: Nov 17 02:40:19 Fatal: setrlimit(RLIMIT_DATA, 256): Invalid argument dovecot: Nov 17 02:40:19 Error: Auth process died too early - shutting down dovecot: Nov 17 02:40:19 Error: child 1452 (auth) returned error 89 setting auth_process_size to another value didn't fixed this issue. Thanks for any help Greets $ /sbin/dovecot -n # 1.0.7: /etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/dovecot.log ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable: /libexec/dovecot/imap-login login_user: Administrator mail_location: maildir:~/Maildir auth default: user: Administrator passdb: driver: passwd-file args: /etc/passwd.dovecot userdb: driver: passwd

2 10