November 2007 - dovecot

[Dovecot] 1.1.beta9 deliver crashes with segfault
by arvids 28 Nov '07

28 Nov '07

Hello, after upgrade from beta8 to beta9 deliver process crashes with segfault. Deleting old maildirs does not help. Here is backtrace: Program received signal SIGSEGV, Segmentation fault. 0x0808e36d in mail_cache_field_get_decision (cache=0x8114da0, field_idx=128) at mail-cache-lookup.c:301 301 i_assert(field_idx < cache->fields_count); (gdb) bt #0 0x0808e36d in mail_cache_field_get_decision (cache=0x8114da0, field_idx=128) at mail-cache-lookup.c:301 #1 0x0808f351 in mail_cache_field_can_add (ctx=0x810ca58, seq=1, field_idx=4) at mail-cache-transaction.c:997 #2 0x0808351f in index_mail_want_cache (mail=0x810ce00, field=<value optimized out>) at index-mail.c:597 #3 0x08084046 in index_mail_cache_sizes (mail=0x810ce00) at index-mail.c:618 #4 0x080845a7 in index_mail_close (_mail=0x810ce00) at index-mail.c:971 #5 0x0808510e in index_mail_free (_mail=0x810ce00) at index-mail.c:1166 #6 0x080a8e20 in mail_free (mail=0x810cdcc) at mail.c:18 #7 0xb7e3dd3c in quota_mailbox_transaction_commit (ctx=0x810c6f8, uid_validity_r=0xbfedf444, first_saved_uid_r=0xbfedf444, last_saved_uid_r=0xbfedf444) at quota-storage.c:100 #8 0x080aa525 in mailbox_transaction_commit (t=0xbfedf484) at mail-storage.c:661 #9 0x08059304 in deliver_save (namespaces=0x80f1210, storage_r=0xbfedf558, mailbox=0x80d6918 "INBOX", mail=0x80f8260, flags=0, keywords=0x0) at deliver.c:146 #10 0x0805a6cd in main (argc=1301916, argv=0xbfedf614) at deliver.c:898 my dovecot -n output: # 1.1.beta9: /usr/local/dovecot/etc/dovecot.conf base_dir: /var/run/dovecot/ syslog_facility: local0 protocols: pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/local/dovecot/libexec/dovecot/pop3-login login_greeting: Server. login_process_per_connection: no login_processes_count: 5 login_max_processes_count: 32 verbose_proctitle: yes first_valid_uid: 95 first_valid_gid: 95 mail_uid: 95 mail_gid: 95 mail_location: maildir:~/Maildir mail_debug: yes dotlock_use_excl: yes fsync_disable: yes mail_executable: /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins: quota mail_plugin_dir: /usr/local/dovecot/lib/dovecot/pop3 pop3_enable_last: yes pop3_client_workarounds: outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login digest-md5 cram-md5 apop cache_size: 1024 cache_ttl: 600 cache_negative_ttl: 60 user: doveauth verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: dict:::proxy:/var/run/dovecot/dict-server:quotadict dict: quotadict: mysql:/usr/local/dovecot/etc/dovecot-sql-dict-quota.conf Regards, Arvids

2 1

[Dovecot] Can't login from Mac OS X Mail.app
by Mike McGonagle 28 Nov '07

28 Nov '07

Hello all, I have been working on getting this machine -- Peace may sound simple—one beautiful word— but it requires everything we have, every quality, every strength, every dream, every high ideal. —Yehudi Menuhin (1916–1999), musician

2 1

[Dovecot] Embracing .99
by Joe Allesi -X (joallesi - Coyote Creek Consulting at Cisco) 28 Nov '07

28 Nov '07

We're stuck on RHEL 4.x, so we're currently working on a plan to live in harmony with .99 for another year or so. With that said, the plan is below. Let me know if you have any other recommendations. [ ]Convert to high-performance mode vice high-security to reduce overall resource usage. [ ]Implement iptables throttling for new connections to prevent denials of service. [ ]Covert from mbox to maildir to help reduce the likelihood of corruption that lead to mailbox outages. As our overall individual mailbox usage is low, maildir seems to be a good option as mbox corruption has severely impacted a few of our high-profile applications. However, does anyone know of a sane method to use maildir on RHEL 4.x without switching over to Postfix? Thanks!

5 4

[Dovecot] Various uidlist and index errors with 1.1 on NFS
by Adam McDougall 28 Nov '07

28 Nov '07

Two nights ago I took a leap and extended my testing of dovecot 1.1 by replacing 1.0 for the approx 15 users I had on 1.0. At that time I also for the first time tried dovecot 1.1 in a load balanced 2 server configuration with indexes on NFS. I was hoping I did this right, using the mail_nfs params and 1.1 so fchown etc would flush the access cache, but I am getting a number of messages and errors that indicate things aren't happy. Attaching error logs. Some of the errors were caused by me running multiple mail clients including mutt, Thunderbird, Outlook Express, other users may be using one or more copies of thunderbird, or possibly other clients. Most commonly thunderbird. Any help or advice would be appreciated. My goal is to have shared indexes between servers since I will eventually have 4. I'd prefer to avoid maintaining some kind of user->server preference mapping in a proxy (haven't looked into it yet). Thanks. # 1.1.beta6: /usr/local/etc/dovecot.conf ssl_cert_file: /usr/local/etc/apache2/ssl/mail.pem ssl_key_file: /usr/local/etc/apache2/ssl/mail.pem login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_extra_groups: postlocal mail_location: maildir:%h/Maildir:CONTROL=%h/Maildir/dovecot/private/control:INDEX=%h/Maildir/dovecot/private/indexes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_plugins: acl mail_log_max_lines_per_sec: 0 imap_client_workarounds: delay-newmail netscape-eoh tb-extra-mailbox-sep namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: mail/ hidden: yes subscriptions: yes namespace: type: private separator: / prefix: Mail/ hidden: yes subscriptions: yes namespace: type: public separator: / prefix: #shared/decs/ location: maildir:/egr/mail/shared/decs:CONTROL=%h/Maildir/dovecot/public/control/decs:INDEX=%h/Maildir/dovecot/public/indexes/decs list: yes subscriptions: yes auth default: passdb: driver: pam userdb: driver: passwd args: system_user= socket: type: listen client: path: /var/spool/postfix/private/auth mode: 384 user: postfix group: postfix plugin: acl: vfile:/usr/local/etc/dovecot-acls:cache_secs=10

2 8

[Dovecot] Fwd: Re: Fwd: dovecot bug report (64 bit file offsets)
by markevich＠inbox.lv 27 Nov '07

27 Nov '07

Yes, the problem is the compatibility with the mysql library but I stull can't figure out how this might affect reading/writing. ---------- Forwarded message ---------- No: markevich(a)inbox.lv Kam: Marcus Rueckert <darix(a)opensu.se> Atbildt: markevich(a)inbox.lv Datums: Tue, 27 Nov 2007 14:15:29 +0200 Temats: Re: [Dovecot] Fwd: dovecot bug report (64 bit file offsets) I agree that it’s kind strange behavior. Also I’ve googled that exactly the same errors (unexpected eof found … on file ‘UNOPENED’) were related to mysql. But how mysql compile options might affect configuration file parsing and read/write operations? (indexes for example) Does any one have any idea why this might happen? “any slight change to the main dovecot.conf file can prevent dovecot from starting (segfault with "Unexpected eof found when reading file 'UNOPENED' (Errcode: 0)" message), whereas i386 packages work somewhat better.” http://dovecot.org/list/dovecot/2006-April/012340.html Regards, Andris Quoting Marcus Rueckert : which is funny actually as on opensuse (10.1 -> 10.3 -> factory) has no problem with dovecot running on x86_64. darix -- openSUSE - SUSE Linux is my linux openSUSE is good for you www.opensuse.org -- Tavs bezmaksas pasts Inbox.lv Links: ------ [1] mailto:darix@opensu.se ---------- End of forwarded message ---------- -- Tavs bezmaksas pasts Inbox.lv

1 0

[Dovecot] dovecot imap hangs
by russ 27 Nov '07

27 Nov '07

All, I recently did a fresh install/setup on centos 5 to replace my older courier-imap and all seemed to go well until today I started to notice that it simply hangs. I use thunderbird and squirrel mail and after a while it seems like I"m simply rejected. I'm almost guessing that it has to do with the session timing out and then dovecot is unwilling or unable to renew the session. I can't login and there is little or no information in the logs. I've set up a cron job to restart dovecot every 5 minutes to deal with this for now. I'm new to dovecot, what sort of info should I send to you guys? I'm using centos 5, qmail-ldap and Maildir for my mail format. OpenLDAP: slapd 2.3.27 dovecot-1.0-1.2.rc15.el5 my /etc/dovecot.conf =================== mail_location = maildir:%h namespace private { prefix = INBOX. inbox = yes } mail_debug = yes maildir_copy_with_hardlinks = yes auth default { mechanisms = plain passdb ldap { # Path for LDAP configuration file, see doc/dovecot-ldap.conf for example args = /etc/dovecot-ldap.conf } userdb ldap { args = /etc/dovecot-ldap.conf } } =================== my dovecot-ldap.conf =================== # This file is opened as root, so it should be owned by root and mode 0600. # # NOTE: If you're not using authentication binds, you'll need to give # dovecot-auth read access to userPassword field in the LDAP server. # With OpenLDAP this is done by modifying /etc/ldap/slapd.conf. There should # already be something like this: # access to attribute=userPassword # by dn="<dovecot's dn>" read # add this # by anonymous auth # by self write # by * none # Space separated list of LDAP hosts to use. host:port is allowed too. hosts =127.0.0.1:389 # LDAP URIs to use. You can use this instead of hosts list. Note that this # setting isn't supported by all LDAP libraries. #uris = # Distinguished Name - the username used to login to the LDAP server #dn = dn=cn=Manager,dc=cttechhosting,dc=net dnpass=secret # Password for LDAP server #dnpass = # Use SASL binding instead of the simple binding. Note that this changes # ldap_version automatically to be 3 if it's lower. Also note that SASL binds # and auth_bind=yes don't work together. #sasl_bind = no # SASL mechanism name to use. #sasl_mech = # SASL realm to use. #sasl_realm = # SASL authorization ID, ie. the dnpass is for this "master user", but the # dn is still the logged in user. Normally you want to keep this empty. #sasl_authz_id = # Use authentication binding for verifying password's validity. This works by # logging into LDAP server using the username and password given by client. # The pass_filter is used to find the DN for the user. Note that the pass_attrs # is still used, only the password field is ignored in it. Before doing any # search, the binding is switched back to the default DN. auth_bind = yes # If authentication binding is used, you can save one LDAP request per login # if users' DN can be specified with a common template. The template can use # the standard %variables (see user_filter). Note that you can't # use any pass_attrs if you use this setting. # # If you use this setting, it's a good idea to use a different # dovecot-ldap.conf for userdb (it can even be a symlink, just as long as the # filename is different in userdb's args). That way one connection is used only # for LDAP binds and another connection is used for user lookups. Otherwise # the binding is changed to the default DN before each user lookup. # # For example: # auth_bind_userdn = cn=%u,ou=people,o=org # auth_bind_userdn = uid=%u,ou=accounts,dc=cttechhosting,dc=net # LDAP protocol version to use. Likely 2 or 3. #ldap_version = 2 ldap_version=3 # LDAP base. %variables can be used here. base = ou=accounts,dc=cttechhosting,dc=net # Dereference: never, searching, finding, always #deref = never # Search scope: base, onelevel, subtree #scope = subtree # User attributes are given in LDAP-name=dovecot-internal-name list. The # internal names are: # uid - System UID # gid - System GID # home - Home directory # mail - Mail location # # There are also other special fields which can be returned, see # http://wiki.dovecot.org/UserDatabase/ExtraFields user_attrs = mailMessageStore=home,qmailUID=uid,qmailGID=gid,mailMessageStore=mail # Filter for user lookup. Some variables can be used (see # http://wiki.dovecot.org/Variables for full list): # %u - username # %n - user part in user@domain, same as %u if there's no domain # %d - domain part in user@domain, empty if user there's no domain user_filter = (&(objectClass=qmailUser)(uid=%u)) # Password checking attributes: # user: Virtual user name (user@domain), if you wish to change the # user-given username to something else # password: Password, may optionally start with {type}, eg. {crypt} # There are also other special fields which can be returned, see # http://wiki.dovecot.org/PasswordDatabase/ExtraFields pass_attrs = mail=user,userPassword=password # If you wish to avoid two LDAP lookups (passdb + userdb), you can use # userdb prefetch instead of userdb ldap in dovecot.conf. In that case you'll # also have to include user_attrs in pass_attrs field prefixed with "userdb_" # string. For example: #pass_attrs = uid=user,userPassword=password,homeDirectory=userdb_home,qmailUID=userdb_uid,qmailGID=userdb_gid # Filter for password lookups pass_filter = (&(objectClass=qmailUser)(uid=%u)) # Default password scheme. "{scheme}" before password overrides this. # List of supported schemes is in: http://wiki.dovecot.org/Authentication default_pass_scheme = LDAP-SHA # You can use same UID and GID for all user accounts if you really want to. # If the UID/GID is still found from LDAP reply, it overrides these values. #user_global_uid = ========================= #user_global_gid = ===================

4 6

[Dovecot] Fwd: dovecot bug report (64 bit file offsets)
by markevich＠inbox.lv 27 Nov '07

27 Nov '07

I have found similar problem: http://www.dovecot.org/list/dovecot/2007-January/018623.html "After configure remove HAVE_PREAD from config.h, recompile and see if it works." I think I figured out where might be the problem. If the binary is compiled in the 64bit environment and you want to use 64 bit file offset you must use 64 bit equivalents of the function. Of course if you are using open/pread (which are 32 bit compatible only) the whole program functionality will be broken. You must use open64/pread64 etc. Else macros _LARGE_FILE_API should be defined in order to use large files in other case nothing will work (random parsing errors and dead indexes will appear ). As I can see there is a big issue in the dovecot. http://publib.boulder.ibm.com/iseries/v5r2/ic2924/index.htm?info/apis/pread… Regards, Andris ---------- Forwarded message ---------- No: markevich(a)inbox.lv Kam: tss(a)iki.fi Reply-To: markevich(a)inbox.lv Date: Tue, 27 Nov 2007 10:45:23 +0200 Temats: dovecot bug report (64 bit file offsets) Hello. I found 2 issues while using dovecot in the 64-bit system. Before that I was using it on the Solaris 10 32bit and everything worked fine. First issue is that it's impossible to specify Openssl library directory, there is only possiblity to specify type gnutls/openssl. But if there are 2 versions of openssl installed it's hard to specify which one we want to use, we need to play with AUXLIBS and LD flags to prevent looking in un-needed locations. I'm suggesting to add new ./configure key like --with-ssl-dir like all other programs do (why dovecot hasn't it?). For example in FC8 openssl 0.9.8b is available in the packages but latest is 0.9.8.g, and it's impossible to compile dovecot with 0.9.8b because of the missing function in it which present in 0.9.8.g. Second and most serious bug is that it seems that dovecot is unable to use 64 file offsets correctly. First problem was that I as unable to launch dovecot at all - it gave a lot of configuration file (dovecot.conf) parsing errors (which is working perfectly on the 32 bit Solaris). It was very strange because he complained that he is expecting to see '=' in the line where only comments are located. Deleting some lines at the start of the configuration file produced the error on random lines (I can't describe it in other way) but with the comments too. For example, first error complained that line 42 is incorrect (only comments are there), after deletion of 2 empty lines at the beginning dovecot complained that line 172 has errors but any way there are only comments there too. I've deleted all of the comments from the configuration file but still dovecot randomly is giving such errors. Any way dovecot is UNABLE to parse all my file, I can see it from dovecot -n. He is starting normally (time to time) but only half of the configuration file is read. Similar problems goes with the indexes dovecot.index.log - dovecot is able to create the files but is unable to read them after any access to it dovecot generates errors like unexpected eof found and file is corrupted. From all this I can assume that 64bit file offsets on a 64 bit system aren't working at all. Latest dovecot 1.0.7 (also tried 1.0.5) Fedora core 8 64bit (with latest patches and updates) Intel core duo 6300 (x86_64) XFS (only local filesystem) Regards, Andris

2 3

[Dovecot] dovecot with ldap and allow_nets
by Marc Cuypers 27 Nov '07

27 Nov '07

Hi, I'm using dovecot on debian etch: ||/ Name Version ii dovecot-common 1.0.rc15-2etch1 ii dovecot-imapd 1.0.rc15-2etch1 ii dovecot-pop3d 1.0.rc15-2etch1 # dovecot --version 1.0.rc15 Now here is my question. Some of the mail users may only login from the LAN, while others can login from the LAN and the internet. I've read about allow_nets but i can't find very much info when dovecot is used with ldap. Can someone give me a direction (url, configuration file, ...). Thanks in advance. -- Best regards, Marc

3 9

[Dovecot] quota rewrite patch
by pawel.panek＠inet.pl 27 Nov '07

27 Nov '07

Hi, Can quota-rewrite-1.0.2.diff patch be applied to 1.0.5 or later versions? Anyone has tested it with 1.0.5 or 1.0.7 versions? Pawel --------------------------------------------------------------- Wiadomosc wyslana z panelu pocztowego iNet. http://www.inet.pl

3 3

[Dovecot] telnet virtual users
by jan gestre 27 Nov '07

27 Nov '07

Hi Guys, I've installed postfix + dovecot + postfixadmin + mysql in my CentOS 4.5 box and I would like to test it using telnet however I can't telnet it using the following syntax: $ telnet localhost pop3 Trying 127.0.0.1... Connected to localhost.localdomain (127.0.0.1). Escape character is '^]'. +OK Dovecot ready. user testuser(a)domain.com pass password -ERR Authentication failed. I've also telnet it using imap to no avail. Is there another way to do this? TIA

3 2