- dovecot - dovecot.org

[Dovecot] How to change dovecot's bounce message
by Markus Reymann 20 Dec '07

20 Dec '07

Hi, I am using the quota plugin of dovecot. Dovecot is running as LDA for postfix. When the system is running into the quota limit, the bounce message reads as follows: > Your message was automatically rejected by Dovecot Mail Delivery Agent. > The following reason was given: > Quota exceeded Can I somehow change this message, to make it more userfriendly? Postfix has a possibilty to change the bounce_template_file. Best regards, Markus

2 1

[Dovecot] Massive Dovecot auth errors too strange for me
by Rudi K. 20 Dec '07

20 Dec '07

Hello out there, im running Dovecot on "ubuntu Dapper" serving pop3 only in maildir-style, but the dove-auth-process refuses "answers" to the deliver or login-process from time to time, (several times a day), and I have no glue whats going on and why ... Debbugging password-Auth surprised me, as the transmitted password IS correct and allows an successfull authenification lots of hundreds times a day.... but suddenly runs into trouble .. here the logs ... (please take care..., I´m a newbie ;-) Dec 18 10:25:05 server dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=91.9.201.219, lip=83.154.61.77 Dec 18 10:25:07 server deliver(user.yxz(a)somedom.de): User request from dovecot-auth timed out Dec 18 10:25:07 server postfix/pipe[22156]: 63861180062A7: to=<user.yxz(a)somedom.de>, relay=dovecot, delay=60, status=deferred (temporary failure) Dec 18 10:33:09 server dovecot: auth(default): ssha_verify(info(a)mydom.de): invalid SSHA base64 decode Dec 18 10:33:09 server dovecot: auth(default): cache(info(a)mydom.de,84.166.106.150): Password mismatch Dec 18 10:33:09 server dovecot: auth(default): cache(info(a)mydom.de,84.166.106.150): SSHA(1234) != '1234' Dec 18 10:33:11 server dovecot: auth(default): client out: FAIL^I56^Iuser=info(a)mydom.de Dec 18 10:33:11 server dovecot: auth(default): client out: FAIL^I57^Iuser=info(a)mydom.de root@server:~# dovecot --version 1.0.rc17 root@server:~# dovecot --build-options Build options: ioloop=poll notify=dnotify ipv6 openssl SQL drivers: mysql postgresql sqlite Passdb: checkpassword ldap pam passwd passwd-file shadow sql Userdb: checkpassword ldap passwd prefetch passwd-file sql static root@server:/etc/dovecot# grep -v '^ *$#.*$\?$' dovecot-ldap.conf hosts = localhost dn = cn=admin,dc=jdbit,dc=de dnpass = auth_bind = yes ldap_version = 3 base = ou=mailsystem,dc=jdbit,dc=de scope = subtree user_attrs = uid=user,userPassword=password user_filter = (&(objectClass=ekitsMailAccount)(|(uid=%u)(userAlias=%u))) pass_attrs = uid=user,userPassword=password pass_filter = (&(objectClass=ekitsMailAccount)(|(uid=%u)(userAlias=%u))) default_pass_scheme = SSHA user_global_uid = vmail user_global_gid = vmail root@server:~# dovecot -n # /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: pop3 listen: mail.mydom.de disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/pop3-login login_greeting: mail.mydom.de POP3-Server ready login_process_size: 64 login_processes_count: 64 first_valid_uid: 5000 last_valid_uid: 5000 first_valid_gid: 5000 last_valid_gid: 5000 mail_extra_groups: mail mail_location: maildir:/var/spool/dovecot/mail/%Ld/%Ln mail_executable: /usr/lib/dovecot/pop3 mail_process_size: 384 mail_plugin_dir: /usr/lib/dovecot/modules/pop3 pop3_uidl_format: %08Xu%08Xv pop3_client_workarounds: outlook-no-nuls oe-ns-eoh auth default: cache_ttl: 0 user: nobody worker_max_count: 60 passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen client: master: path: /var/run/dovecot/dovecot-auth-master mode: 384 user: vmail

2 1

[Dovecot] Question with versions and problem with IMAP
by Drew Weaver 20 Dec '07

20 Dec '07

General question I have is this. Recently my personal server which I receive e-mail for a domain which is just for playing with rebooted on its own and I had both an RPM version and a source version of dovecot installed on the same machine. The RPM version started first even though I had been running under the source built version up until this point (I originally found that for some reason the version centos built was missing something, maybe plugins, I don't remember now) Anyhow, the question I have is why did it insist that all of my mail was new mail? I quickly realized what the problem is, and I noticed that once I switched it back and forth between the old and new versions it properly updated the 'read vs unread' mail in IMAP, and even though dovecot was using the same configuration file with both binaries (/etc/dovecot.conf) it made such a huge difference. The reason I am asking is because I want to update my source version from 1.0.rc2 to 1.0.9 but I would really like to retain my read vs. unread mail. The RPM version in question is: 0.99.11 The problem I am facing is, today a large mailbox approx. 570M suddenly stopped working via IMAP in outlook express. (again on version 1.0.rc2) no changes have been made to the configuration for over a year. There are no errors in maillog here is the output however: Dec 18 09:49:53 mail dovecot: imap-login: Login: user=<user>, method=PLAIN, rip=client, lip=server Dec 18 09:49:53 mail dovecot: IMAP(user): Effective uid=552, gid=100 Dec 18 09:49:53 mail dovecot: IMAP(user): Loading modules from directory: /usr/local/lib/dovecot/imap Dec 18 09:49:53 mail dovecot: IMAP(user): Module loaded: /usr/local/lib/dovecot/imap/lib01_quota_plugin.so Dec 18 09:49:53 mail dovecot: IMAP(user): Module loaded: /usr/local/lib/dovecot/imap/lib02_imap_quota_plugin.so Dec 18 09:49:53 mail dovecot: IMAP(user): maildir: data=/home/user/Maildir:INDEX=/mailaux/user:CONTROL=/mailaux/user Dec 18 09:49:53 mail dovecot: IMAP(user): maildir: root=/home/user/Maildir, index=/mailaux/user, control=/mailaux/user, inbox= Dec 18 09:49:53 mail dovecot: IMAP(user): fs quota add storage dir = /home/user/Maildir Dec 18 09:49:53 mail dovecot: IMAP(user): fs quota block device = /dev/sda1 Dec 18 09:49:53 mail dovecot: IMAP(user): fs quota mount point = /home Dec 18 09:49:55 mail dovecot: IMAP(user): Disconnected: Logged out Outlook express gives its usually helpful error message: Header download for the 'Inbox' folder did not complete. Account: 'server', Server: 'server', Protocol: IMAP, Server Response: '', Port: 143, Secure(SSL): No, Error Number: 0x800C0148 Any advice on either of these issues would just be great. Happy holidays to those who are celebrating this time of year! -Drew

2 1

[Dovecot] Upgrading from 1.0.rc2-1ubuntu2.2 on edgy
by Daragh Mc Grath 20 Dec '07

20 Dec '07

Hi Guys, Can anyone shed some light as to how I upgrade away from 1.0.rc2-1ubuntu2.2 on edgy? The usual aptitude upgrades aren't doing anything for me, and, downloading the package from another Ubuntu release, and trying a dpkg -i is causing lots of dependency errors. Daragh

2 1

Re: [Dovecot] Dovecot + SASL + allow_nets
by Andrew Garner 20 Dec '07

20 Dec '07

> Timo Sirainen schreef: > > On Mon, 2007-12-03 at 14:36 +0100, Marc Cuypers wrote: > >> When using dovecot for authentication of an SASL (postfix) request, i > >> cannot use the allow_nets parameter. The IP-address of the requester is > >> not known in dovecot. > >> > >> I would like to allow sasl for certain users, others are not allowed to > >> access via SASL. > >> Some users can have access to imap and pop3 from certain IP-addresses. > >> > >> How could i combine this in then dovecot configuration? > > > > Since Postfix doesn't send the IP to Dovecot, there isn't anything on > > Dovecot's side you can do. You could try asking about this in Postfix > > list.. Someone at least had a patch which allowed sending local IP to > > Dovecot (http://marc.info/?t=119306971600010&r=1&w=2) Maybe it sends > > remote IP as well. I wrote that patch. It passes both endpoints (remote & local) through to dovecot . This lets you restrict smtp-auth just like pop3 or imap using the remote IP. In my case, I had played around with a quick hack for doing per-ip realming (using the local IP) w/ dovecot-sql.

3 4

[Dovecot] child (login) killed with signal 9
by Matt LaPlante 19 Dec '07

19 Dec '07

Hi, I'm running dovecot on an Ubuntu server (1:1.0.5-1ubuntu2). Dovecot provides pop3, imap, and sasl to postfix. The setup works quite nicely, however I do have one error that shows up repeatedly in my dovecot.log. <snip> dovecot: 2007-12-12 09:29:06 Error: child 32765 (login) killed with signal 9 dovecot: 2007-12-12 09:29:06 Error: child 18039 (login) killed with signal 9 dovecot: 2007-12-12 10:05:07 Error: child 26088 (login) killed with signal 9 dovecot: 2007-12-12 10:05:07 Error: child 5271 (login) killed with signal 9 dovecot: 2007-12-12 10:05:07 Error: child 5273 (login) killed with signal 9 <snip> I'm not aware that this is actually causing problems, but since it shows up several hundred times a day on a couple-user setup, I'm rather curious about what's causing it. Thanks, Matt

3 6

[Dovecot] maildirsize quota counting locking account?
by Daniel Watts 19 Dec '07

19 Dec '07

Hi, I've just straced a dovecot imap process and found one thread sitting there doing hundreds and hundreds of maildirsize updates as follows: > > open("/home/virtual/mydomain.com/home/admin/Maildir/maildirsize", O_RDWR|O_APPEND) = 7 > read(7, "10485760000S\n1562717408 107547\n-"..., 5120) = 2446 > read(7, "", 2674) = 0 > write(1, "* 1810 FETCH (UID 1815 RFC822.SI"..., 2031) = 2031 > setsockopt(1, SOL_TCP, TCP_CORK, [0], 4) = 0 > epoll_wait(4, {{EPOLLIN, {u32=101056896, u64=2370923004288}}}, 5, 2584) = 1 > read(0, "2838 UID fetch 1816 (UID RFC822."..., 2974) = 51 > setsockopt(1, SOL_TCP, TCP_CORK, [1], 4) = 0 > close(7) = 0 > open("/home/virtual/mydomain.com/home/admin/Maildir/maildirsize", O_RDWR|O_APPEND) = 7 > read(7, "10485760000S\n1562717408 107547\n-"..., 5120) = 2446 > read(7, "", 2674) = 0 > open("/home/virtual/mydomain.com/home/admin/Maildir/.Folders.ALERTS.Payments/cur/1195331425.M52296P11937V0000000000000807I000000001015A5EB_0.tg3,S=2079:2,Sa", O_RDONLY) = 10 > fstat(10, {st_mode=S_IFREG|0600, st_size=2079, ...}) = 0 > pread(10, "Return-Path: <apache(a)tg7.alumina"..., 4096, 0) = 2079 > pread(10, "", 2017, 2079) = 0 > pread(10, "Return-Path: <apache(a)tg7.alumina"..., 4096, 0) = 2079 > write(1, "* 1811 FETCH (UID 1816 RFC822.SI"..., 2180) = 2180 > close(10) = 0 > stat("/home/virtual/mydomain.com/home/admin/Maildir/.Folders.ALERTS.Payments/new", {st_mode=S_IFDIR|0700, st_size=6, ...}) = 0 > stat("/home/virtual/mydomain.com/home/admin/Maildir/.Folders.ALERTS.Payments/cur", {st_mode=S_IFDIR|0700, st_size=618496, ...}) = 0 > close(7) = 0 > open("/home/virtual/mydomain.com/home/admin/Maildir/maildirsize", O_RDWR|O_APPEND) = 7 > read(7, "10485760000S\n1562717408 107547\n-"..., 5120) = 2446 > read(7, "", 2674) = 0 > write(1, "2838 OK Fetch completed.\r\n", 26) = 26 > setsockopt(1, SOL_TCP, TCP_CORK, [0], 4) = 0 > epoll_wait(4, {}, 5, 800) = 0 > epoll_wait(4, {{EPOLLIN, {u32=101056896, u64=2370923004288}}}, 5, 5000) = 1 > read(0, "2839 UID fetch 1817 (UID RFC822."..., 2923) = 51 > setsockopt(1, SOL_TCP, TCP_CORK, [1], 4) = 0 > close(7) = 0 > open("/home/virtual/mydomain.com/home/admin/Maildir/maildirsize", O_RDWR|O_APPEND) = 7 During this time (at least 5-10 minutes) , I could not check the account via my email client Thunderbird. Clicking on an email would just sit there as if it is loading but nothing would happen - the read pane just remains blank. Is Dovecot going through every email (of many 10,000's) and counting up the sizes? Could this be made more efficient so it doesn't lock the account? This could I guess be a Thunderbird issue - it is a disappointingly imperfect client. Dan

4 5

[Dovecot] Start using Dovecot
by Isaak 19 Dec '07

19 Dec '07

Hey,I have recently set up Dovecot on my server but I have trouble with using it. I'm using Dovecot 1.0.rc15, SQL password and user database with the SQL config files provided on the home page. I'm using Thunderbird to connect to Dovecot. When trying to connect it gives me an internal server error: User not found Is there anything else I need to do before I can use Dovecot? Here's my configuration, any help would be appreciated. # /etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot.info.log protocols: imap pop3 imaps pop3s listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 ssl_cert_file: /var/www/ssl/just-click.pem ssl_key_file: /var/www/ssl/just-click.pem login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login max_mail_processes: 100 first_valid_uid: 1000 last_valid_uid: 1500 mail_extra_groups: mail mail_location: mbox:~/mail/:INBOX=/var/mail/%u mail_debug: yes mbox_read_locks: dotlock fcntl mbox_write_locks: dotlock fcntl mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot-sql.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 432 user: dovecot group: mail _________________________________________________________________ Neem je vrienden overal mee dankzij Messenger op je gsm. http://messenger.live.com

3 2

[Dovecot] sieve & vacation question
by Ralf Hildebrandt 19 Dec '07

19 Dec '07

We have a setup where a Postfix gateway does virtual_alias rewriting of the envelope sender: ralf.hildebrandt(a)charite.de get rewritten to hildeb(a)postamt.charite.de The mail is then sent on to postamt.charite.de, the Mailbox server. There we use deliver & doecot. The sieve vacation recipient says it won't answer if: "The envelope recipient is not found in the message To:, Cc: or Bcc: fields." But this is never the case, since the envelope is being rewritten. How can I solve this conundrum? -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) plonk(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de The ashtray in my office proudly displays "Designed for Windows98/NT"

2 1

[Dovecot] Bug track list
by Antonis Faragitakis 17 Dec '07

17 Dec '07

Hello everyone, I'm looking for a bugs track list for postfix. Is there one ?

2 2

[Dovecot] Help please: Migrating Courier imap - Dovecot (Postfix virtual mailbox domains)
by Mark Piekos 17 Dec '07

17 Dec '07

I'm trying to migrate from qmail to postfix. The original server is combo of qmail and Courier imap (no pop mailboxes) I have a working Postfix config and had imap working with Courier imap on the new server. I thought I would experiment with Dovecot as it has some good press. I have moved the contents of my original maildir's to the new server and ste permissions and group membership appropriatley. I can read the 'Inbox' via Dovecot but non of the subfolders that I had configured. I have tried the 'manual' migration method as described in the faq without success (I can see the subfolders but no contents)and have tried running courier-dovecot-migrate.pl witt he same result. I'd be grateful for any advice. Kind regards, Mark. Dovecote version: 1.0.rc15 /etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot-info.log ssl_disable: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: maildir:/home/vmail/%d/%n maildir_copy_with_hardlinks: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 namespace: type: private prefix: INBOX. inbox: yes auth default: verbose: yes passdb: driver: passwd-file args: /etc/dovecot/passwd userdb: driver: static args: uid=vmail gid=vmail home=/home/vmail/%u

4 9

[Dovecot] v1.1.beta11 deliver crashes when quota exceeded
by arvids 15 Dec '07

15 Dec '07

Hello, v1.1.beta11 deliver crashes when quota exceeded. This also reveals another problem in v1.1.beta11 - imap process does not follow quota settings - this user copied(with imap client) to his imap folder large volume of emails and these emails significantly exceeded quota settings for this user, but imap process did not complain about it. Here is full backtrace of deliver crash: (gdb) bt full #0 0xb7e5dc87 in raise () from /lib/libc.so.6 No symbol table info available. #1 0xb7e5f4f8 in abort () from /lib/libc.so.6 No symbol table info available. #2 0x080ba998 in i_syslog_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0x80ce1c8 "file %s: line %d (%s): assertion failed: (%s)", args=0xbf9e0674 "4W\r\b6") at failures.c:303 backtrace = 0x80e7d20 "/usr/local/dovecot/libexec/dovecot/deliver(i_syslog_fatal_handler+0x2c) [0x80ba98c] -> /usr/local/dovecot/libexec/dovecot/deliver [0x80ba78b] -> /usr/local/dovecot/libexec/dovecot/deliver [0x808c914] "... #3 0x080ba78b in i_panic (format=0x80ce1c8 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:196 args = 0xbf9e0674 "4W\r\b6" #4 0x0808c914 in index_transaction_finish_rollback (t=0x810e210) at index-transaction.c:54 __PRETTY_FUNCTION__ = "index_transaction_finish_rollback" #5 0x0808c758 in index_transaction_rollback (_t=0x810e210) at index-transaction.c:114 itrans = (struct mail_index_transaction *) 0x0 #6 0xb7e2fcf4 in quota_mailbox_transaction_rollback (ctx=0x810e210) at quota-storage.c:113 qt = (struct quota_transaction_context *) 0x810e8c0 #7 0x0805990b in deliver_save (namespaces=0x80f2280, storage_r=0xbf9e0828, mailbox=0x80d8a58 "INBOX", mail=0x80f9c38, flags=0, keywords=0x0) at deliver.c:216 box = (struct mailbox *) 0x80fe048 t = (struct mailbox_transaction_context *) 0x0 kw = (struct mail_keywords *) 0x0 error = 134759821 mailbox_name = 0x80e7af0 "INBOX" ret = <value optimized out> #8 0x0805ac0d in main (argc=Cannot access memory at address 0x58ac ) at deliver.c:954 error_string = <value optimized out> error = <value optimized out> ret = <value optimized out> config_path = 0x80cdb08 "/usr/local/dovecot/etc/dovecot.conf" envelope_sender = 0x80e7030 "arvids(a)mpe.lv" mailbox = 0x80d8a58 "INBOX" auth_socket = <value optimized out> home = <value optimized out> destaddr = 0xbf9e1869 "tests1" user = 0xbf9e1869 "tests1" error = <value optimized out> extra_fields = {arr = {buffer = 0x80e7070, element_size = 4}, v = 0x80e7070, v_modifiable = 0x80e7070} ns = (struct mail_namespace *) 0x80f2280 raw_ns = (struct mail_namespace *) 0x80f22a8 storage = (struct mail_storage *) 0x80f2688 box = (struct mailbox *) 0x80f4a98 input = (struct istream *) 0x80f49b8 t = (struct mailbox_transaction_context *) 0x80f8fc8 headers_ctx = (struct mailbox_header_lookup_ctx *) 0x80f88b8 mail = (struct mail *) 0x80f9c38 process_euid = 95 namespace_pool = <value optimized out> stderr_rejection = false keep_environment = false user_auth = true i = 63 ret = <value optimized out> (gdb) Regards, Arvids

1 0

[Dovecot] Just verifying upgrade procedure?
by Bjørn T Johansen 14 Dec '07

14 Dec '07

When upgrading from source, it's ok to just run make install and every files will be overwritten with the new version? Nothing else one should do? Regards, BTJ -- ----------------------------------------------------------------------------------------------- Bjørn T Johansen btj(a)havleik.no ----------------------------------------------------------------------------------------------- Someone wrote: "I understand that if you play a Windows CD backwards you hear strange Satanic messages" To which someone replied: "It's even worse than that; play it forwards and it installs Windows" -----------------------------------------------------------------------------------------------

3 3

[Dovecot] Xen + NFS
by Eric 14 Dec '07

14 Dec '07

Thanks for Dovecot! I am currently testing several scenarios to help determine how to best implement dovecot for our environment. One scenario of particular interest is Maildir + NFS, load balanced between several servers running dovecot. I am not sure anyone would ever want to implement what I am about to describe here, but none-the-less, I thought I would mention it to the list to see if anyone has had the same experience, or could possibly help. What I am using to _test_ is a single server running RedHat Server 5 + Xen. Dom0 is acting as my NFS server, and a RedHat Server 5 guest running on the same machine is acting as my NFS client and dovecot server. I have a single directory exported from the NFS server which contains several home folders with inboxes stored in Maildir format. The problem I am having is when I open a POP3 connection from a separate machine, I see the following messages on the virtual server in /var/log/maillog and I am unable to retrieve mail: file maildir-uidlist.c: line 139 (maildir_uidlist_unlock): assertion failed: (uidlist->lock_count > 0) and more often: Mailbox init failed top=0/0, retr=0/0, del=0/0, size=0 It appears to be an issue with the login not having the proper permissions to create the dovecot.uidlist file, however, when I log in locally to the dovecot server with the POP3 account, I can read+write in the directory without problems. I suspect that I am missing something simple, but cannot seem to figure it out. dovecot-1.0-1.2.rc15.el5 RedHat Server 5 kernel: 2.6.18-8.1.14.el5xen dovecot -n: shutdown_clients: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_greeting: Server ready. mail_location: maildir:~/.maildir:INDEX=/var/spool/dovecot/%u maildir_copy_with_hardlinks: yes mbox_write_locks: dotlock fcntl mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 pop3_reuse_xuidl(default): no pop3_reuse_xuidl(imap): no pop3_reuse_xuidl(pop3): yes pop3_lock_session(default): no pop3_lock_session(imap): no pop3_lock_session(pop3): yes auth default: passdb: driver: ldap args: /etc/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot-ldap.conf nfs mount options: rw,rsize=32768,wsize=32768,hard,fg,lock,nfsvers=3,tcp,retrans=0,noac --------------------------------- Looking for last minute shopping deals? Find them fast with Yahoo! Search.

2 1

[Dovecot] 1.08 + quota-rewrite has no trash plugin
by adam_jh＠hotmail.com 14 Dec '07

14 Dec '07

I think I'm just going to move to 1.1 - however, I'm not keen on installing all the dev tools necessary on a production box. Does anyone have any pointers to web pages or keywords I can check to see what kind of safeguards are needed. The problem I have is building the the srpm to include the quota-rewrite with the trash plugin. I think it has been removed and I wanted to check if anyone knows any good reason not just simply re-enable it (though without the skills I'm not sure I'd do it). -SUBDIRS = acl convert quota imap-quota lazy-expunge mail-log trash $(ZLIB) +SUBDIRS = acl convert quota imap-quota lazy-expunge mail-log $(ZLIB) [root@test ~]# /etc/rc.d/init.d/dovecot start Starting Dovecot Imap: Warning: Corrected permissions for login directory /var/run/dovecot-login FPlugin trash not found from directory /usr/lib/dovecot/imap Error: imap dump-capability process returned 89 Fatal: Invalid configuration in /etc/dovecot.conf [FAILED] A year ago the same question was asked, but I'm not sure of any changes since then. >>> >From tss at iki.fi Sun Oct 15 22:44:38 2006 From: tss at iki.fi (Timo Sirainen) Date: Mon, 16 Oct 2006 00:44:38 +0300 Subject: [Dovecot] Apple Mail quota display In-Reply-To: <C49A984C-F2BF-4A40-84A4-7ED1F7264866(a)mac.com> References: <E94C8EAF-E17E-4E68-B43F-E990A632C4F9(a)mac.com> <1160339709.5137.125.camel@hurina> <C49A984C-F2BF-4A40-84A4-7ED1F7264866(a)mac.com> Message-ID: <1160948678.5448.85.camel@hurina> On Sat, 2006-10-14 at 01:13 -0700, Timothy Martin wrote: > I'm no wiz at applying diffs and compiling my own (i'm a BSD ports > kinda guy) but when i tried that diff i couldn't compile because > there looked to be a couple of lines that should have been removed > and the Trash plugin doesn't appear to be updated to work with the > quota rewrite. Yea, trash plugin won't compile. Just ignore that. Unless you need it.. <<< Thanks Adam

1 0

[Dovecot] dovecot.index only gets updated in Root maildir Folder
by Florian Franzeck 13 Dec '07

13 Dec '07

Debian uses dnotify by default.

3 5

Re: [Dovecot] antispam integration (dovecot antispam plugin): chroot & no way to pass `--user=' to dspam?
by Johannes Berg 13 Dec '07

13 Dec '07

> I want have dspam statistics to be per-user, not global. And I like > idea to learn filter by moving messages from/to SPAM folder, it seems to > be natural and much better, than Web UI (I don't want to use dspam Web > UI at all). > > Is here any way to resolve two problems: > > (1) Run dspam in chrooted environment > (2) pass `--user=${USER}' parameter to dspam. No idea. Passing --user is easy, there's an example in the readme file for the antispam plugin. The former I have no idea about, I guess all it needs is access to the mysql db. > Oh, and even more: I think, that it will be useful to have `socket' > backend for spam-plugin, which allows to send messages to two different > configured sockets (TCP or UNIX domain) -- one for `learn as spam' and > other for `learn as ham'. It allows to run in chrooted environment > easily, and solve problem with exec-dspam-on-every-message. Dunno. Why are you running it chrooted anyway? If you write such a backend I can add it to my tree :) johannes

1 0

[Dovecot] SYN flooding / pipe() failed: Too many open files
by Frank Elsner 13 Dec '07

13 Dec '07

Hello *, I've the following problem with dovecot 1.0.7: /var/log/messages shows | Dec 13 13:48:27 mailbox kernel: possible SYN flooding on port 143. Sending cookies. and /var/log/maillog shows (Please note: nearly the same time): | Dec 13 13:48:28 mailbox dovecot: pipe() failed: Too many open files This leads to an unresponsive mail service and requires a dovecot restart. What can be done to prevent this? BTW, this is my dovecot -n: # 1.0.7: /usr/local/dovecot/etc/dovecot.conf base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /usr/local/dovecot/etc/mailbox.pem ssl_key_file: /usr/local/dovecot/etc/mailbox.key disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable(default): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3-login login_greeting: TU-Berlin.DE POP3-/IMAP Service ready login_log_format_elements: %u %r %c login_processes_count: 24 login_max_processes_count: 512 verbose_proctitle: yes mail_location: maildir:/var/Mail/Boxes/%1u/%u mailbox_idle_check_interval: 15 maildir_copy_with_hardlinks: yes maildir_copy_preserve_filename: yes mail_executable(default): /usr/local/dovecot/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot/lib/dovecot/pop3 mail_log_prefix: %Ls(%u): imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login anonymous count: 32 passdb: driver: ldap args: /usr/local/dovecot/etc/dovecot-ldap.conf userdb: driver: static args: uid=777 gid=12 plugin: quota: maildir:ignore=Trash Kind regards ______________________________________________________________ Frank Elsner / c/o Technische Universitaet Berlin | ____________/ tubIT [BD], Sekr. E-N 50 | | Einsteinufer 17 | | Phone: +49 30 314 23897 D-10587 Berlin | | eMail: Frank.Elsner(a)TU-Berlin.DE Germany __________________| |_________________________________________________________| in dubio pro exim

3 2

[Dovecot] How to copy Spammail for learning out of Postfix and Dovecot (vmail)
by Sven Schmidt 13 Dec '07

13 Dec '07

Hi! I am using Postfix 2.3.8 and Dovecot 1.0.rc15. Virtual Domains and Mailboxes are configured. I tried to copy spammy Mail with Procmail, but Procmail only sees local mails. How to configure it to get a copy of spammy mails in a mbox or mail-dir?

3 4

[Dovecot] Dovecot Antispam Problem (Using mail sending backend)
by Justin Refice 13 Dec '07

13 Dec '07

I'm trying to setup DSPAM training using the mail-sending backend of the Antispam filter, unfortunately, things don't appear to be working. I've compiled it against the debian etch dovecot libraries, and the plugin itself builds, and doesn't report any errors when running. As a matter of fact, it doesn't report ANYTHING when running, except for the initialization code (DEBUG=syslog): imap: antispam: plugin initialising imap: antispam: "trash" is trash folder imap: antispam: "Trash" is trash folder imap: antispam: "Deleted Items" is trash folder imap: antispam: "spam" is spam folder imap: antispam: "Spam" is spam folder imap: antispam: "SPAM" is spam folder imap: antispam: "junk" is spam folder imap: antispam: "Junk" is spam folder imap: antispam: "Junk Mail" is spam folder imap: antispam: no unsure folders imap: antispam: mail backend spam address dspam-add(a)xxx.yyy imap: antispam: mail backend not-spam address dspam-fp(a)xxx.yyy imap: antispam: mail backend sendmail /usr/sbin/sendmail imap: antispam: mail backend tmpdir /tmp .... And that's it. I never hear from the plugin again, regardless of how many times I create/delete the SPAM folder, or how many times I move/copy into/out of the folder. The plugin is basically silent. I don't see the mails being sent/recieved, so I'm assuming that's it isn't doing anything at all. I can manually use the training addresses, so I know they're working. Any help would be appreciated. -Justin R.

5 9

[Dovecot] got too little data ??
by Benoit Branciard 12 Dec '07

12 Dec '07

I just switched in a hurry one of our mailbox servers from UW-imapd to Dovecot in an attempt to address performance and stability problems. This server hosts ~5500 accounts, ~2000 are daily used, ~600 simultaneous IMAP connexions in rush hours, and lots of POP ones. Some accounts may be accessed simultaneously with IMAP and POP. The system is : - Debian Sarge (x86 with amd64 kernel) - MBOX files mailboxes - indexes migrated out of filesystem quotas - Sendmail MTA - Procmail local delivery agent (not easily replaceable due to extensive use of procmailrc filters) - Both Procmail and Dovecot use [dotlock, fcntl] as mailbox locking scheme - No other processes have access to mailboxes in normal use - Dovecot 1.0.8 hand-compiled from tarball The good new is that it seems to perform better than UW-imapd. The bad new is that we get lots or errors like this in log: IMAP(username): FETCH for mailbox INBOX UID 23862 got too little data: 3186 vs 3206 Such "accidents" happen about 4-5 times a day, and does not correct themselves, even with a mailbox expunge or reopen. However manual deletion of the faulty mailbox index seems to clear the problem, until another one occurs. On such errors some mail clients (Thunderbird) retry operation in infinite loop, so log gets really cluttered. In imap-fetch-body.c it is stated : "We shouldn't really ever get here. One reason is if mail was deleted from NFS server while we were reading it. Another is some temporary disk error." Both reasons do not seem to apply in our case: mail partition is not NFS-mounted, and disks (a RAID5 array) seem healthy. Furthermore, affected accounts are not over quota. So may we have found a bug ? Or may we have a locking problem ? Or an index handling one ? I tried to disable mbox_lazy_writes without success. I will try to disable disk indexes totally, which should help since problems seem index-related; but performance may suffer. Any clues appreciated... Dovecot -n says : # 1.0.8: /usr/local/etc/dovecot.conf protocols: imap imaps pop3 pop3s listen: [::] ssl_cert_file: /usr/local/etc/ssl/private/our-certificate.pem ssl_key_file: /usr/local/etc/ssl/private/our-certificate.pem disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login first_valid_uid: 200 first_valid_gid: 200 mail_location: mbox:~/mail:INBOX=~/mail/INBOX:INDEX=/espace/dovecot/indexes/%u fsync_disable: yes mbox_lazy_writes: no mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle tb-extra-mailbox-sep delay-newmail imap_client_workarounds(imap): outlook-idle tb-extra-mailbox-sep delay-newmail imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xv%08Xu pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: passdb: driver: pam args: * userdb: driver: passwd plugin: quota: fs -- Ce message a ete verifie par MailScanner pour des virus ou des polluriels et rien de suspect n'a ete trouve.

4 6

[Dovecot] Dovecot 1.08 seems very slow
by Marc Perkel 12 Dec '07

12 Dec '07

I know I'm late reporting this but 1.08 seems really slow. It seems like it is as slow as some of the early RCs were. Wish I had more info. Using Maildir format.

2 1

[Dovecot] 1.0.8 with quota 1.0.8 patch - undefined symbol: quota_set
by adam_jh＠hotmail.com 12 Dec '07

12 Dec '07

I get the following error after patching the 1.0.8 src.rpm with the quota-rewrite-1.0.8.diff [root@test dovecot]# /etc/rc.d/init.d/dovecot start Starting Dovecot Imap: Edlopen(/usr/lib/dovecot/imap/lib02_imap_quota_plugin.so) failed: /usr/lib/dovecot/imap/lib02_imap_quota_plugin.so: undefined symbol: quota_set FCouldn't load required plugins Error: imap dump-capability process returned 89 Fatal: Invalid configuration in /etc/dovecot.conf [FAILED] I have checked the new quota config changes. The src rpm is taken from http://atrpms.net/dist/el4/dovecot/. Using the same process without the patch, the rpm that's built and installed works (or at least starts). A process of elimination revealed it doesn't understand the imap_quota aspect of the quota imap_quota configuration line. Removing that it works, but I kind of need it! Can anyone help? Thanks, adam To patch it I did: Patch103: dovecot-1.0.beta2-mkcert-permissions.patch Patch105: dovecot-1.0.rc7-mkcert-paths.patch # quota patch Patch106: quota-rewrite-1.0.8.diff and %patch103 -p1 -b .mkcert-permissions %patch105 -p1 -b .mkcert-paths %patch106 -p1 -b .quota Since I'm using centos to match RHEL 4 [rpmbuild@test SPECS]$ cat /etc/redhat-release Red Hat Enterprise Linux WS release 4 (Nahant) I also added to my .rpmmacros for the rpmbuild user I have %bcond_with() %{expand:%%{?_with_%{1}:%%global with_%{1} 1}} %bcond_without() %{expand:%%{!?_without_%{1}:%%global without_%{1} 1}} %with() %{expand:%%{?with_%{1}:1}%%{!?with_%{1}:0}} %without() %{expand:%%{?without_%{1}:0}%%{!?without_%{1}:1}} then rpm -e dovecot su rpmbuild ... rpmbuild -ba postfix.spec rpm -Uvh ...dovecot.rpm [root@test dovecot]# /usr/sbin/postfix -n # 1.0.8: /etc/dovecot.conf login_dir: /var/run/dovecot-login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_processes_count: 1 first_valid_uid: 505 last_valid_uid: 505 mail_extra_groups: mail mail_location: maildir:/var/vmail/%d/%n maildir_copy_with_hardlinks: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): outlook-idle pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: user: nobody passdb: driver: sql args: /etc/dovecot-mysql.conf userdb: driver: sql args: /etc/dovecot-mysql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: mail master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: mail plugin: quota: maildir

2 3

[Dovecot] Fishing attempt locking up dovecot
by Jerry Yeager 12 Dec '07

12 Dec '07

On Dec 11, 2007, at 5:58 PM, dovecot-request(a)dovecot.org wrote: > > > Message: 10 > Date: Tue, 11 Dec 2007 15:58:16 -0700 > From: Patrick Milvich <patrick(a)milvich.com> > Subject: [Dovecot] Fishing attempt locking up dovecot > To: dovecot(a)dovecot.org > Message-ID: <8C5CE5FE-BD2F-40C4-8A36-A4CD8BD533DB(a)milvich.com> > Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes > > I've mentioned this before but only heard from one other person who > has experienced this, but it's becoming a pretty serious issue. > > The situation: > A spammer sets a bot on a fishing attempt to gain email addresses, > causing numerous login processes to spawn and suck up all available > resources. > > The problem: > Obviously this can act like a dos attack, but the real issue is after > the spammer stops (by virtue of being added to our firewall blacklist, > being caught and shut down by their isp, or otherwise), dovecot > doesn't seem to relinquish the resources, causing "too many files > open" errors for normal usage. > > stuff cut out > > End of dovecot Digest, Vol 56, Issue 33 > *************************************** Will the following be of any help to you? (it is a patch for Postfix 2.4.nn) It would seem that the type of fishing expedition you mention would fall into the bit described below (lots of errors). While it will not directly solve the "out of resources" Dovecot problem, it may limit the up-front damage, followed with a CRON script running every twenty minutes or so that scans the last line of the mail log for the 'too many files open' error and upon finding it runs a version of the killall imap-login processes. ftp://postfix.mirrors.pair.com/index.html Postfix 2.4 patch (PGP signature ) to add stress-adaptive behavior to the SMTP server. When some mail flood keeps all server ports busy, this feature can be used to quickly drop connections from clients that make errors, and to reduce the time that Postfix waits for a client command. This may delay some legitimate deliveries, but it will allow you to still keep some mail flowing. After the mail flood ends, Postfix reverts to its normal behavior.

1 0

[Dovecot] dovecot deliver errors
by Andrew Garner 12 Dec '07

12 Dec '07

I think someone else mentioned this problem earlier on the list, and I've recently started seeing the following error show up: file index-transaction.c: line 54 (index_transaction_finish_rollback): assertion failed: (t->mail_ref_count == 0) Raw backtrace: /usr/lib/dovecot/deliver(i_syslog_fatal_handler+0x2b) [0x80bff0b] -> /usr/lib/dovecot/deliver [0x80bfd1a] -> /usr/lib/dovecot/deliver [0x808f783] -> /usr/lib/dovecot/deliver(index_transaction_rollback+0x1a) [0x808f5aa] -> /usr/lib/dovecot/modules/lda//lib10_quota_plugin.so [0xb7e6d013] -> /usr/lib/dovecot/deliver(deliver_save+0x202) [0x8059812] -> /usr/lib/dovecot/modules/lda//lib90_cmusieve_plugin.so [0xb7e4bb1d] -> /usr/lib/dovecot/modules/lda//lib90_cmusieve_plugin.so [0xb7e5bdbc] -> /usr/lib/dovecot/modules/lda//lib90_cmusieve_plugin.so(sieve_execute_bytecode+0x1c4) [0xb7e5c7d4] -> /usr/lib/dovecot/modules/lda//lib90_cmusieve_plugin.so(cmu_sieve_run+0x30c) [0xb7e4c7bc] -> /usr/lib/dovecot/modules/lda//lib90_cmusieve_plugin.so [0xb7e4a81f] -> /usr/lib/dovecot/deliver(main+0x10c0) [0x805a990] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xc8) [0xb7e86ea8] -> /usr/lib/dovecot/deliver [0x80588e1] With beta11 I started running into this problem (using postfix's smtp-source messages): postfix/pipe[19560]: 85372294: to=<example(a)example.com>, relay=dovecot, delay=20385, delays=20384/0.01/0/0.19, dsn=5.3.0, status=bounced (Command died with signal 11: "/usr/ lib/dovecot/deliver") Program received signal SIGSEGV, Segmentation fault. 0x080d017a in str_sanitize_append (dest=0x80ee2f8, src=0x0, max_len=80) at str-sanitize.c:11 11 str-sanitize.c: No such file or directory. in str-sanitize.c (gdb) #0 0x080d017a in str_sanitize_append (dest=0x80ee2f8, src=0x0, max_len=80) at str-sanitize.c:11 p = <value optimized out> #1 0x080d02ce in str_sanitize (src=0x0, max_len=80) at str-sanitize.c:35 str = (string_t *) 0x80ee2f8 #2 0x080594f4 in deliver_log (mail=0x8107a48, fmt=0x80d349b "saved mail to %s") at deliver.c:120 args = 0xbfb087d8 "\200<DA>\016\b" str = (string_t *) 0x80ee120 #3 0x0805979f in deliver_save (namespaces=0x80f7a90, storage_r=0xbfb088e8, mailbox=0x80ded98 "INBOX", mail=0x8107a48, flags=0, keywords=0x0) at deliver.c:222 box = (struct mailbox *) 0x810be58 t = (struct mailbox_transaction_context *) 0x0 kw = (struct mail_keywords *) 0x0 error = MAIL_ERROR_NONE mailbox_name = 0x80eda80 "INBOX" ret = 0 #4 0x0805ac15 in main (argc=5, argv=Cannot access memory at address 0x4 ) at deliver.c:954 error_string = <value optimized out> error = <value optimized out> ret = <value optimized out> config_path = 0x80d34ba "/etc/dovecot/dovecot.conf" envelope_sender = 0x80ed030 "example(a)foo.net" mailbox = 0x80ded98 "INBOX" auth_socket = <value optimized out> home = <value optimized out> destaddr = 0xbfb09f9c "example(a)example.com" user = 0xbfb09f9c "example(a)example.com" error = <value optimized out> extra_fields = {arr = {buffer = 0x80ed080, element_size = 4}, v = 0x80ed080, v_modifiable = 0x80ed080} ns = (struct mail_namespace *) 0x80f7a90 raw_ns = (struct mail_namespace *) 0x80f7ab8 storage = (struct mail_storage *) 0x80f7e98 box = (struct mailbox *) 0x8102768 input = (struct istream *) 0x80f8670 t = (struct mailbox_transaction_context *) 0x8106be8 headers_ctx = (struct mailbox_header_lookup_ctx *) 0x8106508 mail = (struct mail *) 0x8107a48 process_euid = 89 namespace_pool = <value optimized out> stderr_rejection = false keep_environment = false user_auth = true i = 63 ret = <value optimized out> # dovecot -n # 1.1.beta11: /etc/dovecot/dovecot.conf base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login verbose_proctitle: yes mail_uid: 89 mail_gid: 89 mail_location: maildir:~/Maildir mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): fts fts_squat mail_plugins(imap): fts fts_squat mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap/ mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap/ mail_plugin_dir(pop3): /usr/lib/dovecot/modules/ imap_client_workarounds(default): delay-newmail imap_client_workarounds(imap): delay-newmail imap_client_workarounds(pop3): pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: login plain cram-md5 digest-md5 username_format: %Lu verbose: yes debug: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth user: postfix group: postfix master: path: /var/run/dovecot/auth-master user: vmail group: vmail plugin: quota: maildir quota_rule: *:storage=102400:messages=30000 fts: squat

2 1

[Dovecot] dovecot.index only gets updated in Root maildir Folder
by Florian Franzeck 11 Dec '07

11 Dec '07

version 1.0.rc15 (Newest Version available in Debian 4.0, newer version in testing tree requires new version libc...) I got a procmail rule that moves mail from some senders to another folder, e.g. .archive.facebook/ . This works fine, the message appear in .archive.facebook/new if i "ls" that directory by shell. But dovecot.index files don't get updated, hence IDLE doesn't tell the client new mail arrived. this only happens if i click on the folder in thunderbird. like this, not even clicking on Thunderbird "Check mail" button shows me new Mail arrived. Is this a common error in this version? would there any benefit if i self compiled a newer version regarding this issue? Thanx Config: log_timestamp: %Y-%m-%d %H:%M:%S ssl_listen: * login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_extra_groups: mail mail_location: maildir:~/Maildir auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master:

1 0

[Dovecot] v1.0.9 released
by Timo Sirainen 11 Dec '07

11 Dec '07

http://dovecot.org/releases/1.0/dovecot-1.0.9.tar.gz http://dovecot.org/releases/1.0/dovecot-1.0.9.tar.gz.sig + Maildir: Don't wait on dovecot-uidlist.lock when we just want to find out a new filename for the message. - mbox: v1.0.8 changes sometimes caused FETCH to fail with "got too little data", disconnecting the client. - Fixed a memory leak when FETCHing message header/body multiple times within a command (e.g. BODY[1] BODY[2]) - IMAP: Partial body fetching was still slow with mboxes

1 0

[Dovecot] Using global und per-user sieve scripts at the same time
by Matthias Kellermann 11 Dec '07

11 Dec '07

Hi list, I'm trying to get a global sieve mailfilter with per-user sieve scripts to work. At the "lda"-section in the dovecot.conf file I have: global_script_path = /usr/local/etc/sieve/spam /usr/local/etc/sieve/spam: require "fileinto"; if header :contains ["Subject"] ["***Spam***"] { fileinto "Spam"; stop; } which will work fine delivering Spam Mails in a Spam dir for every user. If a user creates his own .dovecot.sieve file the global script will not work anymore. How can I enable global and local per-user sieve scripts at once? Is this possible? Do you know any workaround so all users will have the same (Spam-)sieve filters beside there own (global templates or so)? Matthias

5 11

[Dovecot] squat also not working in beta11
by Joe Wong 10 Dec '07

10 Dec '07

Hi Timo, Just tried squat in beta11. I also get the same error in the log: dovecot: Dec 10 14:21:17 Error: IMAP(joewong99:joew.outblaze.com): Corrupted squat uidlist file /mailfs/4/22/3/joewon g99:joew.outblaze.com@joew_outblaze_com/Maildir/dovecot.index.search.uids: Broken uidlists There is not change in my configuration file. # 1.1.beta11: /usr/local/etc/dovecot.conf log_path: /var/log/dovecot-1.1.log info_log_path: /var/log/dovecot-1.1.log protocols: imap ssl_disable: yes login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_user: nobody verbose_proctitle: yes mail_location: maildir:~/Maildir mail_debug: yes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_drop_priv_before_exec: yes mail_plugins: fts fts_squat auth default: user: mdrop username_chars: abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@: username_translation: @: verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf plugin: fts: squat --

2 5

Re: [Dovecot] New Mailbox Format Plugin Help
by Sacha Bernstein 10 Dec '07

10 Dec '07

On 12/8/07, Timo Sirainen <tss(a)iki.fi> wrote: > On Sat, 2007-12-08 at 10:11 -0500, Sacha Bernstein wrote: > > I would like to develop a new mailbox format for a very specialized > > application. Can anyone point me in the appropriate direction to get > > started writing a plugin? > > > > More detail for anyone interested: > > I need to store mail in a format that's quickly accessible and > > modifiable to an external process. This is for a very low-volume mail > > system (averaging less than 50 messages stored at any one time) that > > needs very good indexing. I need to create new mailboxes on the fly > > and perform fast searches across all the mailboxes. I intend to store > > all the messages in an SQL database. Any help getting started > > interfacing with dovecot (other than reading through _all_ the source > > code) would be greatly appreciated. > > v1.1 makes this a lot easier, so start with it instead of v1.0. You can > probably get started with my existing SQL backend code: > http://dovecot.org/list/dovecot/2007-November/026632.html > > The main idea is to implement APIs in lib-storage/mail-storage-private.h > and lib-storage/mailbox-list-private.h. Most of these calls can be > implemented by calling generic index_*() functions in > lib-storage/index/. Thanks, I'll get started with this. I'm sure I'll have more questions once I get further into it. If anyone's interested (especially any amateur radio operators that may be on this list), you can see what my plans are for the SQL storage backend for dovecot at w2sjb.org. Basically, the short version is a linux gateway to a radio-based email system for use in emergencies. Of course it has many other uses, but that's what I'm going to be using it for :-) Thanks, Sacha

1 0

Re: [Dovecot] Automatic Index Generation
by Maciej Poszywak 10 Dec '07

10 Dec '07

>> Timo Sirainen wrote: >> >>> I guess you mean logging in with POP3? There the slowdown comes from >>> getting all messages' virtual sizes. So your preindexer could probably >>> do this by running pop3 for all users. If you use only a single UID for >>> users, you could do something like: >>> >>> for user in `cat users`; do >>> export MAIL=maildir:/home/$user/Maildir >>> echo "quit" | /usr/local/libexec/dovecot/pop3 >>> done >>> >>> >>> >> vmu1@test:~$ env | grep MAIL >> MAIL=maildir:/var/mail/testuser >> vmu1@test:~$ echo "quit" | /usr/lib/dovecot/pop3 >> pop3(vmu1): Fatal: pop3_uidl_format setting is missing from config file >> >> I have pop3_uidl_format correctly defined in the config file. I've also >> tried to strace pop3, to find where it does look for it, but with no >> success. >> > > It gets it from environment: > > POP3_UIDL_FORMAT=... pop3 > > In general all settings are passed in environment using uppercased > names. > > Are you sure that all variables can be read from environment ? vmu1@mail:~$ env | grep -E "(MMAP|LOCK)" MMAP_DISABLED=yes MAIL_READ_MMAPED=no LOCK_METHOD=dotlock POP3_LOCK_SESSION=yes vmu1@mail:~$ echo "quit" | /usr/lib/dovecot/pop3 pop3(vmu1): Fatal: lock_method=dotlock and mmap_disable=no combination isn't supported. You don't _really_ want it anyway. vmu1@mail:~$ /usr/sbin/dovecot --version 1.0.rc15 -- Maciej Poszywak

2 1

[Dovecot] v1.1.beta11 released (Problems)
by Jerry Yeager 10 Dec '07

10 Dec '07

On Dec 9, 2007, at 1:48 PM, dovecot-request(a)dovecot.org wrote: > > > Message: 7 > Date: Sun, 09 Dec 2007 20:29:49 +0200 > From: Timo Sirainen <tss(a)iki.fi> > Subject: [Dovecot] v1.1.beta11 released > To: dovecot(a)dovecot.org > Message-ID: <1197224989.922.405.camel@hurina> > Content-Type: text/plain; charset="us-ascii" > > http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta11.tar.gz > http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta11.tar.gz.sig > > This one should be the last beta release before the first v1.1 release > candidate. > > I'll try to stay away from this list and Dovecot in general for the > next > 1,5 weeks. I've several exams coming up and I should have started > studying for them days ago already.. :) > stuff cut out > End of dovecot Digest, Vol 56, Issue 26 > *************************************** I ran into a problem moving from v 1.1 beta 10 to v 1.1 beta 11, the logs show: Dec 9 16:03:49 ns1 dovecot[331]: Dovecot v1.1.beta11 starting up Dec 9 16:03:50 ns1 dovecot[331]: imap-login: We couldn't drop root group privileges (wanted=150, gid=150, egid=0) Dec 9 16:03:50 ns1 dovecot[331]: Temporary failure in creating login processes, slowing down for now The last two messages then begin repeating until Dovecot is shut down. obviously, no one can log in. I tried changing the following # System user and group used to access mails. If you use multiple, userdb # can override these by returning uid or gid fields. You can use either numbers # or names. <doc/wiki/UserIds> #mail_uid = #mail_gid = to explicitly specifying # System user and group used to access mails. If you use multiple, userdb # can override these by returning uid or gid fields. You can use either numbers # or names. <doc/wiki/UserIds> mail_uid = Dovecot mail_gid = Dovecot As well as setting the setuid bit in login_executable = /usr/local/libexec/dovecot/imap-login to no avail. Dropping back to v 1.1 beta 10 fixed things for the moment. I did a quick scan of the example conf file and the wiki docs but could not find anything relevant. dovecot -n shows (essentially the same for both versions) # 1.1.beta11: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ protocols: imaps ssl_listen: *:993 ssl_cipher_list: ALL:!LOW:!SSLv2 verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_user: Dovecot login_greeting: Hello, Dovecot is ready. valid_chroot_dirs: /var/mail/vmail/ mail_extra_groups: mail mail_location: maildir:/var/spool/vmail/%d/%n:INDEX=/var/spool/vmail/ %d/%n:INBOX=/var/spool/vmail/%d/%n mail_debug: yes lock_method: flock auth default: mechanisms: plain login passdb: driver: passwd-file args: scheme=plain-md5 username_format=%u /etc/dovecot/passwd userdb: driver: static args: uid=virtual gid=virtual home=/var/spool/vmail/%d/%n socket: type: listen client: path: /var/spool/postfix/private/auth user: postfix group: postfix master: path: /usr/local/var/run/dovecot/auth-master user: virtual group: virtual This is running on OS X 10.5.1 ??? Jerry

2 2

[Dovecot] Dovceot 1.0.8 compile error after rewrite patch
by Lars Johansen 10 Dec '07

10 Dec '07

Added the rewrite patch for 1.0.8 without any problems, but when I tried building with: configure --prefix=/usr/local/dovecot, make gives this output: gcc -shared .libs/mail-log-plugin.o -Wl,-soname -Wl,lib20_mail_log_plugin.so -o .libs/lib20_mail_log_plugin.so ar cru .libs/lib20_mail_log_plugin.a mail-log-plugin.o ranlib .libs/lib20_mail_log_plugin.a creating lib20_mail_log_plugin.la (cd .libs && rm -f lib20_mail_log_plugin.la && ln -s ../lib20_mail_log_plugin.la lib20_mail_log_plugin.la) make[4]: Leaving directory `/usr/local/src/dovecot-1.0.8/src/plugins/mail-log' Making all in trash make[4]: Entering directory `/usr/local/src/dovecot-1.0.8/src/plugins/trash' if /bin/sh ../../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/plugins/quota -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT trash-plugin.lo -MD -MP -MF ".deps/trash-plugin.Tpo" -c -o trash-plugin.lo trash-plugin.c; \ then mv -f ".deps/trash-plugin.Tpo" ".deps/trash-plugin.Plo"; else rm -f ".deps/trash-plugin.Tpo"; exit 1; fi mkdir .libs gcc -DHAVE_CONFIG_H -I. -I. -I../../.. -I../../../src/lib -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/plugins/quota -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT trash-plugin.lo -MD -MP -MF .deps/trash-plugin.Tpo -c trash-plugin.c -fPIC -DPIC -o .libs/trash-plugin.o trash-plugin.c:110: warning: 'struct quota_root_transaction_context' declared inside parameter list trash-plugin.c:110: warning: its scope is only this definition or declaration, which is probably not what you want trash-plugin.c: In function 'trash_try_clean_mails': trash-plugin.c:134: error: dereferencing pointer to incomplete type trash-plugin.c:205: error: dereferencing pointer to incomplete type trash-plugin.c:205: error: dereferencing pointer to incomplete type trash-plugin.c:206: error: dereferencing pointer to incomplete type trash-plugin.c:207: error: dereferencing pointer to incomplete type trash-plugin.c:207: error: dereferencing pointer to incomplete type trash-plugin.c:208: error: dereferencing pointer to incomplete type trash-plugin.c: At top level: trash-plugin.c:214: warning: 'struct quota_root_transaction_context' declared inside parameter list trash-plugin.c: In function 'trash_quota_root_try_alloc': trash-plugin.c:216: error: dereferencing pointer to incomplete type trash-plugin.c:220: error: 'struct quota_backend_vfuncs' has no member named 'try_alloc' trash-plugin.c:238: warning: passing argument 1 of 'trash_try_clean_mails' from incompatible pointer type trash-plugin.c: At top level: trash-plugin.c:248: warning: 'struct quota_root_transaction_context' declared inside parameter list trash-plugin.c: In function 'trash_quota_root_try_alloc_bytes': trash-plugin.c:250: error: dereferencing pointer to incomplete type trash-plugin.c:254: error: 'struct quota_backend_vfuncs' has no member named 'try_alloc_bytes' trash-plugin.c:262: warning: passing argument 1 of 'trash_try_clean_mails' from incompatible pointer type trash-plugin.c: At top level: trash-plugin.c:272: warning: 'struct quota_root_transaction_context' declared inside parameter list trash-plugin.c: In function 'trash_quota_root_test_alloc_bytes': trash-plugin.c:274: error: dereferencing pointer to incomplete type trash-plugin.c:278: error: 'struct quota_backend_vfuncs' has no member named 'test_alloc_bytes' trash-plugin.c:286: warning: passing argument 1 of 'trash_try_clean_mails' from incompatible pointer type trash-plugin.c: In function 'trash_quota_root_created': trash-plugin.c:313: error: 'struct quota_root' has no member named 'v' trash-plugin.c:314: error: 'struct quota_root' has no member named 'v' trash-plugin.c:315: error: 'struct quota_root' has no member named 'v' trash-plugin.c:316: error: 'struct quota_root' has no member named 'v' trash-plugin.c:317: error: 'struct quota_root' has no member named 'v' make[4]: *** [trash-plugin.lo] Error 1 make[4]: Leaving directory `/usr/local/src/dovecot-1.0.8/src/plugins/trash' make[3]: *** [all-recursive] Error 1 make[3]: Leaving directory `/usr/local/src/dovecot-1.0.8/src/plugins' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/usr/local/src/dovecot-1.0.8/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/local/src/dovecot-1.0.8' make: *** [all] Error 2

2 1

[Dovecot] Automatic Index Generation
by Maciej Poszywak 10 Dec '07

10 Dec '07

Hello, I'm looking for an application/script/etc. which will allow me to recreate dovecot indexes by hand from shell. I'm preparing myself for migration to dovecot 1.0.rc15 (debian stable) and would like to create indexes before users start to login into new server to ease the load. My other option is to write a script which will log as each user and create indexes, however this seems a bit of painful way to do it. Anybody can point me in right direction? -- Maciej Poszywak

5 10

[Dovecot] dict: Leaked a t_pop() call in I/O handler
by Sergio Lopez 10 Dec '07

10 Dec '07

Hello, I've just installed another postfix+dovecot based mail service (I love dovecot! :-), and I found this message "dict: Leaked a t_pop() call in I/O handler (nil)" being logged each time I authenticate against it via POP3 or IMAP. Searching through the code, I've found this (this is Dovecot v1.0.8): ---- src/dict/dict-cache.c ---- void dict_cache_unref(struct dict_cache *cache, const char *uri, const char *username) { struct dict_entry *entry; t_push(); entry = hash_lookup(cache->dicts, t_strdup_printf("%s\t%s", username, uri)); i_assert(entry != NULL && entry->refcount > 0); if (--entry->refcount == 0) { hash_remove(cache->dicts, entry->user_uri); dict_deinit(&entry->dict); i_free(entry->user_uri); i_free(entry); } } ---- src/dict/dict-cache.c ---- Notice the "t_push()" call there. So calling t_pop() somewhere before the end of the function, makes dovecot work like a charm (again). P.D: I'm really surprised that nobody noticed this before. Am I the only man in the world who uses Dovecot storing quota information into a SQL Database? ;-) -- Sergio López - <sergio.lopez(a)nologin.es> Nologin Consulting S.L. - http://nologin.es

2 1

[Dovecot] Internal Error - Cannot select inbox
by Eric Beda 10 Dec '07

10 Dec '07

Hi, I am new to this list although i have been using dovecot for some time now, i've come accross this error when a user tries to log in * OK Dovecot ready. 1 login username password 1 OK Logged in. 1 select inbox 1 NO Internal error occurred. Refer to server log for more information. [2007-12-07 12:51:56] there are no errors reported in the log files related to that issue for both dovecot.log and maillog what i do receive in the log files is dovecot: Dec 07 12:55:46 Info: imap-login: Login: user=<username@domain>, method=PLAIN, rip=::ffff:127.0.0.1, lip=::ffff:127.0.0.1, secured dovecot: Dec 07 12:55:46 Info: IMAP(username@domain): Effective uid=500, gid=500 dovecot: Dec 07 12:55:46 Info: IMAP(aadu(a)uccmail.co.tz): mbox: data=/var/spool/mail/vmail/domain/username:INBOX=/var/spool/mail/vmail/domain/username/Inbox:INDEX=/var/spool/mail/vmail/domain/username:home=/var/spool/mail/vmail/domain/username/.imap/.imap dovecot: Dec 07 12:55:46 Info: IMAP(aadu(a)uccmail.co.tz): mbox: root=/var/spool/mail/vmail/domain/username, index=/var/spool/mail/vmail/domain/username, inbox=/var/spool/mail/vmail/domain/username/Inbox dovecot: Dec 07 12:55:46 Info: IMAP(username@domain): Disconnected i can't seem to pinpoint what is going wrong, some things to note i have existing users who can read email succesfully, its when i create a new user via postfixadmin, one should note that all directories are created and owned by vmail whose gid and uid is 500 and for the new users the directories and mboxes are created succesfully, but even if i copy over a working inbox of previous user to new user i still get an error so i don't think it is an mbox formatting issue another thing is that i can successfully check mail using mutt facility, even sending using mail clients (outlook express) is possible other configurations that might be helpful # dovecot --version 1.0.rc15 #cat /etc/group |grep vmail dovecot:x:97:vmail vmail:x:500:dovecot # /etc/dovecot.conf log_path: /var/log/dovecot.log protocols: pop3 pop3s imap imaps ssl_disable: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: mbox:/var/spool/mail/vmail/%d/%n:INBOX=/var/spool/mail/vmail/%d/%n/Inbox:INDEX=/var/spool/mail/vmail/%d/%n:home=/var/spool/mail/vmail/%d/%n/.imap/.imap mail_debug: yes maildir_copy_with_hardlinks: yes mbox_min_index_size: 200 mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: mechanisms: plain login passdb: driver: pam passdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf userdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master:

3 5

[Dovecot] Roadmap to future
by Timo Sirainen 10 Dec '07

10 Dec '07

v1.1.0 is finally getting closer, so it's time to start planning what happens after it. Below is a list of some of the larger features I'm planning on implementing. I'm not yet sure in which order, so I think it's time to ask again what features companies would be willing to pay for? Sponsoring Dovecot development gets you: - listed in Credits in www.dovecot.org - listed in AUTHORS file - you can tell me how you want to use the feature and I'll make sure that it's possible (within reasonable limits) - allows you to change the order in which features are implemented (more or less) As you can see below, some features are easier to implement when other features are implemented first. Several of them depend on v2.0 master rewrite, so I'm thinking that maybe it's time to finally finish that first. I know several companies have requested replication support, but since it kind of depends on several other features, it might be better to leave that for v2.1. But of course sponsoring development of those features that replication depends on gets you the replication support faster. :) I'm still trying to go to school (and this year I started taking CS classes as well as biotech classes..), so it might take a while for some features to get implemented. I'm anyway hoping for a v1.2 or v2.0 release before next summer. So, the list.. -------------- Implemented, but slightly buggy so not included in v1.1 (yet): - Mailbox list indexes - THREAD REFERENCES indexes - THREAD X-REFERENCES2 algorithm where threads are sorted by their latest message instead of the thread root message Could be implemented for v1.2: - Shared mailboxes and ACLs http://www.dovecot.org/list/dovecot/2007-April/021624.html - Virtual mailboxes: http://www.dovecot.org/list/dovecot/2007-May/022828.html - Depends on mailbox list indexes dbox plans, could be implemented for v1.2: - Support for single instance attachment storage - Global dbox storage so copying messages from mailbox to another involves only small metadata updates - Support some kind of hashed directories for storing message files, instead of storing everything in a single directory. - Finish support for storing multiple messages in a file v2.0 master/config rewrite -------------------------- It's mostly working already. One of the larger problems left is how to handle plugin settings. Currently Dovecot just passes everything in plugin {} section to mail processes without doing any checks. I think plugin settings should be checked just as well as the main settings. Also plugins should be able to create new sections instead of having to use plain key=value settings for everything. v2.0 currently runs a perl script on Dovecot's source tree to find settiongs from different places then then creates a single all-settings.c for config process. This obviously doesn't work for out-of-tree plugins, so there needs to be some other way for them to pass the allowed settings. There are two possibilities: a) Read them from separate files. This is a bit annoying, because it's not anymore possible to distribute simple plugin.c files and have them compiled into plugin.so files. b) Read them from the plugin itself. This would work by loading the plugin and then reading the variable containing the configuration. I'm a bit worried about security implications though, because the plugins could execute some code while they're loaded. But I guess a new unprivileged process could be created for doing this. Of course normally admins won't run any user-requested plugins anyway so this might not be a real issue anyway. :) Index file optimizations ------------------------ - Since these are not backwards compatible changes, the major version number should be increased whenever these get implemented. So I think these should be combined with v2.0 master/config rewrite. I'd rather not release v3.0 soon after v2.0 just for these.. - dovecot.index.log: Make it take less space! Get rid of the current "extension introduction" records that are large and written over and over again. Compress UID ranges using similar methods than Squat uses now. Try all kinds of other methods to reduce space usage. Write transaction boundaries, so the reader can process entire transactions at a time. This will make some things easier, such as avoiding NFS data cache flushes, replication support and also allows lockless writes using O_APPEND. - dovecot.index: Instead of keeping a single message record array, split it into two: A compressed list of message UIDs and array containing the rest of the data. This makes the file smaller and keeping UIDs separate allows better CPU cache (and maybe disk I/O) utilization for UID -> sequence lookups. At least this is the theory, I should benchmark this before committing to this design. :) There could also be a separate expunged UIDs list. UIDs existing in there would be removed from existing UIDs list, but it wouldn't affect calculating offsets to record data in the file. So while currently updating dovecot.index file after expunges requires recreating the whole file, with this method it would be possible to just write 4 bytes to the expunged UIDs list. The space reserved for expunged UIDs list would be pretty small though, so when it gets full the file would be recreated. - dovecot.index.cache: Better disk I/O and CPU cache utilization by keeping data close together in the file when it's commonly accessed toghether. For example message sizes and dates for all messages could be close to each others to optimize SORTing by message size/date. If clients use conflicting access patterns, the data could be either duplicated to optimize both patterns or just let it be slower for the other pattern. Deliver / LMTP server --------------------- Currently deliver parses dovecot.conf using its own parser. This has caused all kinds of problems. v2.0's master rewrite helps with this, because deliver can then just ask the configuration from config process the same way as other processes are. Another problem is that people who use multiple user IDs have had to make deliver setuid-root. I really hate this, but currently there's no better way. Better fix for this would be to use LMTP server instead. There could be either a separate LMTP client or deliver could support LMTP protocol as well. I'm not sure which one is better. How would LMTP server then get around the multiple user IDs issue? There are two possibilities: a) Run as root and temporarily set effective UID to the user whose mails we are currently delivering. This has the problem that if users have direct access to their mailboxes and index files, the mailbox handling code has to be bulletproof to avoid regular users gaining root privileges by doing special modifications to index files -- possibly at the same time as the mail is being delivered to exploit some race condition with mmaped index files.. b) Create a child process for each different UID and drop its privileges completely. If all users have different UIDs, this usually means forking a new process for each mail delivery, making the performance much worse than with a) method. It would anyway be possible to delay destroying the child processes in case a new message comes in for the same UID. This would probably mostly help only when UIDs are shared by multiple users, such as each domain having their own UID. I think I'll implement both and let admin choose which method to use. This same problem exists for several other things besides deliver/LMTP server. For example a) method is already implemented for expire plugin's expire-tool in v1.1. So this code needs to be somewhat generic so it won't have to be duplicated in multiple places. All of this pretty much requires the new v2.0 master rewrite. Adding these to v1.x would be ugly. Proxying -------- - These could be implemented to v1.2. - Log in normally (no proxying) if destination IP is the server itself. - Support for per-namespace proxying: namespace public { prefix = Public/ location = proxy:public.example.org } There are two choices for this: Dummy IMAP proxying or handling it with a mail storage backend. Dummy IMAP proxying would just let the remote server whose mailbox is currently selected handle most of the commands and their replies. I'm just afraid that this will become problematic in future. For example if the proxying server wants to send the client an event, such as "new message was added to this other mailbox", it would have to be sure that the remote server isn't currently in the middle of sending something. And the only way to be sure would be to parse its input, which in turn would make the proxying more complex. Then there would be problems if the servers support different IMAP extensions. And maybe some extensions will require knowing the state of multiple mailboxes, which will make handling them even more complex if the mailboxes are on different servers. Implementing this as a mail storage backend would mean that the proxying server parses all the IMAP commands internally and uses Dovecot's mail storage API to process them. The backend would then request data from the remote server when needed and cache it internally to avoid asking the same data over and over again. Besides caching, this would mean that there are no problems with extensions, since Dovecot handles the the exact same way as for other backends, requiring no additional code. To get better performance the storage backend would have to be smarter than most other Dovecot backends. For example while the current backends handle searches by reading through all the messages, the proxy backend should just send the search request to the remote server. The same for SORT. And for THREAD, which the current storage API doesn't handle.. And how would proxying server and remote server then communicate? Again two possibilities: Either a standard IMAP protocol, with possibly some optional Dovecot-extensions to improve performance, or a bandwidth-efficient protocol. The main advantage with IMAP protocol is that it could be used for proxying to other servers. Bandwidth-efficient protocol could be based on dovecot.index.log format, making it faster/easier to parse and generate. Once we're that far with proxying, we're close to having..: Replication ----------- The plans haven't changed much from: http://www.dovecot.org/list/dovecot/2007-May/022792.html The roadmap to complete replication support would be basically: 1. Implement proxying with mail storage API. 2. Implement asynchronous replication: - Replication master process collecting changes from other Dovecot processes via UNIX sockets. It would forward these changes to slaves. Note that this requires that only Dovecot is modifying mailboxes, mails must be delivered with Dovecot's deliver! - If some slaves are down, save the changes to files in case they come back up. In case they don't and we reach some specific max. log file size, keep also track of mailboxes that have changed and once the slaves do come back, make sure those mailboxes are synced. - If replication master is down and there have been changes to mailboxes.. Well, I haven't really thought about this. Maybe refuse to do any changes to mailboxes? Maybe have mail processes write to some "mailboxes changed" log file directly? Probably not that big of a deal since replication master just shouldn't be down. :) - Support for manual resync of all mailboxes, in case something was done outside Dovecot. - Replication slave processes would be reading incoming changes. I think this process should just make sure that the changes are read as fast as possible, so with sudden bursts of activity the slave would start saving the changes to a log instead of the master. - Replication mailbox writer processes would receive changes from the main slave process via UNIX sockets. They'd be responsible for actually saving the data to mailboxes. If multiple user IDs are used, this has the same problems as LMTP server. - Conflict resolution. If mailbox writer process notices that the UID already exists in the mailbox, both the old and the new message must be given new UIDs. This involves telling the replication master about the problem, so both servers can figure out together the new UIDs. I haven't thought this through yet. - Conflict resolution for message flags/keywords. The protocol would normally send flag changes incrementally, such as "add flag1, remove flag2". Besides that there could be a 8bit checksom of all the resulting flags/keywords. If the checksum doesn't match, request all the current flags. It would be of course possible to send the current flags always instead of incremental updates, but this would waste space when there are lots of keywords, and multi-master replication will work better when the updates are incremental. 3. Synchronous replication: - When saving messages, don't report success until at least one replication slave has acknowledged that it has also saved the message. Requires adding bidirectional communication with the replication master process. The message could sent to slaves in smaller parts, so if the message is large the wait at the end would basically consist of sending "finished saving UID 1234, please ack". - Synchronous expunges also? Maybe optional. The main reason for this is that it wouldn't be nice to break IMAP state by having expunged messages come back. 4. Multi-master replication: - Almost everything is already in place. The main problem here is IMAP UID allocation. They must be allocated incrementally, so each mailbox must have a globally increasing UID counter. The usage goes like: 1. Send the entire message body using a global unique ID to all servers. No need to wait for their acknowledgement. 2. Increase the global IMAP UID counter for this mailbox. 3. Send global UID => IMAP UID message to all servers. 4. Wait for one of them to reply with "OK". Because messages sent by different servers can end up being visible in different times, the servers must wait that they've seen all the previous UIDs before notifying client of a new UID. If the sending server crashed between steps 2 and 3, this never happens. So the replication processes must be able to handle that, and also handle requesting missing UIDs in case they had lost connections to other servers. - I just had the idea of global UID counters instead of global locks, so I haven't yet thought how the counters would be best implemented. It should be easier to implement than global locks though. - Non-incremental changes are somewhat problematic and could actually require global locks. The base IMAP protocol supports replacing flags, so if there is no locking and conflicting flag replacement commands are sent to two servers, which one of those commands should be effective? Timestamps would probably be enough for flag changes, but it may not be enough for some IMAP extensions (like CONDSTORE?). - If global locks are required, they would work by passing the lock from one server to another when requested. So as long as only a single server is modifying the mailbox, it would hold the global lock and there would be no need to keep requesting it for each operation. 5. Automation: - Automatically move/replicate users between servers when needed. This will probably be implemented separately long after 4. The replication processes would be ugly to implement for v1.x master, so this pretty much depends on v2.0 master rewrite.

4 6

[Dovecot] disconnect after too many errors?
by Peter Hessler 09 Dec '07

09 Dec '07

There are a couple of jerks that are tying to dictionary attack my email server, and one of the vectors is pop3/imap logins. Something I would like to do in dovecot, but can't seem to find, is the ability to disconnect after a certain number of errors. The vast majority of my users (i.e. me) don't hand-type POP3 or IMAP transactions, but when we do, we know how to spell things properly. Does dovecot have this? A simiple look shows no. -- I wouldn't mind dying -- it's that business of having to stay dead that scares the shit out of me. -- R. Geis

4 6

[Dovecot] MANAGESIEVE patch v7 for dovecot 1.0.3 and TLS
by Andreas Schneider 09 Dec '07

09 Dec '07

Hi, I allow only TLS/SSL connection to dovecot. The managesieve doesn't work with TLS but it works without it. gladiac@magrathea:~> gnutls-cli -p 2000 -s --insecure -V milliways.cynapses.org Resolving 'milliways.cynapses.org'... Connecting to '213.239.217.124:2000'... - Simple Client Mode: - Received[194]: "IMPLEMENTATION" "dovecot" "SASL" "PLAIN" "SIEVE" "fileinto reject envelope vacation imapflags notify subaddress relational comparator-i;ascii-numeric regex" "STARTTLS" OK "Dovecot ready." STARTTLS - Sent: 9 bytes - Received[33]: OK "Begin TLS negotiation now." Let me know if you need more information. Thanks, -- andreas -- http://www.cynapses.org/ - cybernetic synapses

3 4

[Dovecot] Compiling with SQL support
by Mark Smith 09 Dec '07

09 Dec '07

Hello all, I am currently having a slight problem (ok well more likely me just not doing it right), with compiling Dovecot with MySQL support. The version is 1.0.8. I have tried running configure with --with-sql and --with-sql-drivers, but this however still does not compile MySQL support, I do no wish to install MySQL on this server, as I am using a network SQL server, but I do have the compiled source available on this server. I have tried running: gcc -shared -fPIC -DHAVE_CONFIG_H -DBUILD_MYSQL \ -I../.. -I../lib -I../lib-settings -I/data/mysql/include/mysql \ driver-mysql.c -o driver_mysql.so -lmysqlclient inside the /src/lib-sql, but this just returns an error that mysqlclient cannot be found. I have tried running dovecot --build-options, but MySQL is not listed here, the operating system is FreeBSD 6.2. The documentation does not seem to be giving any hints as to why this is not working, nor do How Tos. Anyrhing remotely helpful would be appreciated. Mark Smith

2 1

[Dovecot] Is dovecot the right choice for this problem?
by Darren McLaughlin 09 Dec '07

09 Dec '07

Is dovecot the right choice for this problem? I have a shared server with verio. I have one particular client that sends and receives numerous large emails, and those emails were causing me to run out of processes on my verio server, and basically slow things down a great deal due to the shared mail queue. Verio suggested Dovecot to reduce server load and allow this one client to have less problems with sending and receiving email. Does this sound logical to anyone in the know? Thanks! Darren

3 6

[Dovecot] Are these events normal?
by Jost Krieger 08 Dec '07

08 Dec '07

We have dropped dovecot in place of UW-IMAP for about 40000 users and have solved our immediate problem: disk I/O overload, mainly from people doing POP3 and "leave mail on server". Thank you! Now i got loads of dovecot error messages in the logs and don't know if there is any significance. Here are a few examples: The most common event is: 2007-12-06 16:00:17.837654500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1547 got too little data: 5176 vs 5184 2007-12-06 16:00:18.575403500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1548 got too little data: 4749 vs 4757 2007-12-06 16:00:19.276147500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1548 got too little data: 4749 vs 4757 2007-12-06 16:00:20.371238500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1540 got too little data: 5162 vs 5170 2007-12-06 16:00:20.996483500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1540 got too little data: 5162 vs 5170 2007-12-06 16:00:21.650218500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1541 got too little data: 4086 vs 4094 2007-12-06 16:00:22.273782500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1541 got too little data: 4086 vs 4094 2007-12-06 16:00:22.920507500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1542 got too little data: 3556 vs 3562 2007-12-06 16:00:23.490787500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1542 got too little data: 3556 vs 3562 2007-12-06 16:00:24.052849500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1543 got too little data: 4098 vs 4106 2007-12-06 16:00:24.741072500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1543 got too little data: 4098 vs 4106 2007-12-06 16:00:25.448977500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1544 got too little data: 4627 vs 4635 2007-12-06 16:00:26.130131500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1544 got too little data: 4627 vs 4635 2007-12-06 16:00:26.819376500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1545 got too little data: 7582 vs 7590 2007-12-06 16:00:27.445497500 dovecot: Error: IMAP(xxxxxxxx): FETCH for mailbox UCE-TMP UID 1545 got too little data: 7582 vs 7590 Somewhat rarer are events like 2007-12-06 19:36:44.114294500 dovecot: Info: POP3(yyyyyyyy): Disconnected: Storage error during logout. top=1/1723, retr=1/4665462, del=27/61, size=17280696 and rarely we got 2007-11-24 12:10:01.086620500 dovecot: Error: IMAP(zzzzzzzz): file istream-header-filter.c: line 194 (read_header): assertion failed: (hdr == NULL) 2007-11-24 12:10:01.086718500 dovecot: Error: IMAP(zzzzzzzz): Raw backtrace: 2007-11-24 12:10:01.089552500 dovecot: Error: child 13083 (imap) killed with signal 6 2007-11-24 12:10:01.655875500 dovecot: Error: IMAP(zzzzzzzz): file istream-header-filter.c: line 194 (read_header): assertion failed: (hdr == NULL) 2007-11-24 12:10:01.656106500 dovecot: Error: IMAP(zzzzzzzz): Raw backtrace: 2007-11-24 12:10:01.659853500 dovecot: Error: child 13098 (imap) killed with signal 6 2007-11-24 12:10:02.022553500 dovecot: Error: IMAP(zzzzzzzz): file istream-header-filter.c: line 194 (read_header): assertion failed: (hdr == NULL) 2007-11-24 12:10:02.022761500 dovecot: Error: IMAP(zzzzzzzz): Raw backtrace: 2007-11-24 12:10:02.025866500 dovecot: Error: child 13121 (imap) killed with signal 6 Our dovecot is # 1.0.5: /usr/local/dovecot/etc/dovecot.conf log_path: /dev/stderr log_timestamp: protocols: pop3 imap listen(default): 134.147.64.16:143 listen(imap): 134.147.64.16:143 listen(pop3): 134.147.64.16:110 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3-login login_process_per_connection: no valid_chroot_dirs: /net/sunu007/disc3/home:/net/sunu007/disc4/home max_mail_processes: 4096 first_valid_uid: 50 mail_location: mbox:~/Mail:INBOX=~/Mailbox:INDEX=~/ mail_executable(default): /usr/local/dovecot/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot/lib/dovecot/pop3 mail_log_max_lines_per_sec: 0 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: passdb: driver: shadow args: blocking=yes userdb: driver: passwd Is there anything we should do? The crashes have stopped in the meantime, it seems. Jost -- | Helft Spam ausrotten! HTML in Mail ist unhöflich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gefällig, gefällige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 |

3 3

[Dovecot] New Mailbox Format Plugin Help
by Sacha Bernstein 08 Dec '07

08 Dec '07

I would like to develop a new mailbox format for a very specialized application. Can anyone point me in the appropriate direction to get started writing a plugin? More detail for anyone interested: I need to store mail in a format that's quickly accessible and modifiable to an external process. This is for a very low-volume mail system (averaging less than 50 messages stored at any one time) that needs very good indexing. I need to create new mailboxes on the fly and perform fast searches across all the mailboxes. I intend to store all the messages in an SQL database. Any help getting started interfacing with dovecot (other than reading through _all_ the source code) would be greatly appreciated. Thanks, Sacha

2 1

[Dovecot] Questions about deliver log files
by frank.kintrup＠fkware.de 08 Dec '07

08 Dec '07

Hi, I upgraded from Courier to dovecot, and now I try to rebuild some of the features I used to have. One was a monthly per user log of maildrop's work. I used this code in maildroprc: DATE=`date +%m` logfile "$MAILDIR/maildrop-$DATE.log" This created a monthly log in the each user's Maildir. I find it easier to have a log per user than having to filter the log entries from a large log file for all users. I tried to recreate it with deliver by using the variables %h and %d/%n, but they are not interpreted when the log file is accessed ("Can't open log file /var/vmail/%d/%n/deliver.log: No such file or directory"). And there seems to be no way to include a date in the file name (but maybe I could use logrotate for that). Another problem: Currently deliver only logs the message id. A user would never ask for this (especially if he asks where certain mails were stored/discarded), he would ask for the sender's name/email or subject. Is the contents of the log file configurable? Frank

2 2

[Dovecot] Stale NFS file handle and duplicated messages
by Adrian Barker 08 Dec '07

08 Dec '07

We recently moved all our users from the Washington IMAP server to Dovecot. There has been a substantial improvement in performance, but some users are reporting duplicate messages, and we see 'Stale NFS file handle' errors in the syslog. Does anyone know what would cause this ? The errors relate to the index file, eg. Nov 29 00:49:47 imap-e.ucl.ac.uk dovecot: [ID 107833 mail.error] IMAP(ccaazzz): close() failed with index file /home/ccaazzz/imap-mail/.imap/mbox/dovecot.index: Stale NFS file handle Our IMAP servers (5 of them) are a mixture of Sparc Solaris 8 and Solaris 10 machines, using NFS to a central mailspool running on AIX. We are using a mixture of Dovecot 1.0.3 and 1.0.5. dovecot -n gives: # 1.0.3: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ listen: *:143 ssl_listen: *:993 ssl_ca_file: /usr/local/ssl/certs/sureserveredu.pem ssl_cert_file: /usr/local/ssl/certs/imap-server_ucl_ac_uk.crt ssl_key_file: /usr/local/ssl/certs/imap.key ssl_cipher_list: MEDIUM:!LOW disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable: /usr/local/libexec/dovecot/imap-login login_user: pp login_process_per_connection: no login_processes_count: 30 max_mail_processes: 1500 first_valid_uid: 200 mail_location: mbox:%h/imap-mail:INBOX=/nfs/rcs/mail-spool/mail/%u mmap_disable: yes mbox_lock_timeout: 55 mbox_dotlock_change_timeout: 50 mail_drop_priv_before_exec: yes mail_executable: /usr/local/sbin/dovecot-login.csh mail_plugins: mbox_snarf mail_plugin_dir: /usr/local/lib/dovecot namespace: type: private separator: / inbox: yes auth default: passdb: driver: pam passdb: driver: passwd userdb: driver: passwd plugin: mbox_snarf: ~/imap-mail/mbox -- Adrian Barker, Internet Technology Section Information Systems University College London, Gower Street, London WC1E 6BT External phone: +44 20 7679 5140, Fax (+44) 20 7388 5406 Internal phone: x 25140 Email: A.Barker(a)ucl.ac.uk

2 3

[Dovecot] Sponsorship of Dovecot
by Ed W 08 Dec '07

08 Dec '07

Timo Sirainen wrote: > v1.1.0 is finally getting closer, so it's time to start planning what > happens after it. Below is a list of some of the larger features I'm > planning on implementing. I'm not yet sure in which order, so I think > it's time to ask again what features companies would be willing to pay > for? > OK, I would like to sponsor Dovecot for three months for $1,000/month I am just a small business and this is basically coming straight out of my own paycheck, but we use the product internally and I like it and would like to see it continue to develop at the rate it has done. Although this is just a small token of my appreciation, I hope that other businesses who are using dovecot will step up and at least match this contribution. It's less than the price of a small Exchange Server setup and has oh so much more potential I have some minimal requests for what I would like to be developed during that period, but largely the pledge is without strings and you can develop as you wish. I will add a note on the Roadmap thread with my thoughts Thanks for writing Dovecot. Please contact me offlist and let me know how you want the sponsorship delivered (Paypal is fine but sometimes expensive for the receiver). I hope others will step up and increase this substantially Regards Ed W http://www.mailasail.com

1 0

Re: [Dovecot] imap crash with fts squat enabled.
by Joe Wong 08 Dec '07

08 Dec '07

Hi Timo, Dovecot was running on FC7 while the file server is running on FC4. - Joe May the force be with you..

1 0

[Dovecot] "pipe" plugin - is anyone interested (or using it)?
by Nicolas Boullis 08 Dec '07

08 Dec '07

Hi, A few months ago, I sent a message to this list asking if people would be interested by a "pipe" plugin (see http://dovecot.org/pipermail/dovecot/2007-May/023005.html ). I received a few answers of people who told they were intersted. A few months later, I sent a new message announcing the availability of my work (see http://dovecot.org/pipermail/dovecot/2007-August/024805.html ). Since then, I have received no feedback... So, is anyone using this plugin? Is anyone using it? Timo, on my first message, you seemed to be interested to merge such a feature (see http://dovecot.org/pipermail/dovecot/2007-May/023055.html ). Are you still interested? All comments are welcome. I think the feature (or a more generic one) would be a worthy addition for dovecot, be it for ham/spam learning, to implement an "outbox" or anything else I can't think about. All comments about my work are welcome. (Please note that I have not (yet) tried to port it to dovecot 1.1...) Cheers, Nicolas Boullis Ecole Centrale Paris

7 13

[Dovecot] Corrupted Transaction Log File: v1.0.7
by Daniel Watts 07 Dec '07

07 Dec '07

Following errors have happened quite a bit: Dec 7 14:19:26 locallog@tg3/tg3 dovecot: IMAP(peter.day(a)mydomain.com): Transaction log file /home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log: marked corrupted Dec 7 14:19:26 locallog@tg3/tg3 dovecot: IMAP(peter.day(a)mydomain.com): Transaction log file /home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log.2: marked corrupted Dec 7 14:19:26 locallog@tg3/tg3 dovecot: IMAP(peter.day(a)mydomain.com): Corrupted transaction log file /home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log: Append with UID 50, but next_uid = 15870 Causing Peter Day not to be able to delete emails. Seems mostly to happen in the Trash I think. Shouldn't Dovecot be able to recover from this? And then have some rule that if it cannot recover, delete the index file and rebuild? When I manually remove the file it works fine. Thanks, Daniel

3 4

[Dovecot] open files
by Steve Heaven 07 Dec '07

07 Dec '07

This morning dovecot stopped allowing pop3 logins. In the logs I found the messages below Is there a config value for the max open files ? Dec 7 10:00:22 frigga dovecot: execv(/usr/local/libexec/dovecot/pop3) failed: Too many open files Dec 7 10:01:14 frigga dovecot: pipe() failed: Too many open files Dec 7 10:03:40 frigga dovecot: pipe() failed: Too many open files Dec 7 10:03:40 frigga dovecot: pipe() failed: Too many open files Dec 7 10:03:40 frigga dovecot: pipe() failed: Too many open files Dec 7 10:03:40 frigga dovecot: pipe() failed: Too many open files Dec 7 10:03:43 frigga dovecot: pipe() failed: Too many open files Dec 7 10:03:45 frigga dovecot: pipe() failed: Too many open files Dec 7 10:04:39 frigga dovecot: pipe() failed: Too many open files Dec 7 10:04:41 frigga dovecot: pipe() failed: Too many open files Dec 7 10:04:50 frigga dovecot: pipe() failed: Too many open files Dec 7 10:05:00 frigga dovecot: pipe() failed: Too many open files Dec 7 10:05:02 frigga dovecot: pipe() failed: Too many open files Dec 7 10:06:05 frigga dovecot: pipe() failed: Too many open files Dec 7 10:06:05 frigga dovecot: pipe() failed: Too many open files Dec 7 10:06:05 frigga dovecot: pipe() failed: Too many open files Dec 7 10:06:06 frigga dovecot: pipe() failed: Too many open files Dec 7 10:07:48 frigga dovecot: pipe() failed: Too many open files Dec 7 10:08:05 frigga dovecot: pipe() failed: Too many open files

3 5

[Dovecot] imap crash with fts squat enabled.
by Joe Wong 07 Dec '07

07 Dec '07

Hi Timo, Here is the backtrace for your reference. I have already applied dovecot-97702c9c4111 changes to my 1.1 beta10 code base. I am running dovecot on FC7, gcc 4.1.2, mailbox is on NFS. Whenever I did UID SEARCH body "xxxx" imap crashes. Program terminated with signal 6, Aborted. #0 0x00110402 in __kernel_vsyscall () (gdb) bt full #0 0x00110402 in __kernel_vsyscall () No symbol table info available. #1 0x00790fa0 in raise () from /lib/libc.so.6 No symbol table info available. #2 0x007928b1 in abort () from /lib/libc.so.6 No symbol table info available. #3 0x080ca029 in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0x80ebb5c "Leaked a t_pop() call in timeout handler %p", args=0xbf8538b4 "\005\b\226\225~") at failures.c:424 backtrace = 0xa0e1168 "imap [0x80ca020] -> imap [0x80c9f2c] -> imap(io_loop_handle_timeouts+0x1b7) [0x80d0bc7] -> imap(io_loop_handler_run+0x69) [0x80d1309] -> imap(io_loop_run+0x28) [0x80d09f8] -> imap(main+0x4ac) [0x8066c"... #4 0x080c9f2c in i_panic (format=0x80ebb5c "Leaked a t_pop() call in timeout handler %p") at failures.c:197 args = 0xbf8538b4 "\005\b\226\225~" #5 0x080d0bc7 in io_loop_handle_timeouts (ioloop=0xa0e99b0, update_run_now=true) at ioloop.c:268 diff = <value optimized out> called_timeouts = (struct timeout *) 0x0 tv = {tv_sec = 8579595, tv_usec = 323093} t_id = 2 #6 0x080d1309 in io_loop_handler_run (ioloop=0xa0e99b0) at ioloop-poll.c:159 ctx = (struct ioloop_handler_context *) 0xa0e99f0 pollfd = <value optimized out> tv = {tv_sec = 0, tv_usec = 0} io = <value optimized out> t_id = <value optimized out> msecs = <value optimized out> ret = 0 call = <value optimized out> #7 0x080d09f8 in io_loop_run (ioloop=0xa0e99b0) at ioloop.c:305 No locals. #8 0x08066c2c in main (argc=Cannot access memory at address 0x5dd2 ) at main.c:293 -- And dovecot.conf: # 1.1.beta10: /usr/local/etc/dovecot.conf log_path: /var/log/dovecot-1.1.log info_log_path: /var/log/dovecot-1.1.log protocols: imap ssl_disable: yes login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_user: nobody verbose_proctitle: yes mail_location: maildir:~/Maildir mail_debug: yes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_drop_priv_before_exec: yes mail_plugins: fts fts_squat mail_log_max_lines_per_sec: 100 auth default: user: mdrop username_chars: abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@: username_translation: @: verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf plugin: fts: squat

2 4

[Dovecot] Mails "get lost" - RHEL 5.1 - dovecot-1.0-1.2.rc15.el5
by Götz Reinicke 07 Dec '07

07 Dec '07

Hi, we do have a Voiceboxserver which forward recorded avi messages to the mailserver account of users. I'v tested it for my account 10 minutes ago and everything works. Some users don't get the messages shown up in there mailclient while the logs show a delivery of that mail. May be some mail caches are messed up? We use Thunderbird 2 and the users concerned use imap. Where may I look or what may I check? Thanks for your help! Regards Götz -- Götz Reinicke IT Koordinator Tel. +49 7141 969 420 Fax +49 7141 969 55 420 E-Mail goetz.reinicke(a)filmakademie.de Filmakademie Baden-Württemberg GmbH Mathildenstr. 20 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Dr. Christoph Palmer, MdL, Minister a.D. Geschäftsführer: Prof. Thomas Schadt

2 2

[Dovecot] Sieve MySQL integration
by Steven Murphy 07 Dec '07

07 Dec '07

I have dovecot running with sieve performing vacation autoreply. Can sieve do sql lookups for vacation messages instead of having to do flat files in the users home directory? Thank you in advance. Steve

4 3

[Dovecot] exim/kmail vs. dovecot
by Kristian Koehntopp 07 Dec '07

07 Dec '07

I am using exim via dovecot_deliver to store messages in Maildir in my $HOME. I am using kmail to retrieve stuff. Unfortunately, something in my data crashes dovecot. I was using 1.0.rc14 from opensuse, but downloaded and installed 1.0.8 from the site. Here is the crash: Dec 5 18:05:09 h743107 dovecot: IMAP(kris): file mail-index-transaction.c: line 629 (mail_index_update_flags_range): assertion failed: (seq1 <= seq2 && seq1 > 0) Dec 5 18:05:09 h743107 dovecot: child 13896 (imap) killed with signal 6 Dec 5 18:05:09 h743107 dovecot: IMAP(kris): Raw backtrace: imap [0x8006cf7d] -> imap [0x8006ce58] -> imap(mail_index_update_flags_range+0x194) [0x8004d034] -> imap(mail_index_sync_begin+0x5c9) [0x8004fb79] -> imap(maildir_sync_index_begin+0x61) [0x80021c71] -> imap [0x8002350a] -> imap(maildir_storage_sync_init+0x56) [0x80023646] -> imap(mailbox_sync_init+0x16) [0x8005d566] -> imap(imap_sync_nonselected+0x28) [0x8001b838] -> imap(_cmd_select_full+0xd7) [0x80012c47] -> imap(cmd_select+0x25) [0x80012e25] -> imap [0x800143ea] -> imap[0x8001446c] -> imap(_client_input+0x7d) [0x80014bcd] ->imap(io_loop_handler_run+0x127) [0x80073987]-> imap(io_loop_run+0x28) [0x80072ac8] -> imap(main+0x518) [0x8001d898] -> /lib/libc.so.6(__libc_start_main+0xdc) [0xb7e8d02c] -> imap[0x8000f0c1] I took the liberty to syslog() the seq numbers before the assert and indeed h743107:/etc/dovecot # grep "imap: seq1" /var/log/messages | head -3 Dec 5 18:30:18 h743107 imap: seq1 1 seq2 1 Dec 5 18:30:18 h743107 imap: seq1 1 seq2 1 Dec 5 18:30:18 h743107 imap: seq1 1 seq2 1 h743107:/etc/dovecot # grep "imap: seq1" /var/log/messages | awk '($9 < $7) { print }' Dec 5 18:30:42 h743107 imap: seq1 28 seq2 16 Dec 5 18:32:43 h743107 imap: seq1 28 seq2 16 What exactly is broken here and how can I fix that? Kris -- Kristian =?iso-8859-15?q?K=F6hntopp?= <kris(a)xn--khntopp-90a.de>

3 3

[Dovecot] Compiling with SQL support
by Mark Smith 07 Dec '07

07 Dec '07

Hello all, I am currently having a slight problem (ok well more likely me just not doing it right), with compiling Dovecot with MySQL support. The version is 1.0.8. I have tried running configure with --with-sql and --with-sql-drivers, but this however still does not compile MySQL support, I do no wish to install MySQL on this server, as I am using a network SQL server, but I do have the compiled source available on this server. I have tried running: gcc -shared -fPIC -DHAVE_CONFIG_H -DBUILD_MYSQL \ -I../.. -I../lib -I../lib-settings -I/data/mysql/include/mysql \ driver-mysql.c -o driver_mysql.so -lmysqlclient inside the /src/lib-sql, but this just returns an error that mysqlclient cannot be found. I have tried running dovecot --build-options, but MySQL is not listed here, the operating system is FreeBSD 6.2. The documentation does not seem to be giving any hints as to why this is not working, nor do How Tos. Any help would be appreciated. Mark Smith

1 0

Re: [Dovecot] Automatic Index Generation
by Maciej Poszywak 06 Dec '07

06 Dec '07

Gabriel Millerd wrote: > On Dec 6, 2007 6:35 AM, Maciej Poszywak <jet(a)surreal.pl> wrote: > >> I'm looking for an application/script/etc. which will allow me to recreate dovecot indexes by hand from shell. I'm preparing myself for migration to dovecot 1.0.rc15 (debian stable) and would like to create indexes before users start to login into new server to ease the load. My other option is to write a script which will log as each user and create indexes, however this seems a bit of painful way to do it. Anybody can point me in right direction? >> >> > > I have a perl script that will rip through all the users using imap > and touch every folder (or every subscribed folder). if you dont have > the authentication for a proper login you can always setup a temporary > method that returns "username, 'static password', and homedir" before > going live. > > Dunno if this was what you were asking. > > That's what I'm looking for. It would be nice if you sent me that script. -- Maciej Poszywak

1 1

[Dovecot] Worse now: Cores
by Kristian Koehntopp 06 Dec '07

06 Dec '07

Worse now: I get stuff such as http://paste.debian.net/44248 in my log. What is dovecot trying to do and why? Kris -- Kristian =?iso-8859-15?q?K=F6hntopp?= <kris(a)xn--khntopp-90a.de>

4 7

[Dovecot] Dovecot + SASL + allow_nets
by Marc Cuypers 05 Dec '07

05 Dec '07

Hi, When using dovecot for authentication of an SASL (postfix) request, i cannot use the allow_nets parameter. The IP-address of the requester is not known in dovecot. I would like to allow sasl for certain users, others are not allowed to access via SASL. Some users can have access to imap and pop3 from certain IP-addresses. How could i combine this in then dovecot configuration? -- Best regards, Marc

3 9

[Dovecot] Please configure dovecot
by bhagwat swarup 05 Dec '07

05 Dec '07

hi I am new to linux and dovecot .It is my request that please write the steps to configure 1] dovecot as POP server giving access to a user and controll accesss from to different domains eg block example.com allow nh.com Thanks And Regards Bhagwat Swarup NH India Ltd

2 1

[Dovecot] Imap and quota problem
by Najib Abi Fadel 05 Dec '07

05 Dec '07

Hi everyone, i am using dovecot 1.0 as IMAP and i am facing the following problem: when a user is overquota he is unable to access his account and thus he can't delete emails ! Is there any workaround for this problem ? thanks for any help. ____________________________________________________________________________________ Never miss a thing. Make Yahoo your home page. http://www.yahoo.com/r/hs

3 4

[Dovecot] SIGSEGV login process
by Maxim 05 Dec '07

05 Dec '07

Hi all. I recently upgraded from 1.0.0 to 1.0.7 version and found that process imap-login begins randomly crash: pid 29997 (imap-login), uid 143: exited on signal 11 (core dumped) pid 32189 (imap-login), uid 143: exited on signal 11 (core dumped) pid 32121 (imap-login), uid 143: exited on signal 11 (core dumped) pid 31309 (imap-login), uid 143: exited on signal 11 (core dumped) i guess that it happens during high load on CPU (but just guess) no anything upon upgrade changed - traffic, config are the same. can anyone help me? running FreeBSD 6.2, compiled from port with mysql, lda, kqueue, pop3 support. mail# dovecot -n # 1.0.7: /usr/local/etc/dovecot.conf protocols: imap pop3 pop3s imaps listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(pop3): *:995 ssl_cert_file: /usr/local/etc/ssl_mail/dovecot.pem ssl_key_file: /usr/local/etc/ssl_mail/dovecot.pem ssl_cipher_list: ALL:!LOW disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login verbose_proctitle: yes first_valid_uid: 26 last_valid_uid: 26 mail_extra_groups: mail mail_location: maildir:~/Maildir mmap_disable: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain cram-md5 digest-md5 apop login default_realm: proc.ru passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf mail# grep -v '^ *$#.*$\?$' /usr/local/etc/dovecot-sql.conf driver = mysql connect = host=/tmp/mysql.sock dbname=exim_users user=exim password=** default_pass_scheme = PLAIN password_query = SELECT concat(pw_name, '@', domain) as user, pw_clear_passwd as password FROM vusers WHERE pw_name = '%n' AND domain = '%d' user_query = SELECT pw_dir AS home, 26 AS uid, 26 AS gid, concat('maildir:storage=', quota*1024) AS quota FROM vusers WHERE pw_name = '%n' AND domain = '%d' backtrace from core file: mail# gdb ./work/dovecot-1.0.7/src/imap-login/imap-login /var/run/dovecot/login/tmp/imap-login.core GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-marcel-freebsd"...(no debugging symbols found)... warning: exec file is newer than core file. Core was generated by `imap-login'. Program terminated with signal 11, Segmentation fault. Reading symbols from /usr/lib/libssl.so.4...(no debugging symbols found)...done. Loaded symbols for /usr/lib/libssl.so.4 Reading symbols from /lib/libcrypto.so.4...(no debugging symbols found)...done. Loaded symbols for /lib/libcrypto.so.4 Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /libexec/ld-elf.so.1...(no debugging symbols found)...done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x08051e2d in auth_client_request_continue () (gdb) bt #0 0x08051e2d in auth_client_request_continue () #1 0x0804b8db in client_auth_input () #2 0x080562ec in io_loop_handler_run () #3 0x0805599d in io_loop_run () #4 0x0804d963 in main () (gdb) or what anything info should i provide?

3 13

Re: [Dovecot] Variable krb5 cache location
by Timo Sirainen 04 Dec '07

04 Dec '07

On Sun, 2007-11-25 at 20:24 +0100, Roland Hopferwieser wrote: > First I want to thank you for this great software. > Second, I think it could be a good idea to give the user the chance to > change the location for the kerberos V cache, so there is no potentially > conflict with other processes. With external refreshment of the krb5 > cache, I use the cache also for authentication against the LDAP server > with the gssapi. > Please find attached a little diff file to dovecot 1.0.7. Looks ok, but I hate to add new settings to dovecot.conf nowadays since there are already too many. Also then there would be two Kerberos-related settings that simply set environment variables. I'm beginning to think that maybe something more generic is needed, such as: auth default { .. environment { krb5_ktname = .. krb5ccname = ... who_knows_what_else_in_future = .. } } I think LDAP library also can accept settings from environment. Anyone on mailing list have better ideas?

2 1

[Dovecot] LIST problem with Dovecot1.1beta10
by Dean Brooks 04 Dec '07

04 Dec '07

Hi, Certain IMAP folder problems started popping up with Squirrelmail with the 1.1beta10 version of Dovecot (and possibly earlier versions). Looked into it and I am seeing odd behavior with the LIST command. Here is how to reproduce problem, unless I'm missing something obvious: a001 login dean <password> a001 OK Logged in. a002 list "" * * LIST (\NoInferiors \UnMarked) "/" "Sent" * LIST (\NoInferiors \UnMarked) "/" "Trash" * LIST (\NoInferiors \UnMarked) "/" "Drafts" * LIST (\NoInferiors \UnMarked) "/" "INBOX" a002 OK List completed. a003 list "" Trash* * LIST (\NoInferiors \UnMarked) "/" "Trash" a003 OK List completed. a004 list "" Trash a004 OK List completed. <*** What? Shouldn't it have listed Trash instead of returning nothing?> a005 list "" Trash" <*** Unbalanced quote causes total lockup! It appears that Squirrelmail, and possibly others, are using the LIST command to test for the presence of a mailbox, but it seems impossible to get an exact match. Am I missing something here? -- Dean Brooks dean(a)iglou.com

2 5

Re: [Dovecot] imap process consuming 100% CPU (Dovecot 1.0.3)
by Jackie Hunt 04 Dec '07

04 Dec '07

> > Is this behavior cured, or do you continue to see it? > No, the behavior isn't cured. We still continue to see it with various clients. I have posted a couple of truss outputs, but so far no resolution. Sorry for the slow response. I've been "fighting other fires". Jackie > Jackie Hunt wrote: > >> On Mon, 2007-09-03 at 12:37 +0200, Robert Tomanek wrote: > >> > >>> Hi, > >>> > >>> Sunday, September 2, 2007, 22:42:37, you wrote: > >>> > >>>>> 0x0806049d in imap_sync_more (ctx=3D0x80d9770) at imap-sync.c:104 > >>>>> 104 if (ctx->seq =3D=3D 0) { > >>>>> > >>> A short follow-up on this, looks like an infinite loop to me, unless > >>> some threading magic is supposed to happen here: > >>> > >> Fixed: http://hg.dovecot.org/dovecot-1.0/rev/8e86137a04fb > >> > > > > We also are seeing imap processes consuming 100% CPU. We have > > installed Dovecot v1.0.5 and still see the problem. I have a user > > who can pretty reliably reproduce the problem. It occurs each > > morning after the imap connection has been idling all night. The > > user is running Thunderbird 2.0.0.6 (I think) on Solaris. On the > > client side, he see an hourglass that never goes away, has to shut > > down Thunderbird. > > > > Below is a log, which shows how the CPU is being used (the ps commands > > are done one right after another) and a dbx trace of the state of > > the imap process. I'm hoping that's enough info to figure out what's > > happening. > > > > Thanks much, > > Jackie > > --- > > Jackie Hunt > > ACNS Voice: (970) 663-3789 > > Colorado State University FAX: (970) 491-1958 > > Fort Collins, CO 80523 Email: jackie.hunt(a)colostate.edu > > > > > > $ ps -ef | grep -i xxxxxx | grep imap > > xxxxxx 43004 92942 74 07:15:33 - 38:54 imap > > $ ps -ef | grep -i xxxxxx | grep imap > > xxxxxx 43004 92942 81 07:15:33 - 38:58 imap > > $ ps -ef | grep -i xxxxxx | grep imap > > xxxxxx 43004 92942 120 07:15:33 - 39:01 imap > > $ dbx -a 43004 > > Waiting to attach to process 43004 ... > > Successfully attached to imap. > > warning: Directory containing imap could not be determined. > > Apply 'use' command to initialize source path. > > > > Type 'help' for help. > > reading symbolic information ... > > stopped in pread at 0xd01f06cc > > 0xd01f06cc (pread+0x30) 80410014 lwz r2,0x14(r1) > > (dbx) step > > stopped in istream-file._read at line 120 in file "" > > could not read "istream-file.c" > > (dbx) use src lib src/lib src/lib-storage/index/mbox src/lib-mail src/lib-storage/index src/lib-storage src/imap src/imap-login > > (dbx) use > > src lib src/lib src/lib-storage/index/mbox src/lib-mail src/lib-storage/index src/lib-storage src/imap src/imap-login > > (dbx) where > > istream-file._read(stream = 0x200274a8), line 120 in "istream-file.c" > > i_stream_read(stream = 0x200274cc), line 58 in "istream.c" > > istream-raw-mbox._read(stream = 0x20028ab8), line 160 in "istream-raw-mbox.c" > > i_stream_read(stream = 0x20028adc), line 58 in "istream.c" > > istream-limit._read(stream = 0x20031458), line 56 in "istream-limit.c" > > i_stream_read(stream = 0x2003147c), line 58 in "istream.c" > > istream-header-filter._read(stream = 0x2004aa98), line 234 in "istream-header-filter.c" > > i_stream_read(stream = 0x2004aabc), line 58 in "istream.c" > > i_stream_read_data(stream = 0x2004aabc, data = 0x2ff22630, size = 0x2ff22638, threshold = 1), line 250 in "istream.c" > > message_get_body_size(input = 0x2004aabc, body = 0x2002827c, has_nuls = (nil)), line 107 in "message-size.c" > > index_mail_init_stream(_mail = 0x200281a8, hdr_size = 0x2ff227a8, body_size = 0x2ff227b8), line 502 in "index-mail.c" > > mbox_mail_get_stream(_mail = 0x200281a8, hdr_size = 0x2ff227a8, body_size = 0x2ff227b8), line 206 in "mbox-mail.c" > > mail_get_stream(mail = 0x200281a8, hdr_size = 0x2ff227a8, body_size = 0x2ff227b8), line 107 in "mail.c" > > imap-fetch-body.fetch_body(ctx = 0x200205e0, mail = 0x200281a8, context = 0x20020858), line 331 in "imap-fetch-body.c" > > imap_fetch(ctx = 0x200205e0), line 291 in "imap-fetch.c" > > cmd_fetch(cmd = 0x2001e35c), line 163 in "cmd-fetch.c" > > cmd_uid(cmd = 0x2001e35c), line 19 in "cmd-uid.c" > > client_handle_input(cmd = 0x2001e35c), line 344 in "client.c" > > client_handle_input(cmd = 0x2001e35c), line 398 in "client.c" > > _client_input(context = 0x2001e318), line 441 in "client.c" > > io_loop_handler_run(ioloop = 0x2001d0e8), line 199 in "ioloop-poll.c" > > io_loop_run(ioloop = 0x2001d0e8), line 329 in "ioloop.c" > > main(argc = 1, argv = 0x2ff22b50, envp = 0x2ff22b58), line 290 in "main.c" > > (dbx) list > > 58 return _stream->read(_stream); > > 59 } > > 60 > > 61 void i_stream_skip(struct istream *stream, uoff_t count) > > 62 { > > 63 struct _istream *_stream = stream->real_stream; > > 64 size_t data_size; > > 65 > > 66 data_size = _stream->pos - _stream->skip; > > 67 if (count <= data_size) { > > (dbx) dump > > i_stream_read(stream = 0x2003147c), line 58 in "istream.c" > > _stream = 0x20031458 > > (dbx) up > > istream-header-filter._read(stream = 0x2004aa98), line 234 in "istream-header-filter.c" > > (dbx) list > > 234 if ((ret = i_stream_read(mstream->input)) == -2) { > > 235 if (stream->skip == 0) > > 236 return -2; > > 237 } > > 238 stream->istream.stream_errno = mstream->input->stream_errno; > > 239 stream->istream.eof = mstream->input->eof; > > 240 stream->buffer = i_stream_get_data(mstream->input, &pos); > > 241 } else { > > 242 ret = 0; > > 243 } > > (dbx) dump > > istream-header-filter._read(stream = 0x2004aa98), line 234 in "istream-header-filter.c" > > mstream = 0x2004aa98 > > ret = 4094 > > pos = 1 > > (dbx) up > > i_stream_read(stream = 0x2004aabc), line 58 in "istream.c" > > (dbx) list > > 58 return _stream->read(_stream); > > 59 } > > 60 > > 61 void i_stream_skip(struct istream *stream, uoff_t count) > > 62 { > > 63 struct _istream *_stream = stream->real_stream; > > 64 size_t data_size; > > 65 > > 66 data_size = _stream->pos - _stream->skip; > > 67 if (count <= data_size) { > > (dbx) dump > > i_stream_read(stream = 0x2004aabc), line 58 in "istream.c" > > _stream = 0x2004aa98 > > (dbx) up > > i_stream_read_data(stream = 0x2004aabc, data = 0x2ff22630, size = 0x2ff22638, threshold = 1), line 250 in "istream.c" > > (dbx) list > > 250 ret = i_stream_read(stream); > > 251 if (ret > 0) > > 252 read_more = TRUE; > > 253 } while (ret > 0); > > 254 > > 255 *data = i_stream_get_data(stream, size); > > 256 return ret == -2 ? -2 : > > 257 (read_more || ret == 0 ? 0 : -1); > > 258 } > > 259 > > (dbx) dump > > i_stream_read_data(stream = 0x2004aabc, data = 0x2ff22630, size = 0x2ff22638, threshold = 1), line 250 in "istream.c" > > read_more = 0 > > ret = 0 > > (dbx) up > > message_get_body_size(input = 0x2004aabc, body = 0x2002827c, has_nuls = (nil)), line 107 in "message-size.c" > > (dbx) list > > 107 } while (i_stream_read_data(input, &msg, &size, 1) > 0); > > 108 > > 109 i_stream_skip(input, 1); > > 110 body->physical_size++; > > 111 > > 112 body->virtual_size = body->physical_size + missing_cr_count; > > 113 i_assert(body->virtual_size >= body->physical_size); > > 114 } > > 115 > > 116 void message_size_add(struct message_size *dest, > > (dbx) dump > > message_get_body_size(input = 0x2004aabc, body = 0x2002827c, has_nuls = (nil)), line 107 in "message-size.c" > > last_cr = 0 > > missing_cr_count = 83389 > > msg = "dd" > > i = 4095 > > size = 1 > > (dbx) up > > index_mail_init_stream(_mail = 0x200281a8, hdr_size = 0x2ff227a8, body_size = 0x2ff227b8), line 502 in "index-mail.c" > > (dbx) list > > 502 message_get_body_size(data->stream, > > 503 &data->body_size, NULL); > > 504 data->body_size_set = TRUE; > > 505 } > > 506 } > > 507 > > 508 *body_size = data->body_size; > > 509 } > > 510 > > 511 if (data->hdr_size_set && data->body_size_set) { > > (dbx) dump > > index_mail_init_stream(_mail = 0x200281a8, hdr_size = 0x2ff227a8, body_size = 0x2ff227b8), line 502 in "index-mail.c" > > data = 0x2002820c > > mail = 0x200281a8 > > (dbx) up > > mbox_mail_get_stream(_mail = 0x200281a8, hdr_size = 0x2ff227a8, body_size = 0x2ff227b8), line 206 in "mbox-mail.c" > > (dbx) list > > 206 return index_mail_init_stream(mail, hdr_size, body_size); > > 207 } > > 208 > > 209 struct mail_vfuncs mbox_mail_vfuncs = { > > 210 index_mail_free, > > 211 index_mail_set_seq, > > 212 > > 213 index_mail_get_flags, > > 214 index_mail_get_keywords, > > 215 index_mail_get_parts, > > (dbx) dump > > mbox_mail_get_stream(_mail = 0x200281a8, hdr_size = 0x2ff227a8, body_size = 0x2ff227b8), line 206 in "mbox-mail.c" > > raw_stream = 0x2ff22780 > > mbox = 0x20024a98 > > data = 0x2002820c > > mail = 0x200281a8 > > offset = 804398928 > > (dbx) up > > mail_get_stream(mail = 0x200281a8, hdr_size = 0x2ff227a8, body_size = 0x2ff227b8), line 107 in "mail.c" > > (dbx) list > > 107 return p->v.get_stream(mail, hdr_size, body_size); > > 108 } > > 109 > > 110 const char *mail_get_special(struct mail *mail, enum mail_fetch_field field) > > 111 { > > 112 struct mail_private *p = (struct mail_private *)mail; > > 113 > > 114 return p->v.get_special(mail, field); > > 115 } > > 116 > > (dbx) dump > > mail_get_stream(mail = 0x200281a8, hdr_size = 0x2ff227a8, body_size = 0x2ff227b8), line 107 in "mail.c" > > p = 0x200281a8 > > (dbx) up > > imap-fetch-body.fetch_body(ctx = 0x200205e0, mail = 0x200281a8, context = 0x20020858), line 331 in "imap-fetch-body.c" > > (dbx) list > > 331 body->section[0] == 'H' ? NULL : &body_size); > > 332 if (ctx->cur_input == NULL) > > 333 return -1; > > 334 > > 335 i_stream_ref(ctx->cur_input); > > 336 ctx->update_partial = TRUE; > > 337 > > 338 switch (body->section[0]) { > > 339 case '\0': > > 340 /* BODY[] - fetch everything */ > > (dbx) dump > > imap-fetch-body.fetch_body(ctx = 0x200205e0, mail = 0x200281a8, context = 0x20020858), line 331 in "imap-fetch-body.c" > > fetch_size = 0x20011dd8 > > hdr_size = (physical_size = 843, virtual_size = 843, lines = 15) > > body = 0x20020858 > > body_size = (physical_size = 804398512, virtual_size = 12, lines = 0) > > (dbx) up > > imap_fetch(ctx = 0x200205e0), line 291 in "imap-fetch.c" > > (dbx) list > > 291 ret = handlers[ctx->cur_handler]. > > 292 handler(ctx, ctx->cur_mail, > > 293 handlers[ctx->cur_handler].context); > > 294 t_pop(); > > 295 > > 296 if (ret == 0) > > 297 return 0; > > 298 > > 299 if (ret < 0) { > > 300 if (ctx->cur_mail->expunged) { > > (dbx) dump > > imap_fetch(ctx = 0x200205e0), line 291 in "imap-fetch.c" > > handlers = 0x200206f8 > > count = 3 > > ret = 1 > > (dbx) up > > cmd_fetch(cmd = 0x2001e35c), line 163 in "cmd-fetch.c" > > (dbx) list > > 163 if ((ret = imap_fetch(ctx)) == 0) { > > 164 /* unfinished */ > > 165 client->command_pending = TRUE; > > 166 cmd->func = cmd_fetch_continue; > > 167 cmd->context = ctx; > > 168 return FALSE; > > 169 } > > 170 if (ret < 0) > > 171 ctx->failed = TRUE; > > 172 > > (dbx) dump > > cmd_fetch(cmd = 0x2001e35c), line 163 in "cmd-fetch.c" > > messageset = "11988" > > search_arg = 0x200205a8 > > ctx = 0x200205e0 > > args = 0x2001e590 > > ret = 536954712 > > client = 0x2001e318 > > (dbx) up > > cmd_uid(cmd = 0x2001e35c), line 19 in "cmd-uid.c" > > (dbx) list > > 19 return cmd->func(cmd); > > 20 } else { > > 21 client_send_tagline(cmd, t_strconcat( > > 22 "BAD Unknown UID command ", cmd_name, NULL)); > > 23 return TRUE; > > 24 } > > 25 } > > (dbx) dump > > cmd_uid(cmd = 0x2001e35c), line 19 in "cmd-uid.c" > > cmd_name = "fetch" > > (dbx) up > > client_handle_input(cmd = 0x2001e35c), line 344 in "client.c" > > (dbx) list > > 344 if (cmd->func(cmd) || cmd->param_error) { > > 345 /* command execution was finished */ > > 346 if (!cmd->param_error) > > 347 client->bad_counter = 0; > > 348 _client_reset_command(client); > > 349 return TRUE; > > 350 } > > 351 > > 352 /* unfinished */ > > 353 if (client->command_pending) > > (dbx) dump > > client_handle_input(cmd = 0x2001e35c), line 344 in "client.c" > > client = 0x2001e318 > > (dbx) up > > client_handle_input(cmd = 0x2001e35c), line 398 in "client.c" > > (dbx) list > > 398 client_handle_input(cmd); > > 399 } > > 400 > > 401 return TRUE; > > 402 } > > 403 > > 404 void _client_input(void *context) > > 405 { > > 406 struct client *client = context; > > 407 struct client_command_context *cmd = &client->cmd; > > (dbx) dump > > client_handle_input(cmd = 0x2001e35c), line 398 in "client.c" > > client = 0x2001e318 > > (dbx) up > > _client_input(context = 0x2001e318), line 441 in "client.c" > > (dbx) list > > 441 ret = client_handle_input(cmd); > > 442 t_pop(); > > 443 } while (ret && !client->disconnected); > > 444 o_stream_uncork(client->output); > > 445 client->handling_input = FALSE; > > 446 > > 447 if (client->command_pending) > > 448 client->input_pending = TRUE; > > 449 > > 450 if (client->output->closed) > > (dbx) dump > > _client_input(context = 0x2001e318), line 441 in "client.c" > > ret = 2 > > cmd = 0x2001e35c > > client = 0x2001e318 > > (dbx) up > > io_loop_handler_run(ioloop = 0x2001d0e8), line 199 in "ioloop-poll.c" > > (dbx) list > > 199 io->callback(io->context); > > 200 if (t_pop() != t_id) { > > 201 i_panic("Leaked a t_pop() call in " > > 202 "I/O handler %p", > > 203 (void *)io->callback); > > 204 } > > 205 } > > 206 } > > 207 } > > 208 } > > (dbx) dump > > io_loop_handler_run(ioloop = 0x2001d0e8), line 199 in "ioloop-poll.c" > > t_id = 2 > > tv = (tv_sec = 1, tv_usec = 54083) > > msecs = 1055 > > pollfd = 0x2001d148 > > ctx = 0x2001d118 > > ret = 0 > > io = 0x2001e4e8 > > call = 1 > > (dbx) up > > io_loop_run(ioloop = 0x2001d0e8), line 329 in "ioloop.c" > > (dbx) list > > 329 io_loop_handler_run(ioloop); > > 330 } > > 331 > > 332 void io_loop_stop(struct ioloop *ioloop) > > 333 { > > 334 ioloop->running = FALSE; > > 335 } > > 336 > > 337 void io_loop_set_running(struct ioloop *ioloop) > > 338 { > > (dbx) dump > > io_loop_run(ioloop = 0x2001d0e8), line 329 in "ioloop.c" > > (dbx) up > > main(argc = 1, argv = 0x2ff22b50, envp = 0x2ff22b58), line 290 in "main.c" > > (dbx) list > > 290 io_loop_run(ioloop); > > 291 main_deinit(); > > 292 > > 293 io_loop_destroy(&ioloop); > > 294 lib_deinit(); > > 295 > > 296 return 0; > > 297 } > > (dbx) dump > > main(argc = 1, argv = 0x2ff22b50, envp = 0x2ff22b58), line 290 in "main.c" > > (dbx) up > > __start() at 0x100001d8 > > (dbx) list > > no source file > > (dbx) dump > > __start() at 0x100001d8 > > (dbx) cont > > > > execution completed > > (dbx) quit > > $ > > > > -- > ==== > Stewart Dean, Unix System Admin, Henderson Computer Resources > Center of Bard College, Annandale-on-Hudson, New York 12504 > sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035 > Jackie Hunt ACNS Voice: (970) 663-3789 Colorado State University FAX: (970) 491-1958 Fort Collins, CO 80523 Email: jackie.hunt(a)colostate.edu

4 9

[Dovecot] 1.1beta 10 hang
by Joe Wong 04 Dec '07

04 Dec '07

Hi Timo, I have installed 1.1 beta 10 today with squat enabled. When I do uid search body "something", the imap will sometimes segmentation fault, or sometime hang. Here is what i found in the log when imap did not hang.. dovecot: Dec 04 17:11:07 Panic: IMAP(joewong99:joew.outblaze.com): file squat-uidlist.c: line 178 (uidlist_write_array): assertion failed: ((uid & ~UID_LIST_MASK_RANGE) >= prev) dovecot: Dec 04 17:11:07 Error: IMAP(joewong99:joew.outblaze.com): Raw backtrace: imap [0x80ca1f0] -> imap [0x80ca0fc] -> /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so [0x11b9a9] -> /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so [0x11ba7a] -> /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so [0x11bb6b] -> /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so(squat_uidlist_build_add_uid+0x2e2) [0x11c0d2] -> /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so [0x11a9cb] -> /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so [0x11acf0] -> /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so(squat_trie_build_more+0x16a) [0x11ae6a] -> /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so [0x117b54] -> /usr/local/lib/dovecot/imap/lib20_fts_plugin.so(fts_backend_build_more+0x2e) [0x1125de] -> /usr/local/lib/dovecot/imap/lib20_fts_plugin.so [0x113f3d] -> imap [0x805d196] -> imap [0x805d518] -> imap(io_loop_handle_timeouts+0x10b) [0x80d0ceb] -> imap(io_loop_handler_run+0x69) [0x80d1509] -> imap(io_loop_run+0x28) [0x80d0bc8] -> imap(main+0x4cc) [0x8066c4c] -> dovecot: Dec 04 17:11:07 Error: IMAP(joewong99:joew.outblaze.com): /lib/libc.so.6(__libc_start_main+0xe0) [0x77df70] -> imap [0x8059571] dovecot: Dec 04 17:11:07 Error: child 32571 (imap) killed with signal 6 --

2 1

[Dovecot] Please solve my query
by bhagwat swarup 04 Dec '07

04 Dec '07

hi my question is Start a POP3 server on rhel5 with a matching criteria 1) user jack must get mail 2 Allow your network lw.com 3)my133.org domain can not access your server Thanks And Regards Bhagwat Swarup NH India Ltd

4 3

[Dovecot] procmail/formail --> Maildir
by Andre Huebner 04 Dec '07

04 Dec '07

Hello List, i switched mailformat from mbox to maildir. Now i have a little problem with procmail/formail and headermanipulation of mails. Here an example: 0 * ^From.*gmx.de | (formail -t -I"procmail: gmx.de") >> /var/spool/mail/xxxxxx So, i can add some different headerlines for later evaluation and the result is attached to inbox. Now i have the problem that i don't know name of targetfile, cause it is unique for every mail if maildir is used. I did not found a Option or other workaround to solve this case. I know, it is not a dovecot problem but i hope somebody can give a hint. Could it be a possibility to leave all unchanged? Mails could be transported to /var/spool/mail/xxxxxx and picked up by dovecot if in dovecot.conf the convert-plugin ist always activated? Thanks Andre

3 4

[Dovecot] v1.1.beta10 released
by Timo Sirainen 03 Dec '07

03 Dec '07

http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta10.tar.gz http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta10.tar.gz.sig Changes since beta9: - dotlock_use_excl=yes is now the default. I think this should work in all NFS setups that are in use nowadays. O_EXCL has worked since NFSv3. - fs quota: Added "noenforcing" option - Fixed compiling with non-gcc - Fixed quota plugin crash - Lots of fixes to handling message searches, especially related to non-ASCII searches. And most importantly: It includes the new Squat full text search indexing code. There are a few things left in my TODO for it: - It's currently used only to optimize root level AND searches. So for example SEARCH (OR TEXT hello TEXT world) is still searched the slow way. - Expunged messages are never removed from the indexes. - The index could be updated while messages are being saved, but this isn't done yet. - Indexed substring length is hardcoded to 4 characters. This should be configurable, although I think 4 should work quite nicely. Lucene plugin is probably completely broken now, but it was also in beta9.

1 1

[Dovecot] dovecot process nice value
by Daniel Watts 03 Dec '07

03 Dec '07

My imap processes seem to all be running with a nice value of -15 (top priority). Is this usual? Not sure if this is a dovecot setting or something going on with my own system configuration somewhere. I know the userdb query can set the nice value but mine (a mysql query) does not... We're having problems with our mail partition being absolutely thrashed and thought over-strong imap processes might be a factor. Many thanks, Daniel

2 4

[Dovecot] De-duplication / Single Instance Storage - WAS: Re: Updated v1.1 and summer plans
by Charles Marcus 03 Dec '07

03 Dec '07

On 12/2/2007, Timo Sirainen (tss(a)iki.fi) wrote: > On Sun, 2007-12-02 at 10:02 -0500, Charles Marcus wrote: >> Do you have any idea as to a time frame for when you might be able >> to get to it (Single instance Storage)? Are you thinking post >> v2.0? Even 2.1 or 3.0? > Right now I just want to get v1.1 finished. The main problem with it > is that apparently in some installations it's slower than v1.0 and I > haven't yet figured out why. And I want Squat rewrite to be included > in it too (almost finished! just committed it to hg). > > After v1.1 I'm not sure. I'm more interested in implementing other > features first (like v2.0's config rewrite, replication, etc.), but > once I'm beginning to run out of money I'll start doing pretty much > anything people pay me to do ;) Heh - understood... I'll talk to my boss, but he's - well, to put it politely, its a bit difficult to get money out of him... Actually, I'm looking into some form of file-system level de-duplication, which may negate the need for this... Anyone know of anything available on the cheap/free side? -- Best regards, Charles

1 0

[Dovecot] mbox File too large error
by Nicolas KOWALSKI 03 Dec '07

03 Dec '07

Hello, I have a rather large (~400MB) INBOX file in mbox format. When using deliver, it complains in the logs: Dec 2 16:47:13 petole deliver(niko): write() failed with mbox file /home/niko/mail/INBOX: File too large I do not see anything related in the configuration. And ulimit shows nothing special: $ ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited max nice (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited max rt priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited This is with dovecot 1.0.8, sieve plugin 1.0.2: # dovecot -n # 1.0.8: /usr/local/etc/dovecot.conf login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login mail_location: mbox:~/mail:INBOX=~/mail/INBOX mbox_write_locks: fcntl auth default: passdb: driver: pam userdb: driver: passwd What can I do to be able to deliver to large mbox files ? Thanks, -- Nicolas

1 1

[Dovecot] 1.0.8 install trouble on Ubuntu dapper (PAM)
by John Gateley 03 Dec '07

03 Dec '07

Hi, I was running the Ubuntu dovecot package until now, and decided to upgrade because of an issue with Thunderbird. I downloaded and compiled 1.0.8, and it's not starting up. The error I'm getting is: Dec 2 15:35:04 jfootoo dovecot: auth(default): Unknown passdb driver 'pam' (typo, or Dovecot was built without support for it? Check with dovecot --build-options) D I used "./configure" and "./configure --with-pam", both give the same error message. dovecot --build-options gives: uild options: ioloop=poll notify=dnotify ipv6 openssl SQL drivers: Passdb: checkpassword passwd passwd-file shadow Userdb: checkpassword passwd prefetch passwd-file static I have a dovecot that I compiled for a different system and it includes "pam" in the Passdb line. I found a page on the web saying I might need the pam-devel package, but that doesn't seem to exist for ubuntu. I saved the output from ./configure, grepped for pam, and got: checking for pam_start in -lpam... no Any ideas? What do I need to get configure to do pam support? Thanks very much j

2 2

[Dovecot] [packages] Debian Etch Packages for v1.0.8
by Brian T Glenn 03 Dec '07

03 Dec '07

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 deb http://debian.delink.net/ etch-delink main Packages: dovecot-common, dovecot-imapd, and dovecot-pop3d Repository is signed by the following key. It can be found at hkp://pgpkeys.mit.edu/ pub 1024D/E88EB53D 2007-12-01 Key fingerprint = 842B BC47 E158 4DF1 A385 AA52 EAFD 7923 E88E B53D uid delink.net Internet Services (Debian Signing Key) <postmaster(a)delink.net> sub 2048g/0CAB6F5C 2007-12-01 Thanks, - -- Brian T Glenn http://www.delink.net/ -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFHU13hFy/L+4MovqIRAnpHAKClw07vODWo1Qwojntx9SUx/W7fQwCgon5Y 7TP6c4J9E9WgtXNJ836EUmc= =SBh8 -----END PGP SIGNATURE-----

1 0

Re: [Dovecot] Updated v1.1 and summer plans
by Charles Marcus 03 Dec '07

03 Dec '07

Timo Sirainen, on 5/21/2007 8:54 AM, said the following: <snip> > Upcoming v1.1 features, more or less implemented in this order: <snip> Hey Timo, I'm loving all of the new functionality - especially the full support for Shared mailboxes and ACLs... but... I don't see any mention of support for SiS (single-instance-storage) as discussed previously on the list, even for upcoming 1.2/2.0 Did this fall through a crack? Or did you decide it was going to be too difficult for the time being? I'd dearly like to get this working, at least for email attachments... Thanks for your consideration, and thanks so much for dovecot! -- Best regards, Charles

3 5

[Dovecot] namespaces, shared mailboxes
by Alexander 'Leo' Bergolth 03 Dec '07

03 Dec '07

Hi! I'd like to provide shared mailboxes with maildir that should appear like 'Shared/<mailboxname>' to the clients. Using the namespace configuration below, everything works fine, exept one thing: Mail clients (only tested with Thunderbird) won't allow to put mails directly in 'Shared/mailboxname' (the folder it is greyed out). You currently have to create subfolders and put the mails in those subfolders. Is there any workaround for this problem? -------------------- 8< -------------------- namespace private { separator = / inbox = yes prefix = location = mbox:~/mail:INBOX=/var/mail/%u } namespace shared { separator = / # hidden = yes prefix = Shared/spamrep/ location = maildir:/var/spool/mail/Shared/spamrep:CONTROL=~/Maildir/control/Shared/spamrep:INDEX=~/Mail\ dir/index/Shared/spamrep } -------------------- 8< -------------------- I'm using dovecot 1.0.8. "Server supports folders that contain subfolders and messages" is enabled in Thunderbird's advanced server settings. Thanks in advance, --leo -- e-mail ::: Alexander.Bergolth (at) wu-wien.ac.at fax ::: +43-1-31336-906050 location ::: Computer Center | Vienna University of Economics | Austria

5 11

[Dovecot] Tru64 v5.1 with Sia
by J Bacher 02 Dec '07

02 Dec '07

./configure --with-sia # ./dovecot --build-options Build options: ioloop=poll ipv6 openssl SQL drivers: Passdb: checkpassword passwd passwd-file Userdb: checkpassword passwd prefetch passwd-file static # ./dovecot --version 1.0.8 # ./dovecot -n # 1.0.8: /usr/local/etc/dovecot.conf protocols: pop3 listen: *:10100 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/pop3-login mail_extra_groups: mail mail_executable: /usr/local/libexec/dovecot/pop3 mail_plugin_dir: /usr/local/lib/dovecot/pop3 pop3_uidl_format: %08Xu%08Xv auth default: passdb: driver: passwd userdb: driver: passwd Configuration simplified to determine why authentication is [still] failing. Any assistance would be greatly appreciated.

2 2

[Dovecot] imaptest update
by Timo Sirainen 02 Dec '07

02 Dec '07

I finally moved imaptest to mercurial repository and added a lot of new tests to it. It now also has its own wiki page: http://imapwiki.org/ImapTest Dovecot v1.1 with dbox or cydir format is the only open source IMAP server that reports no errors with it (haven't tried non-OSS servers). Dovecot with maildir and mbox have some problems with \Recent flag handling. I guess I'll have to figure out why.

1 0

[Dovecot] dovecot sieve confusion
by Bazy 02 Dec '07

02 Dec '07

Hi... I use dovecot with postfix. For dovecot's sieve plugin to work, do I need to put in my /etc/postfix/master.cf: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -d ${recipient} and postconf -e virtual_transport=dovecot postconf -e dovecot_destination_recipient_limit=1 ?

2 3

[Dovecot] Dovecot strange logs
by Guillaume de Lafond 02 Dec '07

02 Dec '07

Hello, I have some strange logs entries in my dovecot_info.log (auth_debug=yes & auth_verbose=ye) : dovecot: Nov 27 00:28:09 Info: auth(default): vpopmail(CLIENT_EMAIL,CLIENT_IP): lookup user= domain=??п????? dovecot: Nov 27 00:28:09 Info: auth(default): vpopmail(CLIENT_EMAIL,CLIENT_IP): lookup user=CLIENT_USER domain=CLIENT_DOMAIN dovecot: Nov 27 00:28:09 Info: auth(default): vpopmail(CLIENT_EMAIL,CLIENT_IP): lookup user=CLIENT_USER domain= CLIENT_DOMAIN (replace CLIENT_EMAIL,CLIENT_IP,CLIENT_USER,CLIENT_DOMAIN with real value of course) For each authentication I have the in first line : "lookup user= domain=??п?????" It's working.. but I think that it's not normal :) My dovecot -n : # 1.0.7: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: log/dovecot.log info_log_path: log/dovecot_info.log protocols: imap pop3 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: Mail server login_process_per_connection: no login_process_size: 96 login_processes_count: 10 login_max_processes_count: 196 verbose_proctitle: yes first_valid_uid: 89 mail_location: maildir:~/Maildir:INDEX=/Volumes/LD1/dovecot_indexes/ %1d/%d/%n mmap_disable: yes dotlock_use_excl: yes maildir_copy_with_hardlinks: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh namespace: type: private separator: . prefix: INBOX. inbox: yes namespace: type: private separator: / prefix: INBOX/ inbox: yes hidden: yes auth default: mechanisms: plain login apop cram-md5 cache_size: 1024 verbose: yes debug: yes count: 10 passdb: driver: vpopmail args: cache_key=%u dovecot userdb: driver: vpopmail plugin: quota: maildir Regards, -- Guillaume de Lafond Aqua Ray

2 1

[Dovecot] Quick fix for nfs-workarounds.c
by Dean Brooks 02 Dec '07

02 Dec '07

Hi, Under Solaris 8, the rmdir() command returns EEXIST instead of ENOTEMPTY if an rmdir() is attempted on a directory with files still in it. Dovecot 1.1beta9 currently gives tons of errors in the logfile as a result of the code not checking for the right error value. The function nfs_flush_file_handle_cache_dir() in nfs-worksarounds.c probably needs to reflect EEXIST as well as ENOTEMPTY. -- Dean Brooks dean(a)iglou.com

2 1

[Dovecot] imap login messages not logged
by Nikolay Shopik 02 Dec '07

02 Dec '07

One of my server stop logging such messages when user trying to login. imap-login: Login: user=<username(a)example.com>. I check configuration from another server and it very same. I'm running on debian testing with config below. # 1.0.5: /etc/dovecot/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot.info protocols: imap ssl_cert_file: /etc/postfix/new_chained.crt ssl_key_file: /etc/postfix/mail.pem login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_greeting_capability: yes mail_location: maildir:/var/mail/store/%u dotlock_use_excl: yes maildir_copy_with_hardlinks: yes auth default: mechanisms: PLAIN CRAM-MD5 passdb: driver: passwd-file args: /etc/dovecot/passwd userdb: driver: static args: uid=vmail gid=vmail home=/var/mail/store/%u socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 438 user: root group: root plugin: sieve: /var/mail/store/%u/sieve

2 2

[Dovecot] locking strategies?
by Joe Allesi -X (joallesi - Coyote Creek Consulting at Cisco) 01 Dec '07

01 Dec '07

Any known issues with these locking strategies? (RHEL 4.x default) Dovecot: mbox_locks = fcntl Procmail Locking strategies: dotlocking, fcntl() We're considering moving to all dotlocking after a recommendation from RedHat, even though we're not using NFS at all. Thanks!

3 4

[Dovecot] Received Date vs Date Header
by Jeff Grossman 01 Dec '07

01 Dec '07

I am trying to figure out why my mail clients are not correctly showing me the received date versus the date header date. I am using Dovecot 1.1B9. Here is a copy of the rawlog from Dovecot when I started up the client. Is Dovecot supposed to be sending the received date and the date header during this conversation? * OK [RAWLOG TIMESTAMP] 2007-11-30 16:48:31 * NAMESPACE (("" ".")) NIL NIL 3 OK Namespace completed. * LSUB () "." "Junk E-mail" * LSUB () "." "Deleted Items" * LSUB () "." "Drafts" * LSUB () "." "Ham" * LSUB () "." "INBOX" * LSUB () "." "Keep Messages" * LSUB () "." "Mailing Lists" * LSUB () "." "Sent Items" * LSUB () "." "Spam" * LSUB () "." "Other" * LSUB () "." "Inbox2" * LSUB () "." "Dovecot" * LSUB () "." "MIMEDefang" * LSUB () "." "Beta" * LSUB () "." "Debian" * LSUB () "." "Leafnode" * LSUB () "." "Sendmail" 4 OK Lsub completed. * LIST (\HasNoChildren) "." "INBOX" 5 OK List completed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded $MDNSent Junk NonJu: nk) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded $MDNSent Junk NonJunk \*)] Flags permitted. * 19 EXISTS * 2 RECENT * OK [UNSEEN 17] First unseen. * OK [UIDVALIDITY 1191346544] UIDs valid * OK [UIDNEXT 7608] Predicted next UID 6 OK [READ-WRITE] Select completed. * 1 FETCH (FLAGS (\Seen) UID 5) * 2 FETCH (FLAGS (\Seen) UID 5707) * 3 FETCH (FLAGS (\Seen) UID 7042) * 4 FETCH (FLAGS (\Seen) UID 7103) * 5 FETCH (FLAGS (\Seen) UID 7110) * 6 FETCH (FLAGS (\Seen) UID 7183) * 7 FETCH (FLAGS (\Seen) UID 7237) * 8 FETCH (FLAGS (\Seen) UID 7334) * 9 FETCH (FLAGS (\Seen) UID 7353) * 10 FETCH (FLAGS (\Answered \Seen) UID 7355) * 11 FETCH (FLAGS (\Seen) UID 7364) * 12 FETCH (FLAGS (\Seen) UID 7482) * 13 FETCH (FLAGS (\Seen) UID 7485) * 14 FETCH (FLAGS (\Seen) UID 7496) * 15 FETCH (FLAGS (\Seen) UID 7546) : * 16 FETCH (FLAGS (\Seen) UID 7555) * 17 FETCH (FLAGS () UID 7605) * 18 FETCH (FLAGS (\Recent) UID 7606) * 19 FETCH (FLAGS (\Recent) UID 7607) 7 OK Fetch completed. * 18 FETCH (UID 7606 RFC822.SIZE 4589 FLAGS (\Recent) BODY[HEADER.FIELDS (FROM TO CC SUBJECT DATE MESSAGE-ID PRIORITY X-PRIORITY REFERENCES NEWSGROUPS IN-REPLY-(END) TO CONTENT-TYPE)] {352} Date: Fri, 30 Nov 2007 15:24:32 -0800 Subject: x From: x To: x Message-ID: <C375DBB0.416E%x> Content-type: text/plain; charset="US-ASCII" ) * 19 FETCH (UID 7607 RFC822.SIZE 4590 FLAGS (\Recent) BODY[HEADER.FIELDS (FROM TO CC SUBJECT DATE MESSAGE-ID PRIORITY X-PRIORITY REFERENCES NEWSGROUPS IN-REPLY-TO CONTENT-TYPE)] {353} Date: Fri, 30 Nov 2007 15:25:23 -0800 Subject: x From: x To: x Message-ID: <C375DBE2.416F%x> Content-type: text/plain; charset="US-ASCII" ) 8 OK Fetch completed. + idling I am using Maildir and the date and time of those files from "ls -l" are "2007-11-30 16:48" and "2007-11-30 16:49". The mail client (Thunderbird) showed the received date/time and date date/time as "2007-11-30 3:24" and "2007-11-30 3:25" Thanks for any help you can offer me. Jeff

2 2

[Dovecot] 1.1.Beta9 deliver problem: Unknown mail storage driver raw
by Velko Ivanov 01 Dec '07

01 Dec '07

Hello, I'm new to dovecot, trying to configure a Postfix/Dovecot system. Got everything in place - smtp with dovecot SASL and imap working fine, maildir is created, thunderbird logs in successfuly .. but the Dovecot LDA gives me this error on delivery: "Couldn't create internal raw storage: Unknown mail storage driver raw". I tried searching the configuration manual, reference, google and this list's archives, but found no clue. Checked the source, but it will take me some time to figure out what is a storage driver and where is the "raw" one hiding, so if somebody could help, please .. I did it with userdb static initially - uid=dovecot_mail, gid=dovecot_mail, home=/usr/local/storage/mail/%d/%n but after reading, that some passdbs don't work with deliver&static, I moved everything to the db (found out that prefetch isn't working with deliver btw - moans about userdb_ entries not present, while the imap finds them and works happily). It didn't help. # 1.1.beta9: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot listen: mail.srv.ivanov-nest.com ssl_cert_file: /usr/local/etc/dovecot.crt ssl_key_file: /usr/local/etc/dovecot.key login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login mail_location: dbox:~/Maildir dotlock_use_excl: yes maildir_copy_preserve_filename: yes namespace: type: private inbox: yes hidden: yes list: yes subscriptions: yes auth default: mechanisms: plain login user: dovecot_db passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: dovecot_mail group: wheel

1 0

[Dovecot] last logon time
by Nikolay Shopik 30 Nov '07

30 Nov '07

Hi list, How can I detect when user last time logon into their mailbox? For what file I should look and compare change time?

2 1

[Dovecot] deliver+quota assertion
by Andrew Garner 30 Nov '07

30 Nov '07

When stressing dovecot's delivery agent, I sporadically encountered the following assertion failures and the associated errors. I was trickling in ~50 messages per minute to this mailbox via postal. Nov 30 09:38:41 mail deliver(example(a)example.com): close(/home/vmail/domains//+/example.com/k/example//Maildir/maildirsize) failed: Bad file descriptor Nov 30 09:38:41 mail deliver(example(a)example.com): rename(/home/vmail/domains//+/example.com/k/example//Maildir/maildirsize.lo…, /home/vmail/domains//+/example.com/k/example//Maildir/maildirsize) failed : No such file or directory Nov 30 09:38:41 mail deliver(example(a)example.com): file_dotlock_replace(/home/vmail/domains//+/example.com/k/example//Maildir/… failed: No such file or directory Nov 30 09:38:41 mail deliver(example(a)example.com): Internal quota calculation error Nov 30 09:38:41 mail deliver(example(a)example.com): file index-transaction.c: line 54 (index_transaction_finish_rollback): assertion failed: (t->mail_ref_count == 0) Nov 30 09:38:41 mail deliver(example(a)example.com): Raw backtrace: /usr/lib/dovecot/deliver(i_syslog_fatal_handler+0x2b) [0x80bf0ab] -> /usr/lib/dovecot/deliver [0x80beeba] -> /usr/lib/dovecot/deliver [0x 808f243] -> /usr/lib/dovecot/deliver(index_transaction_rollback+0x1a) [0x808f06a] -> /usr/lib/dovecot/modules/lda/lib10_quota_plugin.so [0xb7ea2f13] -> /usr/lib/dovecot/deliver(deliver_save+0x212) [0x8059412] -> /usr/lib/dovecot/deliver(main+0x12cb) [0x805a79b] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xc8) [0xb7ebcea8] -> /usr/lib/dovecot/deliver [0x8058611] # dovecot -n # 1.1.beta9: /etc/dovecot/dovecot.conf base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_greeting: Nationwide Internet Mail Server ready. verbose_proctitle: yes first_valid_uid: 89 last_valid_uid: 89 first_valid_gid: 89 last_valid_gid: 89 mail_uid: 89 mail_gid: 89 mail_location: maildir:/home/vmail/domains/%h/Maildir mail_debug: yes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock mail_executable(default): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): delay-newmail imap_client_workarounds(imap): delay-newmail imap_client_workarounds(pop3): pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: login plain cram-md5 digest-md5 username_format: %Lu verbose: yes debug: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir quota_rule: *:storage=102400 This is the latest hg sources, somewhat after beta9: $ hg tip changeset: 6877:a5a7d38b6df7 branch: HEAD tag: tip user: Timo Sirainen <tss(a)iki.fi> date: Thu Nov 29 19:38:06 2007 +0200

1 0

[Dovecot] Zimbra benchmarking
by Timo Sirainen 30 Nov '07

30 Nov '07

Now that I have a working kvm setup, I thought I'd finally try how Zimbra works. This is mainly some microbenchmarking, so it may not have much to do with actual performance in real life. Setup: - 1GB memory given to kvm (from host's 2GB) - Intel Core 2 6600 (kvm uses only one CPU) - CentOS 5 - 15GB qcow2 image on XFS filesystem - Zimbra 5.0 RC2 RHEL5 x86_64 - Dovecot latest hg, dbox format Both Zimbra and Dovecot were tested running on the same kvm image. All data could be cached in memory, so this didn't really test disk I/O. Dovecot was run with fsync_disable=no. Running with =yes would have made its performance even better. Zimbra features/bugs -------------------- Zimbra's SEARCH command doesn't support substring searching as IMAP requires: 1 search text performance * SEARCH 136 183 227 231 232 233 245 1 OK SEARCH completed 2 search text erformance * SEARCH 2 OK SEARCH completed 3 search text performanc * SEARCH 3 OK SEARCH completed It's possible to search "performanc" in a non-standard way though: 4 search text "performanc*" * SEARCH 136 183 227 231 232 233 245 4 OK SEARCH completed This means that the upcoming Dovecot v1.1 is probably the only IMAP server that supports IMAP-compatible full text search indexes with incremental updates. (Cyrus Squat requires rebuilding the whole index from scratch just for adding one mail, which makes it kind of impractical.) Zimbra doesn't support SORT or THREAD extensions. I had trouble benchmarking more than 5 simultaneous connections in one mailbox. I'm not sure if this is a configurable setting somewhere, or if there's just some bug. The error messages that my imaptest gave looked like Zimbra was buggy, but I didn't look at them too closely. STORE command also seemed to be buggy, giving lots of "STORE failed" errors, even with just one connection. Zimbra uses 500MB of memory just to start up, so it's not exactly for hosting small installations. Login+Logout ------------ Dovecot: ./imaptest - select=0 secs=10 seed=0 clients=1 Logi Logo 100% 100% 3439 6878 ./imaptest - select=0 secs=10 seed=0 clients=10 Logi Logo 100% 100% 4415 8830 Zimbra: ./imaptest - select=0 secs=10 seed=0 clients=1 Logi Logo 100% 100% 18032 36064 ./imaptest - select=0 secs=10 seed=0 clients=10 Logi Logo 100% 100% 25519 51056 Looks like Dovecot's imap process creation hurts it a lot compared to Zimbra's thread creation. Luckily IMAP connections are usually long-living, so this shouldn't matter much, except for webmails for which you can use imapproxy in the middle. LIST "" * --------- Dovecot: ./imaptest - select=0 logout=0 list=100 secs=10 seed=0 clients=1 Logi List 100% 100% 1 181411 ./imaptest - select=0 logout=0 list=100 secs=10 seed=0 clients=10 Logi List 100% 100% 10 133451 Zimbra: ./imaptest - select=0 logout=0 list=100 secs=10 seed=0 clients=1 Logi List 100% 100% 1 1021 ./imaptest - select=0 logout=0 list=100 secs=10 seed=0 clients=10 Logi List 100% 100% 10 972 Yes, Dovecot's LIST is over 100 times faster. STATUS INBOX (MESSAGES UNSEEN RECENT) ------------------------------------- 100 messages in INBOX dovecot: ./imaptest - logout=0 select=0 status=100 secs=10 seed=0 clients=1 Logi Stat 100% 100% 1 191003 ./imaptest - logout=0 select=0 status=100 secs=10 seed=0 clients=10 Logi Stat 100% 100% 10 171171 Zimbra: ./imaptest - logout=0 select=0 status=100 secs=10 seed=0 clients=1 Logi Stat 100% 100% 1 3697 ./imaptest - logout=0 select=0 status=100 secs=10 seed=0 clients=10 Logi Stat 100% 100% 10 7009 FETCH 1:* (UID FLAGS ENVELOPE INTERNALDATE BODYSTRUCTURE) --------------------------------------------------------- 100 messages in INBOX. dovecot: ./imaptest - logout=0 select=100 fetch=100 secs=10 seed=0 clients=1 Logi Sele Fetc 100% 100% 100% 1 1 2769 ./imaptest - logout=0 select=100 fetch=100 secs=10 seed=0 clients=5 Logi Sele Fetc 100% 100% 100% 5 5 2902 Zimbra: ./imaptest - logout=0 select=100 fetch=100 secs=10 seed=0 clients=1 Logi Sele Fetc 100% 100% 100% 1 1 203 ./imaptest - logout=0 select=100 fetch=100 secs=10 seed=0 clients=5 Logi Sele Fetc 100% 100% 100% 5 5 258 FETCH ? (BODY[]) ---------------- Randomly fetch message body from 100 messages Dovecot: ./imaptest - logout=0 select=100 fetch2=100 secs=10 seed=0 clients=1 Logi Sele Fet2 100% 100% 100% 30% 1 1 51958 ./imaptest - logout=0 select=100 fetch2=100 secs=10 seed=0 clients=5 Logi Sele Fet2 100% 100% 100% 30% 5 5 141397 Zimbra: ./imaptest - logout=0 select=100 fetch2=100 secs=10 seed=0 clients=1 Logi Sele Fet2 100% 100% 100% 30% 1 1 410 ./imaptest - logout=0 select=100 fetch2=100 secs=10 seed=0 clients=5 Logi Sele Fet2 100% 100% 100% 30% 5 5 2291 STORE ? FLAGS.SILENT (random flags and keywords) ------------------------------------------------ Dovecot: ./imaptest - logout=0 select=100 store=100 secs=10 seed=0 clients=1 Logi Sele Stor 100% 100% 100% 1 1 15236 ./imaptest - logout=0 select=100 store=100 secs=10 seed=0 clients=5 Logi Sele Stor 100% 100% 100% 5 5 5533 Zimbra: ./imaptest - logout=0 select=100 store=100 secs=10 seed=0 clients=1 Logi Sele Stor 100% 100% 100% 1 1 308 ./imaptest - logout=0 select=100 store=100 secs=10 seed=0 clients=5 Logi Sele Stor 100% 100% 100% 5 5 319 Zimbra gave lots of errors: Error: STORE failed: STORE failed APPEND ------ Appends to empty mailbox: Dovecot: 1 client, 5 seconds: 3959 mails 1 client, 5 seconds, fsync_disable=yes: 21889 mails Zimbra: 1 clients, 5 seconds: 222 mails 5 clients, 5 seconds: 322 mails Zimbra is apparently building full text search indexes while appending, so this test doesn't mean much until I can test Dovecot's performance with Squat indexing.

5 6

[Dovecot] squat plugin
by Joe Wong 29 Nov '07

29 Nov '07

Hello Timo, I have installed 1.1 beta 8 with fts-squat enabled. I have added the plugin section in dovecot.conf. How can I actually make use of the full text index? Regards, - Joe

2 2

[Dovecot] old mails
by Timo Sirainen 29 Nov '07

29 Nov '07

I just got a 6 months old mail to this list and wondered for a while why it happened. Looks like the old dovecot.org was rebooted and Postfix went up and started sending queued mails. So just ignore if you got those.

1 0

Re: [Dovecot] 1.1beta9 'make' fails on osx/Tiger
by Jerry Yeager 29 Nov '07

29 Nov '07

On Nov 28, 2007, at 1:39 PM, dovecot-request(a)dovecot.org wrote: > ------------------------------ > > Message: 7 > Date: Wed, 28 Nov 2007 10:38:19 -0800 > From: snowcrash <schneecrash+dovecot(a)gmail.com> > Subject: Re: [Dovecot] 1.1beta9 'make' fails on osx/Tiger > To: "Jerry Yeager" <jerry(a)scene-naturally.dyndns.org> > Cc: dovecot(a)dovecot.org > Message-ID: > <70f41ba20711281038q12499454o94a9a221e61c54b2(a)mail.gmail.com> > Content-Type: text/plain; charset=ISO-8859-1 > (stuff cut out) > > i'd gather tss would like to know about issues. (it shouldn't be > terribly surprising for a projects' beta release to at least be > _tried_ with _other_ projects' beta releases ...) > > cheers. > > That is usually a good idea, especially if you mention that you are using non standard stuff so that folks who are not aware of that can then get a better understanding of the issues. Or for the elucidation of the folks that are following the list trying to decide what efforts they will have to undertake to make the switch. p.s. The folks at AT&T also recommend that "you" use the newer version of gcc than the older-hacked-to-get-something-for-Tiger version of the Apple Leopard version they (AT&T) are providing -- it is further down the page where they provide links. Jerry

2 2

[Dovecot] autogen.sh fails -> "required file `./config.rpath' not found"
by snowcrash 29 Nov '07

29 Nov '07

if i run autogen.sh on fresh 1.1.beta9 source, it fails @ ./autogen.sh ... 100%[====================================>] 154,427 115.09K/s 08:45:56 (114.82 KB/s) - `wiki-export.tar.gz' saved [154427/154427] configure.in:16: required file `./config.rpath' not found configure.in:5: installing `./missing' configure.in:5: installing `./install-sh' src/auth/Makefile.am: installing `./depcomp' autoreconf: automake failed with exit status: 1 per advice, "gettext-related test failures: config.rpath presence" http://www.mail-archive.com/automake-patches@gnu.org/msg00426.html a simple touch config.rpath ./autogen.sh fixes the problem. hth

2 4

[Dovecot] spf record
by Jim Flowers 28 Nov '07

28 Nov '07

Your spf record is broken: dovecot.org. 39942 IN TXT "v=spf1 a -all" -- Jim Flowers <jflowers(a)ezo.net> -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.

12 20

Re: [Dovecot] 1.1beta9 'make' fails on osx/Tiger
by snowcrash 28 Nov '07

28 Nov '07

(Yes, Really .... w/ gcc v4.2.1, like i said in the first place) > Actually, the 1.1 beta v9 builds just fine under Tiger (PPC and > PPC64) if you use the official Apple sanctioned gcc v 4.01 they ship > with both Tiger and Leopard. If you do download and use gcc 4.2.1 from > the GNU folks you might want to pass along the error / bug reports to > them instead of Apple, but I suspect the GNU folks will tell you to > try the current 4.2.2 version or the new 4.3 version. i'm using Apple's gcc 4.2.1: http://www.opensource.apple.com/darwinsource/10.5/gcc_42-5531/ and the v4.2.1 Tiger equiv from the R-project provided at http://r.research.att.com/tools/ both Apple & ATT are _already_ well plugged into both .. er .. Apple & GNU. yes, 4.2.1 is "not distro" ... but it *is* up-n-coming, as evienced by the fact that it *is* offered on the darwinsource page. i'd gather tss would like to know about issues. (it shouldn't be terribly surprising for a projects' beta release to at least be _tried_ with _other_ projects' beta releases ...) cheers.

1 0

Re: [Dovecot] 1.1beta9 'make' fails on osx/Tiger (Not Really)
by Jerry Yeager 28 Nov '07

28 Nov '07

On Nov 28, 2007, at 10:59 AM, dovecot-request(a)dovecot.org wrote: > Message: 8 > Date: Wed, 28 Nov 2007 07:49:13 -0800 > From: snowcrash <schneecrash+dovecot(a)gmail.com> > Subject: Re: [Dovecot] 1.1beta9 'make' fails on osx/Tiger, but OK on > osx/Leopard (multiple definitions of symbol _hash_create) > To: "Timo Sirainen" <tss(a)iki.fi> > Cc: Dovecot Mailing List <dovecot(a)dovecot.org> > Message-ID: > <70f41ba20711280749k63a6b099obf09b687e5733422(a)mail.gmail.com> > Content-Type: text/plain; charset=ISO-8859-1 > >> (lots of messages from the digest snipped out) Actually, the 1.1 beta v9 builds just fine under Tiger (PPC and PPC64) if you use the official Apple sanctioned gcc v 4.01 they ship with both Tiger and Leopard. If you do download and use gcc 4.2.1 from the GNU folks you might want to pass along the error / bug reports to them instead of Apple, but I suspect the GNU folks will tell you to try the current 4.2.2 version or the new 4.3 version. Jerry

1 0

[Dovecot] 1.1beta9 'make' fails on osx/Tiger, but OK on osx/Leopard (multiple definitions of symbol _hash_create)
by snowcrash 28 Nov '07

28 Nov '07

i'm building dovecot 1.1.beta9 on both osx 10.4.11 osx 10.5.1 using Using built-in specs. Target: powerpc-apple-darwin8 Configured with: /Builds/apple/gcc_42-5531/obj/src/configure --disable-checking -enable-werror --prefix=/usr --mandir=/usr/share/man --enable-languages=c,objc,c++,obj-c++ --program-transform-name=/^[cg][^.-]*$/s/$/-4.2/ --with-gxx-include-dir=/usr/include/c++/4.0.0 --with-slibdir=/usr/lib --build=i686-apple-darwin8 --program-prefix= --host=powerpc-apple-darwin8 --target=powerpc-apple-darwin8 Thread model: posix gcc version 4.2.1 (Apple Inc. build 5531) on both boxes. configuring as Install prefix ...................... : /usr/local/dovecot File offsets ........................ : 64bit I/O loop method ..................... : kqueue File change notification method ..... : kqueue Building with SSL support ........... : yes (OpenSSL) Building with IPv6 support .......... : yes Building with pop3 server ........... : yes Building with mail delivery agent .. : yes Building with GSSAPI support ........ : no Building with user database modules . : static prefetch passwd passwd-file checkpassword sql Building with password lookup modules : passwd passwd-file pam checkpassword sql Building with SQL drivers ............:mysql sqlite is OK on both boxes. on Leopard, make completes without error. but, on Tiger, it fails @ make ... make[3]: Nothing to be done for `all'. Making all in master /bin/sh ../../libtool --tag=CC --mode=link gcc -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -I/usr/local/ssl/include -L/usr/local/db46/lib -L/usr/local/sqlite/lib -lsqlite3 -L/usr/local/mysql/lib/mysql -L/usr/local/lib -liconv -o dovecot auth-process.o askpass.o capabilities-posix.o child-process.o dict-process.o dup2-array.o listener.o log.o login-process.o mail-process.o main.o master-settings.o syslog-util.o ssl-init.o ../lib-settings/libsettings.a ../lib/liblib.a gcc -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -I/usr/local/ssl/include -o dovecot auth-process.o askpass.o capabilities-posix.o child-process.o dict-process.o dup2-array.o listener.o log.o login-process.o mail-process.o main.o master-settings.o syslog-util.o ssl-init.o -L/usr/local/db46/lib -L/usr/local/sqlite/lib /usr/local/sqlite/lib/libsqlite3.dylib -L/usr/local/lib -lreadline -lncurses -lpthread -L/usr/local/mysql/lib/mysql /usr/local/lib/libiconv.dylib ../lib-settings/libsettings.a ../lib/liblib.a /usr/libexec/gcc/powerpc-apple-darwin8/4.2.1/ld: multiple definitions of symbol _hash_create /usr/lib/gcc/powerpc-apple-darwin8/4.2.1/../../../libpthread.dylib(strhash.So) definition of _hash_create ../lib/liblib.a(hash.o) definition of _hash_create in section (__TEXT,__text) /usr/libexec/gcc/powerpc-apple-darwin8/4.2.1/ld: multiple definitions of symbol _hash_destroy /usr/lib/gcc/powerpc-apple-darwin8/4.2.1/../../../libpthread.dylib(strhash.So) definition of _hash_destroy ../lib/liblib.a(hash.o) definition of _hash_destroy in section (__TEXT,__text) collect2: ld returned 1 exit status make[3]: *** [dovecot] Error 1 make[2]: *** [all-recursive] Error 1 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 looks like problems with ot at all sure what in Tiger's causing this ... hints/suggestions? thanks!

3 14

Re: [Dovecot] imap process killed with signal 11
by Daniel 28 Nov '07

28 Nov '07

On Mon, 26 Nov 2007 14:49:01 +0200 Timo Sirainen <tss(a)iki.fi> wrote: > On Sun, 2007-11-25 at 13:39 +0000, Daniel wrote: > > Using the latest cvs from HEAD, I'm experiencing problems after > > sending a message and the client is trying upload the message to the > > appropriate (Sent/Queue) folder. I get only one error in > > dovecot.log: dovecot: Nov 25 14:21:31 Error: child 19554 (imap) > > killed with signal 11 > > Could you get gdb backtrace from this crash? Otherwise I can't really > do anything about it. See http://dovecot.org/bugreport.html > Sure: (gdb) bt full #0 0x1c04af71 in mail_cache_field_exists () No symbol table info available. #1 0x1c04cb4c in mail_cache_field_can_add () No symbol table info available. #2 0x1c041b9d in index_mail_cache_add_idx () No symbol table info available. #3 0x1c041c5c in index_mail_cache_add_idx () No symbol table info available. #4 0x1c04259d in index_mail_close () No symbol table info available. #5 0x1c04298a in index_mail_free () No symbol table info available. #6 0x1c0629cc in mail_free () No symbol table info available. #7 0x035b06ac in quota_mailbox_transaction_commit (ctx=0x8acfa700, uid_validity_r=0xcfbf928c, first_saved_uid_r=0xcfbf9290, last_saved_uid_r=0xcfbf9294) at quota-storage.c:100 qbox = (struct quota_mailbox *) 0x7e27b1e0 qt = (struct quota_transaction_context *) 0x87187bc0 #8 0x1c064810 in mailbox_transaction_commit_get_uids () No symbol table info available. #9 0x1c010a04 in __register_frame_info () No symbol table info available. #10 0x1c010c1c in __register_frame_info () No symbol table info available. #11 0x1c0103e3 in __register_frame_info () No symbol table info available. #12 0x1c078858 in io_loop_handler_run () No symbol table info available. #13 0x1c077e75 in io_loop_run () No symbol table info available. #14 0x1c01c158 in main () No symbol table info available. Is this useful? Daniel

2 2

[Dovecot] How to find an invalid configuration in dovecot.conf
by Laurent PELLISSIER 28 Nov '07

28 Nov '07

Hi, I'm trying to test Dovecot as an IMAP ans POP3 server but I ran into a fatal problem. On the client side (telnet) I'm trying very basic IMAP commands : $ telnet localhost imap Trying 127.0.0.1... Connected to localhost.localdomain (127.0.0.1). Escape character is '^]'. * OK Dovecot ready. 1 LOGIN lavande secret 1 OK Logged in. Connection closed by foreign host. The login succeeds but the connection hangs ! On the server side it complains that the configuration file dovecot.conf is invalid (it was copied from dovecot-example.conf) but it never tells what line number is incorrect. dovecot -a or dovecot -n doesn't complain about a syntax error or something. It works for POP3 for the same user/pass. # /opt/dovecot/sbin/dovecot -F -c /etc/dovecot.conf dovecot: Nov 28 15:43:42 Info: Dovecot v1.0.8 starting up dovecot: Nov 28 15:43:53 Info: imap-login: Login: user=<lavande>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot: Nov 28 15:43:53 Error: IMAP(lavande): Error: Dovecot is already running with PID 4369 (read from /opt/dovecot-1.0.8/var/run/dovecot/master.pid) dovecot: Nov 28 15:43:53 Error: IMAP(lavande): Fatal: Invalid configuration in /etc/dovecot.conf dovecot: Nov 28 15:43:53 Error: IMAP(lavande): Fatal: EOF while reading environment from master dovecot: Nov 28 15:43:53 Error: child 4380 (imap) returned error 89 Best regards, -- Laurent PELLISSIER @ Ecole des Mines d'Alès

2 3

[Dovecot] quick question about fs quota overhead in plugin
by Adam McDougall 28 Nov '07

28 Nov '07

Last night I enabled imap_quota so dovecot could report usage reported by disk quota. I don't intend to actually use the quota plugin to place any limits anytime soon though. How much overhead does this add to normal operations that allocate disk space? Ideally I'd like a situation where the only overhead is incurred when the user uses the mail client to specifically check their usage. Is that possible, and/or is there a better way to do this? If it does cause general overhead on the NFS filer, I could just accept it until/unless I feel it becomes a burden I cannot bear. mail_plugins = acl fts fts_squat quota imap_quota ... quota = fs ...

2 1

[Dovecot] v1.0.8 released
by Timo Sirainen 28 Nov '07

28 Nov '07

http://dovecot.org/releases/1.0/dovecot-1.0.8.tar.gz http://dovecot.org/releases/1.0/dovecot-1.0.8.tar.gz.sig + Authentication: Added "password_noscheme" field that can be used instead of "password". "password" treats "{prefix}" as a password scheme while "password_noscheme" treats it as part of the password itself. So "password_noscheme" should be used if you're storing passwords as plaintext. Non-plaintext passwords never begin with "{", so this isn't a problem with them. - IMAP: Partial body fetching was sometimes non-optimal, causing the entire message to be read for every FETCH command. - deliver failed to save the message when envelope sender address contained spaces. - Maildir++ quota: We could have randomly recalculated quota when it wasn't necessary. - Login process could have crashed after logging in if client sent data before "OK Logged in" reply was sent (i.e. before master had replied that login succeeded). - Don't assert-crash when reading dovecot.index.logs generated by Dovecot v1.1. - Authentication: Don't assert-crash if password beings with "{" but doesn't contain "}". - Authentication cache didn't work when using settings that changed the username (e.g. auth_username_format).

1 0

[Dovecot] IMAP --> Creating Folders --> trailing slash
by Andre Hübner 28 Nov '07

28 Nov '07

Hello List, i use Dovecot 1.0.7 for pop and imap on Suse Linux 10.1. I need a little help in understanding something. If i want to create a folder with outlook express or thunderbird which can also create subfolders, then i have to create these folders with a trailing slash. folders created with trailing slash are in filesystem created als real folders, "normal" folders are created as file. Is it possible to change this behavior? I want to create a folders just by typing a name without trailing slash. It should be possible to store messages in this folder or create subfolders. Is there any workaround to achieve this goal? Thank you Andre

2 1

[Dovecot] little submissions feature request
by Netskin | Corin Langosch 28 Nov '07

28 Nov '07

Hi! I'm using dovecot for a while now and really like it. Actually dovecot 1.5 on Debian AMD64. Now I have to use a cifs mounted maildir directory and found it to be quite slow, though I already tuned it a lot. The only way to get it fast was to put INDEX and CONTROL files on the local disc and so outside of the maildirs. Performance is great but the problem is with submissions to maildirs. When a CONTROL directive is given, dovecot writes the submissions file to this directory too. Now as I have two dovecots in a loadbalancer my users have to do their modifications to their subscriptions always twice (for each server in the loadbalancer). I now modified dovecot on my own to put the submissions file into the Maildir, everything else is unchanged. This works just great and as desired. Anything I missed in my setup, locking issues, ...? Otherwise it may worth adding a switch for this? A directive like INDEX, CONTROL... :SUBMISSSIONS=path... Regards, Corin

2 1

[Dovecot] 1.1.beta8 crashes with segfault when SIGHUP
by arvids 28 Nov '07

28 Nov '07

Hello, dovecot crashes when it receives -HUP signal. It happens always if there was some activity - for example, if I start dovecot, check any account through POP3 and then send -HUP to dovecot process, it crashes with the following log entry: segfault at 00000008 eip 0804d3fb esp bfdd3860 error 4 If there were no activity at all since starting, it does not crash. my dovecot -n output: # 1.1.beta8: /usr/local/dovecot/etc/dovecot.conf base_dir: /var/run/dovecot/ syslog_facility: local0 protocols: pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/local/dovecot/libexec/dovecot/pop3-login login_greeting: Server. login_process_per_connection: no login_process_size: 64 login_processes_count: 5 login_max_processes_count: 32 verbose_proctitle: yes first_valid_uid: 95 first_valid_gid: 95 mail_uid: 95 mail_gid: 95 mail_location: maildir:~/Maildir mail_debug: yes dotlock_use_excl: yes fsync_disable: yes mail_executable: /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins: quota mail_plugin_dir: /usr/local/dovecot/lib/dovecot/pop3 pop3_enable_last: yes pop3_client_workarounds: outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login digest-md5 cram-md5 apop cache_size: 4096 cache_ttl: 28800 cache_negative_ttl: 60 user: doveauth verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: dict:::proxy:/var/run/dovecot/dict-server:quotadict dict: quotadict: mysql:/usr/local/dovecot/etc/dovecot-sql-dict-quota.conf Regards, Arvids

2 2

[Dovecot] 1.1.beta9 deliver crashes with segfault
by arvids 28 Nov '07

28 Nov '07

Hello, after upgrade from beta8 to beta9 deliver process crashes with segfault. Deleting old maildirs does not help. Here is backtrace: Program received signal SIGSEGV, Segmentation fault. 0x0808e36d in mail_cache_field_get_decision (cache=0x8114da0, field_idx=128) at mail-cache-lookup.c:301 301 i_assert(field_idx < cache->fields_count); (gdb) bt #0 0x0808e36d in mail_cache_field_get_decision (cache=0x8114da0, field_idx=128) at mail-cache-lookup.c:301 #1 0x0808f351 in mail_cache_field_can_add (ctx=0x810ca58, seq=1, field_idx=4) at mail-cache-transaction.c:997 #2 0x0808351f in index_mail_want_cache (mail=0x810ce00, field=<value optimized out>) at index-mail.c:597 #3 0x08084046 in index_mail_cache_sizes (mail=0x810ce00) at index-mail.c:618 #4 0x080845a7 in index_mail_close (_mail=0x810ce00) at index-mail.c:971 #5 0x0808510e in index_mail_free (_mail=0x810ce00) at index-mail.c:1166 #6 0x080a8e20 in mail_free (mail=0x810cdcc) at mail.c:18 #7 0xb7e3dd3c in quota_mailbox_transaction_commit (ctx=0x810c6f8, uid_validity_r=0xbfedf444, first_saved_uid_r=0xbfedf444, last_saved_uid_r=0xbfedf444) at quota-storage.c:100 #8 0x080aa525 in mailbox_transaction_commit (t=0xbfedf484) at mail-storage.c:661 #9 0x08059304 in deliver_save (namespaces=0x80f1210, storage_r=0xbfedf558, mailbox=0x80d6918 "INBOX", mail=0x80f8260, flags=0, keywords=0x0) at deliver.c:146 #10 0x0805a6cd in main (argc=1301916, argv=0xbfedf614) at deliver.c:898 my dovecot -n output: # 1.1.beta9: /usr/local/dovecot/etc/dovecot.conf base_dir: /var/run/dovecot/ syslog_facility: local0 protocols: pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/local/dovecot/libexec/dovecot/pop3-login login_greeting: Server. login_process_per_connection: no login_processes_count: 5 login_max_processes_count: 32 verbose_proctitle: yes first_valid_uid: 95 first_valid_gid: 95 mail_uid: 95 mail_gid: 95 mail_location: maildir:~/Maildir mail_debug: yes dotlock_use_excl: yes fsync_disable: yes mail_executable: /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins: quota mail_plugin_dir: /usr/local/dovecot/lib/dovecot/pop3 pop3_enable_last: yes pop3_client_workarounds: outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login digest-md5 cram-md5 apop cache_size: 1024 cache_ttl: 600 cache_negative_ttl: 60 user: doveauth verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: dict:::proxy:/var/run/dovecot/dict-server:quotadict dict: quotadict: mysql:/usr/local/dovecot/etc/dovecot-sql-dict-quota.conf Regards, Arvids

2 1

[Dovecot] Can't login from Mac OS X Mail.app
by Mike McGonagle 28 Nov '07

28 Nov '07

Hello all, I have been working on getting this machine -- Peace may sound simple—one beautiful word— but it requires everything we have, every quality, every strength, every dream, every high ideal. —Yehudi Menuhin (1916–1999), musician

2 1

[Dovecot] Embracing .99
by Joe Allesi -X (joallesi - Coyote Creek Consulting at Cisco) 28 Nov '07

28 Nov '07

We're stuck on RHEL 4.x, so we're currently working on a plan to live in harmony with .99 for another year or so. With that said, the plan is below. Let me know if you have any other recommendations. [ ]Convert to high-performance mode vice high-security to reduce overall resource usage. [ ]Implement iptables throttling for new connections to prevent denials of service. [ ]Covert from mbox to maildir to help reduce the likelihood of corruption that lead to mailbox outages. As our overall individual mailbox usage is low, maildir seems to be a good option as mbox corruption has severely impacted a few of our high-profile applications. However, does anyone know of a sane method to use maildir on RHEL 4.x without switching over to Postfix? Thanks!

5 4

[Dovecot] Various uidlist and index errors with 1.1 on NFS
by Adam McDougall 28 Nov '07

28 Nov '07

Two nights ago I took a leap and extended my testing of dovecot 1.1 by replacing 1.0 for the approx 15 users I had on 1.0. At that time I also for the first time tried dovecot 1.1 in a load balanced 2 server configuration with indexes on NFS. I was hoping I did this right, using the mail_nfs params and 1.1 so fchown etc would flush the access cache, but I am getting a number of messages and errors that indicate things aren't happy. Attaching error logs. Some of the errors were caused by me running multiple mail clients including mutt, Thunderbird, Outlook Express, other users may be using one or more copies of thunderbird, or possibly other clients. Most commonly thunderbird. Any help or advice would be appreciated. My goal is to have shared indexes between servers since I will eventually have 4. I'd prefer to avoid maintaining some kind of user->server preference mapping in a proxy (haven't looked into it yet). Thanks. # 1.1.beta6: /usr/local/etc/dovecot.conf ssl_cert_file: /usr/local/etc/apache2/ssl/mail.pem ssl_key_file: /usr/local/etc/apache2/ssl/mail.pem login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_extra_groups: postlocal mail_location: maildir:%h/Maildir:CONTROL=%h/Maildir/dovecot/private/control:INDEX=%h/Maildir/dovecot/private/indexes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_plugins: acl mail_log_max_lines_per_sec: 0 imap_client_workarounds: delay-newmail netscape-eoh tb-extra-mailbox-sep namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: mail/ hidden: yes subscriptions: yes namespace: type: private separator: / prefix: Mail/ hidden: yes subscriptions: yes namespace: type: public separator: / prefix: #shared/decs/ location: maildir:/egr/mail/shared/decs:CONTROL=%h/Maildir/dovecot/public/control/decs:INDEX=%h/Maildir/dovecot/public/indexes/decs list: yes subscriptions: yes auth default: passdb: driver: pam userdb: driver: passwd args: system_user= socket: type: listen client: path: /var/spool/postfix/private/auth mode: 384 user: postfix group: postfix plugin: acl: vfile:/usr/local/etc/dovecot-acls:cache_secs=10

2 8

[Dovecot] Fwd: Re: Fwd: dovecot bug report (64 bit file offsets)
by markevich＠inbox.lv 27 Nov '07

27 Nov '07

Yes, the problem is the compatibility with the mysql library but I stull can't figure out how this might affect reading/writing. ---------- Forwarded message ---------- No: markevich(a)inbox.lv Kam: Marcus Rueckert <darix(a)opensu.se> Atbildt: markevich(a)inbox.lv Datums: Tue, 27 Nov 2007 14:15:29 +0200 Temats: Re: [Dovecot] Fwd: dovecot bug report (64 bit file offsets) I agree that it’s kind strange behavior. Also I’ve googled that exactly the same errors (unexpected eof found … on file ‘UNOPENED’) were related to mysql. But how mysql compile options might affect configuration file parsing and read/write operations? (indexes for example) Does any one have any idea why this might happen? “any slight change to the main dovecot.conf file can prevent dovecot from starting (segfault with "Unexpected eof found when reading file 'UNOPENED' (Errcode: 0)" message), whereas i386 packages work somewhat better.” http://dovecot.org/list/dovecot/2006-April/012340.html Regards, Andris Quoting Marcus Rueckert : which is funny actually as on opensuse (10.1 -> 10.3 -> factory) has no problem with dovecot running on x86_64. darix -- openSUSE - SUSE Linux is my linux openSUSE is good for you www.opensuse.org -- Tavs bezmaksas pasts Inbox.lv Links: ------ [1] mailto:darix@opensu.se ---------- End of forwarded message ---------- -- Tavs bezmaksas pasts Inbox.lv

1 0

[Dovecot] dovecot imap hangs
by russ 27 Nov '07

27 Nov '07

All, I recently did a fresh install/setup on centos 5 to replace my older courier-imap and all seemed to go well until today I started to notice that it simply hangs. I use thunderbird and squirrel mail and after a while it seems like I"m simply rejected. I'm almost guessing that it has to do with the session timing out and then dovecot is unwilling or unable to renew the session. I can't login and there is little or no information in the logs. I've set up a cron job to restart dovecot every 5 minutes to deal with this for now. I'm new to dovecot, what sort of info should I send to you guys? I'm using centos 5, qmail-ldap and Maildir for my mail format. OpenLDAP: slapd 2.3.27 dovecot-1.0-1.2.rc15.el5 my /etc/dovecot.conf =================== mail_location = maildir:%h namespace private { prefix = INBOX. inbox = yes } mail_debug = yes maildir_copy_with_hardlinks = yes auth default { mechanisms = plain passdb ldap { # Path for LDAP configuration file, see doc/dovecot-ldap.conf for example args = /etc/dovecot-ldap.conf } userdb ldap { args = /etc/dovecot-ldap.conf } } =================== my dovecot-ldap.conf =================== # This file is opened as root, so it should be owned by root and mode 0600. # # NOTE: If you're not using authentication binds, you'll need to give # dovecot-auth read access to userPassword field in the LDAP server. # With OpenLDAP this is done by modifying /etc/ldap/slapd.conf. There should # already be something like this: # access to attribute=userPassword # by dn="<dovecot's dn>" read # add this # by anonymous auth # by self write # by * none # Space separated list of LDAP hosts to use. host:port is allowed too. hosts =127.0.0.1:389 # LDAP URIs to use. You can use this instead of hosts list. Note that this # setting isn't supported by all LDAP libraries. #uris = # Distinguished Name - the username used to login to the LDAP server #dn = dn=cn=Manager,dc=cttechhosting,dc=net dnpass=secret # Password for LDAP server #dnpass = # Use SASL binding instead of the simple binding. Note that this changes # ldap_version automatically to be 3 if it's lower. Also note that SASL binds # and auth_bind=yes don't work together. #sasl_bind = no # SASL mechanism name to use. #sasl_mech = # SASL realm to use. #sasl_realm = # SASL authorization ID, ie. the dnpass is for this "master user", but the # dn is still the logged in user. Normally you want to keep this empty. #sasl_authz_id = # Use authentication binding for verifying password's validity. This works by # logging into LDAP server using the username and password given by client. # The pass_filter is used to find the DN for the user. Note that the pass_attrs # is still used, only the password field is ignored in it. Before doing any # search, the binding is switched back to the default DN. auth_bind = yes # If authentication binding is used, you can save one LDAP request per login # if users' DN can be specified with a common template. The template can use # the standard %variables (see user_filter). Note that you can't # use any pass_attrs if you use this setting. # # If you use this setting, it's a good idea to use a different # dovecot-ldap.conf for userdb (it can even be a symlink, just as long as the # filename is different in userdb's args). That way one connection is used only # for LDAP binds and another connection is used for user lookups. Otherwise # the binding is changed to the default DN before each user lookup. # # For example: # auth_bind_userdn = cn=%u,ou=people,o=org # auth_bind_userdn = uid=%u,ou=accounts,dc=cttechhosting,dc=net # LDAP protocol version to use. Likely 2 or 3. #ldap_version = 2 ldap_version=3 # LDAP base. %variables can be used here. base = ou=accounts,dc=cttechhosting,dc=net # Dereference: never, searching, finding, always #deref = never # Search scope: base, onelevel, subtree #scope = subtree # User attributes are given in LDAP-name=dovecot-internal-name list. The # internal names are: # uid - System UID # gid - System GID # home - Home directory # mail - Mail location # # There are also other special fields which can be returned, see # http://wiki.dovecot.org/UserDatabase/ExtraFields user_attrs = mailMessageStore=home,qmailUID=uid,qmailGID=gid,mailMessageStore=mail # Filter for user lookup. Some variables can be used (see # http://wiki.dovecot.org/Variables for full list): # %u - username # %n - user part in user@domain, same as %u if there's no domain # %d - domain part in user@domain, empty if user there's no domain user_filter = (&(objectClass=qmailUser)(uid=%u)) # Password checking attributes: # user: Virtual user name (user@domain), if you wish to change the # user-given username to something else # password: Password, may optionally start with {type}, eg. {crypt} # There are also other special fields which can be returned, see # http://wiki.dovecot.org/PasswordDatabase/ExtraFields pass_attrs = mail=user,userPassword=password # If you wish to avoid two LDAP lookups (passdb + userdb), you can use # userdb prefetch instead of userdb ldap in dovecot.conf. In that case you'll # also have to include user_attrs in pass_attrs field prefixed with "userdb_" # string. For example: #pass_attrs = uid=user,userPassword=password,homeDirectory=userdb_home,qmailUID=userdb_uid,qmailGID=userdb_gid # Filter for password lookups pass_filter = (&(objectClass=qmailUser)(uid=%u)) # Default password scheme. "{scheme}" before password overrides this. # List of supported schemes is in: http://wiki.dovecot.org/Authentication default_pass_scheme = LDAP-SHA # You can use same UID and GID for all user accounts if you really want to. # If the UID/GID is still found from LDAP reply, it overrides these values. #user_global_uid = ========================= #user_global_gid = ===================

4 6

[Dovecot] Fwd: dovecot bug report (64 bit file offsets)
by markevich＠inbox.lv 27 Nov '07

27 Nov '07

I have found similar problem: http://www.dovecot.org/list/dovecot/2007-January/018623.html "After configure remove HAVE_PREAD from config.h, recompile and see if it works." I think I figured out where might be the problem. If the binary is compiled in the 64bit environment and you want to use 64 bit file offset you must use 64 bit equivalents of the function. Of course if you are using open/pread (which are 32 bit compatible only) the whole program functionality will be broken. You must use open64/pread64 etc. Else macros _LARGE_FILE_API should be defined in order to use large files in other case nothing will work (random parsing errors and dead indexes will appear ). As I can see there is a big issue in the dovecot. http://publib.boulder.ibm.com/iseries/v5r2/ic2924/index.htm?info/apis/pread… Regards, Andris ---------- Forwarded message ---------- No: markevich(a)inbox.lv Kam: tss(a)iki.fi Reply-To: markevich(a)inbox.lv Date: Tue, 27 Nov 2007 10:45:23 +0200 Temats: dovecot bug report (64 bit file offsets) Hello. I found 2 issues while using dovecot in the 64-bit system. Before that I was using it on the Solaris 10 32bit and everything worked fine. First issue is that it's impossible to specify Openssl library directory, there is only possiblity to specify type gnutls/openssl. But if there are 2 versions of openssl installed it's hard to specify which one we want to use, we need to play with AUXLIBS and LD flags to prevent looking in un-needed locations. I'm suggesting to add new ./configure key like --with-ssl-dir like all other programs do (why dovecot hasn't it?). For example in FC8 openssl 0.9.8b is available in the packages but latest is 0.9.8.g, and it's impossible to compile dovecot with 0.9.8b because of the missing function in it which present in 0.9.8.g. Second and most serious bug is that it seems that dovecot is unable to use 64 file offsets correctly. First problem was that I as unable to launch dovecot at all - it gave a lot of configuration file (dovecot.conf) parsing errors (which is working perfectly on the 32 bit Solaris). It was very strange because he complained that he is expecting to see '=' in the line where only comments are located. Deleting some lines at the start of the configuration file produced the error on random lines (I can't describe it in other way) but with the comments too. For example, first error complained that line 42 is incorrect (only comments are there), after deletion of 2 empty lines at the beginning dovecot complained that line 172 has errors but any way there are only comments there too. I've deleted all of the comments from the configuration file but still dovecot randomly is giving such errors. Any way dovecot is UNABLE to parse all my file, I can see it from dovecot -n. He is starting normally (time to time) but only half of the configuration file is read. Similar problems goes with the indexes dovecot.index.log - dovecot is able to create the files but is unable to read them after any access to it dovecot generates errors like unexpected eof found and file is corrupted. From all this I can assume that 64bit file offsets on a 64 bit system aren't working at all. Latest dovecot 1.0.7 (also tried 1.0.5) Fedora core 8 64bit (with latest patches and updates) Intel core duo 6300 (x86_64) XFS (only local filesystem) Regards, Andris

2 3

[Dovecot] dovecot with ldap and allow_nets
by Marc Cuypers 27 Nov '07

27 Nov '07

Hi, I'm using dovecot on debian etch: ||/ Name Version ii dovecot-common 1.0.rc15-2etch1 ii dovecot-imapd 1.0.rc15-2etch1 ii dovecot-pop3d 1.0.rc15-2etch1 # dovecot --version 1.0.rc15 Now here is my question. Some of the mail users may only login from the LAN, while others can login from the LAN and the internet. I've read about allow_nets but i can't find very much info when dovecot is used with ldap. Can someone give me a direction (url, configuration file, ...). Thanks in advance. -- Best regards, Marc

3 9

[Dovecot] quota rewrite patch
by pawel.panek＠inet.pl 27 Nov '07

27 Nov '07

Hi, Can quota-rewrite-1.0.2.diff patch be applied to 1.0.5 or later versions? Anyone has tested it with 1.0.5 or 1.0.7 versions? Pawel --------------------------------------------------------------- Wiadomosc wyslana z panelu pocztowego iNet. http://www.inet.pl

3 3

[Dovecot] telnet virtual users
by jan gestre 27 Nov '07

27 Nov '07

Hi Guys, I've installed postfix + dovecot + postfixadmin + mysql in my CentOS 4.5 box and I would like to test it using telnet however I can't telnet it using the following syntax: $ telnet localhost pop3 Trying 127.0.0.1... Connected to localhost.localdomain (127.0.0.1). Escape character is '^]'. +OK Dovecot ready. user testuser(a)domain.com pass password -ERR Authentication failed. I've also telnet it using imap to no avail. Is there another way to do this? TIA

3 2

[Dovecot] Dovecots Deliver being to verbose
by Dominik Schulz 27 Nov '07

27 Nov '07

Hi, I've got dovecot 1.0rc15 running on a Debian etch box toegether with deliver and exim4 backend by a mysql userdb. Everythin is working fine, except that deliver is much to verbose. It prints lots of information, including the password, for every mail delivered to the syslog. The problem here is that I don't wan't the password to be printed to a log somewhere. How can I turn this off? Relevant log entrys below. Best Regards Dominik Example from delivers logfile: deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: auth input: user(a)host.tld deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: auth input: user=user(a)host.tld deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: auth input: password=password deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: auth input: home=/home/mail/host.tld/user deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: auth input: uid=8 deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: auth input: gid=8 deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: Loading modules from directory: /usr/lib/dovecot/modules/lda deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: Module loaded: /usr/lib/dovecot/modules/lda/lib90_cmusieve_plugin.so deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: maildir: data=/home/mail/host.tld/user/Maildir deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: maildir: root=/home/mail/host.tld/user/Maildir, index=/home/mail/host.tld/user/Maildir, control=, inbox= deliver(user(a)host.tld): "2007-11-26 19:37:40 "Info: cmusieve: Using sieve path: /home/mail/host.tld/user/.dovecot.sieve deliver(user(a)host.tld): "2007-11-26 19:37:42 "Info: msgid=<49403.129.98.4.165.1196102178.squirrel(a)mail.host.com>: saved mail to dovecot Dovecot.conf w/o comments: base_dir = /var/run/dovecot/ protocols = imap imaps pop3 pop3s disable_plaintext_auth = no shutdown_clients = yes log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " ssl_disable = no ssl_cert_file = /etc/ssl/certs/cert.crt ssl_key_file = /etc/ssl/certs/key.pem ssl_parameters_regenerate = 168 ssl_cipher_list = ALL:!LOW login_dir = /var/run/dovecot/login login_chroot = yes login_user = dovecot login_process_size = 32 login_process_per_connection = yes login_processes_count = 3 login_max_processes_count = 128 login_max_connections = 256 login_greeting = Mailserver (powered by Dovecot) ready. mail_location = maildir:/home/mail/%d/%n/Maildir namespace private { separator = prefix = location = inbox = yes } mail_extra_groups = mail mail_debug = no first_valid_uid = 8 last_valid_uid = 8 max_mail_processes = 1024 mail_process_size = 256 mail_max_keyword_length = 50 umask = 0077 mbox_read_locks = fcntl mbox_write_locks = dotlock fcntl mbox_dotlock_change_timeout = 120 protocol imap { imap_max_line_length = 65536 login_greeting_capability = yes } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol lda { postmaster_address = postmaster(a)host.tld mail_plugin_dir = /usr/lib/dovecot/modules/lda sendmail_path = /usr/lib/sendmail auth_socket_path = /var/run/dovecot/auth-master mail_plugins = cmusieve } auth_process_size = 256 auth_cache_size = 256 auth_cache_ttl = 3600 auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_verbose = no auth_debug = no auth_debug_passwords = no auth default { mechanisms = plain passdb pam { } passdb sql { args = /etc/dovecot/dovecot-sql.conf } userdb passwd { } userdb prefetch { } userdb sql { args = /etc/dovecot/dovecot-sql.conf } user = root socket listen { master { path = /var/run/dovecot/auth-master mode = 0600 } client { path = /var/run/dovecot/auth-client mode = 0600 user = mail group = mail } } } dict { } plugin { }

2 1

[Dovecot] Mailbox is in inconsistent state
by Dion Hollenbeck 27 Nov '07

27 Nov '07

Running on Fedora 7, error happening on both Dovecot 1.05, and now that I upgraded to 1.07, same thing occurs. dovecot -n # 1.0.7: /etc/dovecot.conf login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd Email client(s): Eudora 7.0.1 on XP and 6.2.x on NT both do the same thing. Protocol: POP3 Symptom: 1 - On Linux, fetchmail is bringing mail down from ISP and running it through SpamAssasin to remove spam. 2 - Still on Linux, I use Pine 4.64 to manually remove any spam or viruses not caught by SA. Exit Pine. 3 - On windoze, with Eurora, check for new mail, "ERR Mailbox is in inconsistent state, please relogin" 4 - Check for new mail second time, works perfectly. 5 - Use Pine again with new mail having arrived, same error occurs. 6 - Do not use Pine in between and error does not occur. I have tried searching the mailing list archives for this error, but it only is mentioned in conjunction with IMAP. Noticed that UIDs of some value can cause the problem. My actual user IDs start with 500, which according to dovecot.conf is the default allowable. I have made no changes to dovecot.conf at all. I also tried looking at the log, but it appears to be a binary (located in /home/<username>/mail/.imap/INBOX/dovecot.index.log) not a readable text file. thanks, dion -- Dion Hollenbeck Email: hollen(a)woodsprite.com Home Page: http://www.woodsprite.com Brewing Page: http://hbd.org/hollen Toys: 98 4Runner, 86 4x4 PU

2 5

[Dovecot] Dovecot + Cygwin
by Ronny 26 Nov '07

26 Nov '07

Hey guys, does somebody get dovecot work under cygwin? The compilation finish without any problems. But after trying to run dovecot i got this in my log: dovecot: Nov 17 02:40:18 Info: Dovecot v1.0.7 starting up dovecot: Nov 17 02:40:19 Fatal: setrlimit(RLIMIT_DATA, 256): Invalid argument dovecot: Nov 17 02:40:19 Error: Auth process died too early - shutting down dovecot: Nov 17 02:40:19 Error: child 1452 (auth) returned error 89 setting auth_process_size to another value didn't fixed this issue. Thanks for any help Greets $ /sbin/dovecot -n # 1.0.7: /etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/dovecot.log ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable: /libexec/dovecot/imap-login login_user: Administrator mail_location: maildir:~/Maildir auth default: user: Administrator passdb: driver: passwd-file args: /etc/passwd.dovecot userdb: driver: passwd

2 10

Re: [Dovecot] v1.1.beta9 released
by lenny＠edpausa.com 26 Nov '07

26 Nov '07

> http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta9.tar.gz > http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta9.tar.gz.sig > > Some changes since beta8: > > - This release should work perfectly with NFS attribute cache enabled. > - Fixes to handling what should be written to cache file and when > - Some index handling optimizations > - IMAP LIST: dbox and cydir can now return children state > > Beta9 will most likely have a rewritten Squat indexer. More about that > the next mail. > > build errors. solaris 9, sparc, sun studio 9 and 12. source='base64.c' object='base64.o' libtool=no \ DEPDIR=.deps depmode=none /bin/bash ../../depcomp \ cc -DHAVE_CONFIG_H -I. -I. -I../.. -I/opt/SUNWconn/crypto/include -xjobs=4 -c base64.c "base64.c", line 96: syntax error before or at: ) "base64.c", line 105: syntax error before or at: ) "base64.c", line 107: "break" outside loop or switch "base64.c", line 108: cannot recover from previous errors cc: acomp failed for base64.c *** Error code 2 make: Fatal error: Command failed for target `base64.o'

2 1

[Dovecot] File locking problems and duplicate emails with the snarf plugin
by Adrian Barker 26 Nov '07

26 Nov '07

Two weeks ago we switched all our IMAP users (around 25,000) from the Washington IMAP server to Dovecot, and since then there have been several occasions when reading new email just hangs, and duplicate emails appear. We are using the 'snarf' plugin to copy new email to the inbox, and it looks as though the problems are caused by file locking. We have been using the Washington IMAP server for a number of years without any file locking problems, so the underlying file locking mechanism is robust. Has anyone else seen this problem ? Our IMAP servers (5 of them) are a mixture of Sparc Solaris 8 and Solaris 10 machines, and they use NFS to a central mailspool running on AIX. We are using a mixture of Dovecot 1.0.3 and 1.0.5. Any help would be appreciated, as the problem has caused a lot of disruption, but we are reluctant to revert to the Washington IMAP server because of the performance improvements with Dovecot - there has been a reduction of over 60% in NFS accesses to the filestore. dovecot -n gives: # 1.0.3: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ listen: *:143 ssl_listen: *:993 ssl_ca_file: /usr/local/ssl/certs/sureserveredu.pem ssl_cert_file: /usr/local/ssl/certs/imap-server_ucl_ac_uk.crt ssl_key_file: /usr/local/ssl/certs/imap.key ssl_cipher_list: MEDIUM:!LOW disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable: /usr/local/libexec/dovecot/imap-login login_user: pp login_process_per_connection: no login_processes_count: 30 max_mail_processes: 1500 first_valid_uid: 200 mail_location: mbox:%h/imap-mail:INBOX=/nfs/rcs/mail-spool/mail/%u mmap_disable: yes mbox_lock_timeout: 55 mbox_dotlock_change_timeout: 50 mail_drop_priv_before_exec: yes mail_executable: /usr/local/sbin/dovecot-login.csh mail_plugins: mbox_snarf mail_plugin_dir: /usr/local/lib/dovecot namespace: type: private separator: / inbox: yes auth default: passdb: driver: pam passdb: driver: passwd userdb: driver: passwd plugin: mbox_snarf: ~/imap-mail/mbox -- Adrian Barker, Internet Technology Section Information Systems University College London, Gower Street, London WC1E 6BT External phone: +44 20 7679 5140, Fax (+44) 20 7388 5406 Internal phone: x 25140 Email: A.Barker(a)ucl.ac.uk

2 2

[Dovecot] Some dovecot conf parameters
by Proskurin Kirill 26 Nov '07

26 Nov '07

Hello all! First of all - sorry for my english. :-) Im working now on migration from cyrus to dovecot(v1.07). Everything work`s fine for now, but some parameters at dovecot conf a mystical for me. :-) dovecot-ldap.conf: user_attrs = mail #,homeDirectory,,,, user_filter = (&(objectClass=qmailUser)(mail=%u)) pass_attrs = mail,userPassword=password pass_filter = (&(objectClass=qmailUser)(mail=%u)) What does this parameters mean? Im understand what mean a *_filter, but im do not understand a *_attrs. Yes, im read a http://wiki.dovecot.org/AuthDatabase/LDAP and http://wiki.dovecot.org/PasswordDatabase/ExtraFields But don`t understand it. :-( Ask you for help, or just say what im read this wiki again and again. --- Best regards, Proskurin Kirill

2 2

[Dovecot] Ldap Proxy
by Harrison Metzger 26 Nov '07

26 Nov '07

Hello I'm trying to do an ldap proxy but it is not working, it just continues to access the user's mailbox. I was able to do a proxy with a user in a "passwd-file", but not ldap directory. Here is part my "args" file on the passdb ldap stanza: base = dc=example,dc=com auth_bind = yes pass_filter = (&(objectClass=BCMailAccount)(BCMailEnable=true)(BCMailDovecotEnable=true)(uid=%u)(BCMailDovecotProxyHost=*)) pass_attrs = uid=user,proxy,BCMailDovecotProxyHost=host I've turned on auth_verbose, debug, etc and still can't figure out why it wont proxy. Ive tried adding user_attrs (the same as the pass attrs). I've even just put nologin in the pass_attrs but the user is still able to login, its like that field is not being processed. Harrison Metzger

2 5

[Dovecot] upgrade from version 1.0.3 to version 1.0.7
by dhottinger＠harrisonburg.k12.va.us 26 Nov '07

26 Nov '07

Im working on upgrading to dovecot-1.0.7 from version 1.0.3 which I installed using yum. I backed up my init.d stuff so everything still works. However, when I shutdown my old dovecot version and start the new, I get an empty mailbox when logging into mail. My current config for dovecot.conf on version 1.0.3 has this for my mailbox location:mail_location = mbox:~/:INBOX=/var/mail/%u I went from uw-imap to dovecot some months ago and necessary changes to the .mailboxlist to .subscriptions. Is there a different format for version 1.0.7? -- Dwayne Hottinger Network Administrator Harrisonburg City Public Schools "rarely do people communicate, they just take turns talking"

2 4

[Dovecot] v1.1.beta9 released
by Timo Sirainen 26 Nov '07

26 Nov '07

http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta9.tar.gz http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta9.tar.gz.sig Some changes since beta8: - This release should work perfectly with NFS attribute cache enabled. - Fixes to handling what should be written to cache file and when - Some index handling optimizations - IMAP LIST: dbox and cydir can now return children state Beta9 will most likely have a rewritten Squat indexer. More about that the next mail.

2 2

[Dovecot] NFS lock tester
by Timo Sirainen 26 Nov '07

26 Nov '07

Anyone who has NFS, could you test: http://dovecot.org/tmp/locktest.c 1. Compile: gcc locktest.c -o locktest -Wall -g 2. Start in server 1: ./locktest temp1 3. Start in server 2: ./locktest temp2 4. Server 1 might log "unlink() failed" error after starting the second locktest, ignore that. It starts writing something like: 1 successes 12 successes link() succeeded, but link count=1 12 successes What I'd like to know is what OS you use on your NFS clients, what NFS server you use and what errors does it give (errors being those "link() succeeded/failed, but .." messages). I'm getting that "link() succeeded, but link count=1" error with FreeBSD 6.2. So I'd like to know if this is a FreeBSD bug, NFS server bug or a more common NFS problem that I should work around..

4 6

[Dovecot] Small typo
by Abhijit Hoskeri 26 Nov '07

26 Nov '07

Hi, There is a small typo in src/lib/network.c line 624 return "A non-recovable name server error occurred"; should be return "A non-recoverable name server error occurred"; Sorry about the pedantry. BTW, I am getting this error whenever I am trying to resolve a name from inside dovecot, but I can using the system tools. I am trying to get the proxying code to use hostnames as well as IP addresses. -Abhijit.

2 7

[Dovecot] Wanting to seperate MTA and Imap
by Brent Clark 26 Nov '07

26 Nov '07

Hi Current my set up is that the MTA and Dovecot (maildir) is on the same machine. Ive been asked to seperate the services from the same machine (too would like to add a secondary MTA - but thats future ideas). I read the documentation on NFS, but from other sites i have read. Most say this is NOT the best solution. My question is, how do some of the fellow dovecot users,or other companys, e.g. google etc, pull this off. If you can assist in helping me fine a solution and too help me understand, I would greatfully appreciate it. Kind Regards Brent Clark

5 4

[Dovecot] libwrap-ing IMAP and POP logins
by Edgar Fuß 26 Nov '07

26 Nov '07

Since I've been using this for maybe a year now, maybe someone else is interested in restricting IMAP and POP logins via libwrap. In addition to the attached patch (against 1.0.5) to src/login-common/main.c, src/{imap,pop3}-login/Makefile.in have to be modified to link against libwrap. Of course, the option needs to be integrated into configure in the long run.

2 2

[Dovecot] Sieve regex never matches
by frank.kintrup＠fkware.de 26 Nov '07

26 Nov '07

Hi, I found the following code on the net which should redirect all mails to another address depending on the time of day (useful for forwarding mails to work): require ["regex"]; if allof (header :regex "date" "(08|09|10|11|12|13|14|15|16|17):..:..", not header :regex "date" "(sat|sun)") { redirect "address@work>"; keep; } To check and test I simplified the regex to match all mails within a certain hour: require ["regex"]; if header :regex "date" "20:..:.." { redirect "user@domain"; keep; } Both scripts compile fine, but their regex never match. Has anyone an idea why? I'm using Dovecot 1.0.0 on Debian Etch stable. Frank

3 2

[Dovecot] passdb ldap static values
by Harrison Metzger 26 Nov '07

26 Nov '07

Hello, In the pass_attrs field one can map ldap attributes to dovecot attributes. I'm wondering if I can map both ldap attribuets and static attributes to a dovecot value in the same passdb section. Also, I can't seem to find what other values (if any) can belong in the: passdb ldap { args = /path/filename } stanza. Are there any other options I can put in that stanza, I can't seem to find any on the wiki. Harrison Metzger

2 1

[Dovecot] Disconnected: Mailbox is in inconsistent state, please relogin
by Kleyton M. 26 Nov '07

26 Nov '07

Bom dia, Pessoal eu tenho um servidor HP Proliant ML 110 com 4gb de memoria e processador Xeon. Minha distribuição é um Fedora Core 7 com Postfix + Procmail e este chama Spanassasim e Clamav Para IMAP, POP3 utilizo dovecot. Estava tendo o erro de Corrupted dovecot.index, atualizei da versao 1.05 para a 1.07 Agora o mesmo problema ocorre algumas messagens ficam presas na caixa e o usuario nao recebe atraves do outlook 2000 (pop3) e quando logo via IMAP alguns usuarios tem menssagens nao lidas que nao foram entregues por pop3 e no Maillog aparece: Nov 23 09:00:43 golf dovecot: IMAP(everli): Maildir /home/everli/Maildir sync: UID < next_uid (89 < 90, file = msg.BAwd:2,) Nov 23 09:00:43 golf dovecot: IMAP(everli): Disconnected: Mailbox is in inconsistent state, please relogin. Apos isso relogando ou clicando novamente na caixa de entrada e deslogando o dovecot entrega via POP3 essas menssagens nao lidas. Porque isso ? como resolvo esse problema pois a maioria utiliza outlook e não o IMAP Cordialmente; Kleyton Maia dos Santos ____________________________________________________________________________________ Get easy, one-click access to your favorites. Make Yahoo! your homepage. http://www.yahoo.com/r/hs

2 1

[Dovecot] imap process killed with signal 11
by Daniel 26 Nov '07

26 Nov '07

Hi! Using the latest cvs from HEAD, I'm experiencing problems after sending a message and the client is trying upload the message to the appropriate (Sent/Queue) folder. I get only one error in dovecot.log: dovecot: Nov 25 14:21:31 Error: child 19554 (imap) killed with signal 11 So my client disconnects, and asks for the password again, and in dovecot.info I get nothing, but the logs of the new connection attempt. What else info should I provide? System is OpenBSD 4.2 $ dovecot -n # 1.1.beta8: /etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/mail/dovecot.log info_log_path: /var/log/mail/dovecot.info protocols: pop3 pop3s imap listen: 212.92.15.17 ssl_cert_file: /etc/ssl/dovecot_cert.pem ssl_key_file: /etc/ssl/private/dovecot_key.pem login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: _dovecot login_processes_count: 1 login_max_processes_count: 10 max_mail_processes: 100 first_valid_uid: 8000 first_valid_gid: 8000 mail_location: maildir:~/Maildir/ mail_debug: yes dotlock_use_excl: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins: quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): tb-extra-mailbox-sep imap_client_workarounds(imap): tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain digest-md5 ntlm user: _dv_auth master_user_separator: * verbose: yes passdb: driver: passwd-file args: /etc/dovecot.passdb_master pass: yes master: yes passdb: driver: passwd-file args: /etc/dovecot.passdb userdb: driver: passwd-file args: /etc/dovecot.userdb socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: _postfix group: _postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: vmail plugin: quota: maildir quota_rule: *:storage=100M quota_rule2: Trash:storage=50M -- Lévai Dániel Key ID: 0x4AC0A4B1 (wwwkeys.eu.pgp.net) Fingerprint: D037 03B9 C12D D338 4412 2D83 1373 917A 4AC0 A4B1

2 1

[Dovecot] recalculation of maildir Quota
by Ingo Rogalsky 26 Nov '07

26 Nov '07

Hello, I intend to use maildir Quota for measurement only, not for applying restrictions. Therefore I defined rather high values. That's working as expected. Nevertheless it's not useful, because the recalculation time is to high. This takes some minutes for my own mailaccount with 250.000 mails on a NFS storage. This would be to bad, but whilst this time, the Mailclient hangs. Probably our users woulnd't accept this. Can this be done in the background? Furthermore I noticed that recalculation occurs after the file maildirsize gets longer than 30 lines (around 250-300 bytes) and not after 5120 bytes as the wiki states. Do I do/understand something wrong or is this a bug? Probably a nightly cronjob, which does calculation of Maildir-size would be a more useful alternative. Regards, Ingo Rogalsky

5 6

[Dovecot] migrating from mbox to maildir
by Erick Perez 26 Nov '07

26 Nov '07

Hi all, I have a locking problem in a Centos 4.4 linux machine with the following config: dovecot-0.99.11-8.EL4 postfix-2.2.10-1.1.el4 I use virtual mailboxes with postfix currently I have dovecot with mbox as this: default_mail_env = mbox:/var/mail/virtualmail/%d/%n The problem is that mail is being delivered to mailboxes very very slowly (sometimes up to 4 hours). In my logs, I have tons of these messages: mail postfix/virtual[24965]: CFB8878D04F: to=<REMOVED@REMOVED>, relay=virtual, delay=51, status=deferred (mailbox /var/spool/mail/virtualmail/REMOVEDDOMAINNAME/npitti: unable to lock for exclusive access: Resource temporarily unavailable) then someone told me that I need to change dovecot to maildir format. Is there a reference to change format? Or some comments about this? Thanks in advance.

5 6

[Dovecot] overquota message
by Emiliano Gabrielli (aka AlberT) 26 Nov '07

26 Nov '07

Hi, is it possible to customize the overquota message ? I'd like very much if it was possible to use the %d in the postmaster mail address (and overquota message) too ... in virtual domain environment it is very likely .. thanks in advance -- <?php echo ' Emiliano Gabrielli (aka AlberT) ',"\n", ' GrUSP founder - ZCE ',"\n", ' AlberT_at_SuperAlberT_it - www.SuperAlberT.it ',"\n", ' IRC: #php,#AES azzurra.com ',"\n",'ICQ: 158591185'; ?>

2 1

[Dovecot] Squat full text search indexer redesign
by Timo Sirainen 26 Nov '07

26 Nov '07

I was writing this to beta9 announcement, but it grew so huge that I guess a separate mail is better. :) I've spent quite a lot of time this last week redesigning/rewriting Squat indexer. I think the redesign is good enough now that I'll just replace the existing squat with this new one in next release. I don't think many people are using the old squat, and there are also some bugs in it that cause some searches not to find anything (haven't tried to fix it). The old Squat indexes about 3MB/s on my machine while the new one indexes 8MB/s. Or it's actually 10MB/s, but at the end of indexing it does a compression step that merges all fragmented UID lists. That drops the index size something like 5-10%, but it's pretty slow because it has to go through all the fragmented lists. It could probably be optimized to be a lot faster, but I think I'll forget about it for now. Besides being faster there are other improvements in it: - Old squat could answer only 4 character long substring searches. New squat can answer 1..n characters long substring searches, where n can be configurable. The larger the n, the larger the index size. For example 4..10 index sizes are about 35% -> 46% -> 53% -> 59% -> 63% -> 67% -> 70% of the mailbox size (with 32MB of Dovecot mailing list archives). With both old and new squat if the search keyword is longer than n, Dovecot looks up the list of all possible n char long combinations of the word, gets a list of their common UIDs and then reads those mails to verify that the word is really found from them. - New squat can also be configured to index longer words for non-substring searches. This allows it to give a definite list of UIDs where the word is found, so Dovecot doesn't have to open those mails to verify it. However it can't give a definite list of UIDs where the substring isn't found. So it still has to do the n-char-combination lookup described above, and for those returned UIDs which aren't also in the definite-UIDs list Dovecot still has to read them to check if the substring is found or not. This could be skipped for non-standard X-FAST-TEXT and X-FAST-BODY searches which don't try to search substrings. Adding 255 char long non-substring searches to 4 char long substring searches grows the index about 7% (35%->42% for 32MB, 28%->36% for 200MB, 27%->33% for 1,4GB). Unfortunately it also grows memory usage pretty much. For a 200MB mailbox heap usage grows from 34MB to 163MB. For 1,4GB lkml mailbox heap usage grows from 80MB to 700MB. So I'm not sure if this should be enabled by default until something can be done about the memory usage. - The current list of indexed characters are: A-Z, 0-9, @.-+#$%_& and all 8bit chars. When trying to search for non-indexed characters Dovecot has to split the search word. For example "a,b" would search "a" and "b", combine the results and then open those mails to see where it really exists. The same thing happens with "a b". If the search word doesn't contain any indexable characters, Dovecot has to read all mails. This indexable character list could be changed runtime, so if a user keeps searching for some non-indexed character, it could be added to indexed characters and the index be rebuilt. - To be able to give definite replies for BODY searches squat has to keep track of whether a word was found from body or header. This also optimizes HEADER searches because then Dovecot has to search only those mails that have the word in their headers, instead of the mails that have it in either header or body. Unfortunately this makes the indexes somewhat larger again (22%->28% for 200MB), but I think this should be done by default. The header+body is stored by storing UID 1=message 1 header, UID 2=message 1 body, UID 3=message 2 header, etc. I haven't yet tried how well the UID lists could be compressed if could support only-header or only-body ranges. For example now if word is found from all headers but from no bodies, it stores the UID list as 1,3,5,7,etc, while it could be stored as simple "only bodies, 1:7". I guess the UID list compression could use all kinds of other algorithms as well. Currently it supports only the whole list being either a bitmask or UID range. A long UID list might compress better as a bitmask +range combination. UID lists take most of the Squat space, so even small improvements can give huge benefits. If you're interested in trying, you can download the current test code and modify uidlist_write_array() for writing and node_uidlist_get_at_offset() for reading. http://dovecot.org/tmp/test.c http://dovecot.org/tmp/test-uidlist.c Place to src/plugins/fts-squat/, run with ./test some-mbox-file Another somewhat different idea to substring indexing (suggested to me by someone else) would be to index the messages' words normally like most indexers do, and then use Squat indexes for those words. So for example when searching for "ord" it first looks up all words that contain "ord" substring in them. Then it looks up message UIDs for those words, and the resulting UID list is a definite list of messages that has the substring. I'm not sure how well the above would work in practise. If the list of words would be mostly static it would work great. Unfortunately every mail has at least two unique strings: Message-ID and Received header's ESMTP ID. Dovecot must be able to search those as well. Also with some languages, like Finnish, a single word can be written in tens of different ways and combined with other words. A quick preliminary testing for 32MB Dovecot mailing list shows: - 142265 unique words takes 2,0MB, one per line - indexing those words creates 6,7MB Squat indexes So not including extra overhead for the unique word index, these use a total of 8,8MB. 4-char-substring Squat indexes for the same mailbox take 8,5MB and 4-char-substring+255-char-full-word Squat indexes take 11MB. So this doesn't look very promising.

1 0

[Dovecot] Configuration Error
by Mike McGonagle 26 Nov '07

26 Nov '07

Hello, I am a newbie when it comes to Dovecot, and in following this ( http://workaround.org/articles/ispmail-etch/ ) document in setting these things up, I have run into an error that I am not quite certain what to do... I am running Ubuntu Gutsy Gibbon, and using 1.0.5 for Dovecot. The message I am getting when I try to 'restart' Dovecot (using '/etc/init.d/dovecot restart') is: Error: Error in configuration file /etc/dovecot/dovecot.conf line 505: Protocol section not allowed here (section changed at line 505) Fatal: Invalid configuration in /etc/dovecot/dovecot.conf ...fail! Does this mean that I need to move this section of the configuration file to a different spot in the file? All I did was uncomment these things, and make the changes described in the link above, I would think that because this is just an edited version of the configuration file, that something like this shouldn't happen. Any help would be appreciated. Thank you, Mike -- Peace may sound simple—one beautiful word— but it requires everything we have, every quality, every strength, every dream, every high ideal. —Yehudi Menuhin (1916–1999), musician

1 1

[Dovecot] Migrating from 0.99 to 1.0 - questions before upgrading
by Erick Perez 25 Nov '07

25 Nov '07

I order to investigate a locking problem, people in this forum suggested to upgrade from 0.99 to 1.0. Which is obviously a good response. However I have some special setup in dovecot.conf and I want to know if I will break something if I upgrade. So, here is my dovecot.conf 0.99 Note: Here are the only changes I made, the rest of the parameters were not touched and are #commented protocols = imap pop3 imaps pop3s imap_listen = * pop3_listen = * imaps_listen = * pop3s_listen = * ssl_disable = no log_path = /var/log/dovecot.log login_dir = /var/run/dovecot-login ## ## IMAP login process ## login = imap login_process_per_connection = no ## ## POP3 login process ## login = pop3 mail_extra_groups = mail postfix 1000 default_mail_env = mbox:/var/mail/virtualmail/%d/%n client_workarounds = oe6-fetch-no-newmail outlook-idle outlook-pop3-no-nuls mbox_locks = fcntl # Authentication process name. auth = default auth_mechanisms = plain auth_userdb = static uid=1000 gid=1000 home=/var/mail/virtualmail/%d/%u auth_passdb = passwd-file /etc/postfix/dovecotpasswd auth_user = root auth_verbose = yes Thanks in advance for your help Erick Perez

2 1

Re: [Dovecot] Problems reading mbox mail boxes.
by James 24 Nov '07

24 Nov '07

Weird, The problem seems to have gone away, I can read all mail boxes now James

2 2

[Dovecot] dspam integration
by Eugene Prokopiev 24 Nov '07

24 Nov '07

Hi, I see http://johannes.sipsolutions.net/Projects/dovecot-antispam and http://blog.cynapses.org/2007/09/13/dovecot-dspam-plugin/ solutions. Second git repo is not answer, first one is cloned, but I see some drawbacks with it. Dspam backend is more native solution but libdspam using instead of dspam external binary looks like preffered way to integrate dspam. Another problem is waiting for dspam child process exit, so IMAP session is blocked. Why not to fork and forget dspam child process? Email sender backend is non-blocking, but using MTA is great overhead. Calling external program with some args and mail body via pipe can be more suitable way, so external program may be dspam binary directly or shell/perl/python filter to any antispam engine via sendmail or something else. Has anybody plans to implement this features or it will be better to try it myself?

5 8

[Dovecot] Weirdness and Questions...
by James 24 Nov '07

24 Nov '07

version 1.0.7 OK, so here is my weirdness. I sent mail to the server from the command line. mail username@localhost < /etc/passwd When I open /var/spool/mail/username I can see 2 messages. The "system" message at the top and the the message produced from my command line email. If I HUP the process that runs xinet.d and re-open the users mail spool the 2nd email disappears which I wouldn't expect. Has anyone seen this before. My SMTP server could be EXIM or Sendmail. My co- admin is in the process from switching over from to EXIM. I am not sure if the SMTP server has anything to do with it or not. I can see the contents of all the email in ~/mail which is rsynced from my old server so that seems to be working properly. I have mail_locatiion in my config file, do I need anything else? mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u In my list of mailboxes that are in ~/mail I see 2 folders that I'd rather not see. There .customeflags and .INBOX Anyway to hide these, as they are not needed in my opinion. Thanks, James

1 0

[Dovecot] Problems reading mbox mail boxes.
by James 24 Nov '07

24 Nov '07

I just installed dovecot 1.0.7 Set up the pem files for SSL, set up the xinet.d/imaps files and it logs into the server gets a list of all the mbox files in the ~/mail directory and creates representations of them in Apple mail. The problem I am having is when I click on one any of them I see no content. Execpt one. For some reason one of them shows the 2 emails that are inside of it. I am very confused by it. Help? James

1 0

[Dovecot] deliver and append brocken in hg head ("tip"?)
by Jakob Hirsch 23 Nov '07

23 Nov '07

Hi, > Nov 22 18:48:15 seba deliver(jh): file maildir-uidlist.c: line 844 (maildir_uidlist_set_ext): assertion failed: (rec != NULL) > Nov 22 18:48:15 seba deliver(jh): Raw backtrace: /usr/local/libexec/dovecot/deliver(i_syslog_fatal_handler+0x2b) [0x80be37b] -> /usr/local/libexec/dovecot/deliver [0x80be18c] -> /usr/local/libexec/dovecot/deliver [0x8066e56] -> /usr/local/libexec/dovecot/deliver [0x8069f00] -> /usr/local/libexec/dovecot/deliver [0x806a041] -> /usr/local/libexec/dovecot/deliver(maildir_save_finish+0xec) [0x806a77c] -> /usr/local/libexec/dovecot/deliver(mail_storage_copy+0xfa) [0x80ad59a] -> /usr/local/libexec/dovecot/deliver(maildir_copy+0x52) [0x8067f42] -> /usr/local/libexec/dovecot/deliver(deliver_save+0xcf) [0x805945f] -> /usr/local/libexec/dovecot/deliver(main+0x12e5) [0x805a955] -> /lib/libc.so.6(__libc_start_main+0xe0) [0x948f70] -> /usr/local/libexec/dovecot/deliver [0x8058771]

2 1

Re: [Dovecot] dovecot loading during boot
by Karsten Bräckelmann 22 Nov '07

22 Nov '07

[ adding the list back to Cc ] On Thu, 2007-11-22 at 14:28 +0100, Marcus Rueckert wrote: > On 2007-11-22 13:31:59 +0100, Karsten Bräckelmann wrote: > > And impossible for SuSE out-of-the-box, given their > > braindead [1] init scripts. > > what is so braindead about it? See these posts, the second one in particular. Also, my original Shorewall rules and documentation might be interesting. http://www.mail-archive.com/shorewall-users@lists.sourceforge.net/msg03986.… http://www.mail-archive.com/shorewall-users@lists.sourceforge.net/msg03985.… Please note that the initial reason for the above pinning down NFS ports is firewall-friendly behavior and sane rules. With NFS, most involved services use random ports by default, particularly statd, lockd, mountd, rquotad. Which leads to somewhat unsatisfying rules as shown in [1]. The init script shipped by SuSE offers no way whatsoever to pass rpc.statd options, even though it does for rpc.mountd -- and thus no way to pin down the port out-of-the-box short of hacking the init script. Marcus, please feel free to keep me posted on this issue and a fix. I'll happily forward updates to the Shorewall lists. guenther [1] http://shorewall.net/ports.htm#NFS -- char *t="\10pse\0r\0dtu\0.@ghno\x4e\xc8\x79\xf4\xab\x51\x8a\x10\xf4\xf4\xc4"; main(){ char h,m=h=*t++,*x=t+2*h,c,i,l=*x,s=0; for (i=0;i<l;i++){ i%8? c<<=1: (c=*++x); c&128 && (s+=h); if (!(h>>=1)||!t[s+h]){ putchar(t[s]);h=m;s=0; }}}

2 2

[Dovecot] Broken system.
by Marcelo Iturbe 22 Nov '07

22 Nov '07

Hello, I had an Inbox with 975,604 emails on ext3 filesystem. I keept getting dropped on the comand "copy 1:2000 inbox2", the syslog gave me an error message indicating "out of memory" problems. This despite the fact that the server has 800MB of ram free. Anyways, I asked if I could manuanlly move the files at the filesystem level or if that would mess up dovecot (break the GUIDs etc). I was informed that dovecot does not use GUIDs and that I could go ahead and move the emails at the shell level. So I did that, now the /cur folder only has 40,000 emails, but when I connect to the account via telnet, I still get the following: telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK Dovecot ready. 110 login somelameuser somelamepass 110 OK Logged in. 111 select inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 975604 EXISTS * 0 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1188426666] UIDs valid * OK [UIDNEXT 979500] Predicted next UID 111 OK [READ-WRITE] Select completed. So even though there are only 40,000 emails in /cur, dovecot still thinks that there are 9756304 emails. How can I fix this? Thanks Marcelo

4 4

[Dovecot] dovecot loading during boot
by Robert W Nocella 22 Nov '07

22 Nov '07

I have two RHEL4 email servers running postfix/MailScanner which use dovecot. They work great. But during bootup the nfslock script in my init.d loads rpc.statd and calls portmap to get a port number. Portmap keeps giving rpc.statd the imaps port number (993). I then have to stop my mail server services, manually start dovecot, then restart the mail server services and everything goes merrily on its way. Stopping the mail server services drops rpc.statd from using port 993(according to netstat -tlnp). This allows dovecot to take it by default. How to I reserve imap and imaps ports exclusively for use by dovecot. The imap and imaps ports are listed in /etc/services. Thanks for any insight. -- Robert W Nocella Systems Analyst III Computer Support Group Manager UNM ECE Department UNM SOE IT Agent

2 1

[Dovecot] Getting two mails.....
by Bjørn T Johansen 22 Nov '07

22 Nov '07

When I receive a mail that is addressed to my email address and also with a cc to a mailinglist I subscribe to, I get two mails, which I guess is expected... But I have just moved to Dovecot from Cyrus, and Cyrus seems to know that this is the same mail, so only one of those two mail is stored on the imap srv... Is there some option I am missing in Dovecot or isn't this possible using Dovecot? Regards, BTJ -- ----------------------------------------------------------------------------------------------- Bjørn T Johansen btj(a)havleik.no ----------------------------------------------------------------------------------------------- Someone wrote: "I understand that if you play a Windows CD backwards you hear strange Satanic messages" To which someone replied: "It's even worse than that; play it forwards and it installs Windows" -----------------------------------------------------------------------------------------------

5 9

[Dovecot] Creating "special" folders?
by Bjørn T Johansen 22 Nov '07

22 Nov '07

Is there anyway to make dovecot create Sent, Draft, etc folder automatically? Or is this the job for a MUA? Regards, BTJ -- ----------------------------------------------------------------------------------------------- Bjørn T Johansen btj(a)havleik.no ----------------------------------------------------------------------------------------------- Someone wrote: "I understand that if you play a Windows CD backwards you hear strange Satanic messages" To which someone replied: "It's even worse than that; play it forwards and it installs Windows" -----------------------------------------------------------------------------------------------

5 5

[Dovecot] pop3_lock_session and NFS
by salimlist＠sdv.fr 22 Nov '07

22 Nov '07

Hello, I need an advice about POP3 and NFS with Dovecot 1.0 (as 1.1 is still tagged beta) . I currently have all messages and indexes under a NFS partition . I thus turned cache off using actimeo=0 . Of course, my current architecture does not allow me to keep the same user on the same dovecot server. Now, I have some NFS issues with high percentages of getattr() . If I understood well, the cache must be disabled, because of the case of 2 differents computers could log on the same time and mess up the index file . If I use the directive pop3_lock_session and enable it, that should block conccurent pop3 access using a lock file . Can I consider it safe enough to turn on the NFS cache (ie removing actimeo=0) ? Thanks in advance Salim Ps: For you info, we use dovecot here for a big cable broadband ISP, with 2,000,000 mailboxes using 30 dovecot POP3 servers,10 dovecot proxy servers and we are really happy with your nice software, we expect a lot from 1.1 .

2 2

[Dovecot] virtual user login
by Paul A 21 Nov '07

21 Nov '07

Hi, I have server with multiple virtual domains and this server also accepts mail for the local domain. I'm using postfix and have the following setup for a virtual sales(a)domain.com mapped to custsales@localhost I was wondering if there is a way to login with the virtual email address, for example sales(a)domain.com? I would also like to still be able to login with the local user as well. TIA, P

2 1

[Dovecot] Re-download emails from pop3 server
by Evaggelos Balaskas 21 Nov '07

21 Nov '07

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 i use dovecot-1.0.7 for pop3 & imap and virtual users (via text) without any problem. But when my thunderbird is setup not to delete from server (pop3) every time i do get i redownload all my emails from the server. Can anybody advice ? - -ebalaskas.gr Unix System Engineer Informatics Engineer Technological Education -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFHREmuWIK+Pe9twhoRAvCkAJ9WwdL9gqcfQGMMlfcZlmjtYxrkcgCgvJPt 5DwvkNFPEOwb7FT4Dt4YSns= =pyHc -----END PGP SIGNATURE-----

2 2

[Dovecot] convert plugin
by maximatt 21 Nov '07

21 Nov '07

hi.... i have problems with convert plugin, because he delete the message maildir inbox (i dont know this is't right)... i set dovecot (Dovecot v1.0.7) to listen with pop and imap protocols... for example.... if user1 sends to user2 a msg via pop3 or imap, i can see the msg in user2 imap account, but when i read messages from user2 pop account, i see the message, but the message was deleted from imap account.... ¿:(? these are my settings about this issue: mail_location: maildir:/export/home/vmail/prueba/%n mail_plugins(imap): quota imap_quota convert mail_plugins(pop3): quota convert pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %u plugin: quota: maildir convert_mail: mbox:~/mail:INBOX=/export/home/vmail/prueba/%u maybe i not understand yet wich if this plugin do :( thanks!!! :)

1 0

[Dovecot] Limiting the size of index files
by Edgar Fuß 21 Nov '07

21 Nov '07

Is there a way to limit the amount of disc space dovecot will use for its index cache? Other than putting that on a separate partition, I mean. We host our mail data on the file server, however, the index files are located on local discs on each of the mail servers and seem to grow without bounds. We're above 250M now and soon /var will run out of space. Thanks for any help.

4 5

[Dovecot] dovecot mysql support
by jan gestre 21 Nov '07

21 Nov '07

Hi Guys, I'm using CentOS 4.5, is the dovecot default rpm comes with mysql support? Do I need to rebuild it? TIA. jan

6 11

[Dovecot] Problem Running Dovecot 1.0.5
by dave 21 Nov '07

21 Nov '07

Hello, When trying to run dovecot I am getting the following error :- Error: Error in configuration file /usr/local/etc/dovecot.conf line 923: Unknown section type (section changed at line 923) Fatal: Invalid configuration in /usr/local/etc/dovecot.conf The following section is at line 923. userdb static { args = uid=5000 gid=5000 home=/var/spool/vmail/%d/%n allow_all_users=yes } It seems to be that dovecot does'nt understand the section, but I configured with support for static userdb and this was confirmed before compilation took place. OS is Solaris 9. Any advice would be appreciated. Thanks, David.

3 3

[Dovecot] Problems executing dovecot.
by Marcelo Iturbe 21 Nov '07

21 Nov '07

Hello, I am running OS: Ubuntu 6.06.1 LTS dovecot # 1.0.7 Beta Problem: I have all the email delivery set up with maildir. I currently have an account which has 297,261 emails in the Inbox. Here is a transcript of a telnet session with the server: * OK Dovecot ready. 110 login somelameuser lameuserspass 110 OK Logged in. 111 select inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 297261 EXISTS * 149522 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1188426666] UIDs valid * OK [UIDNEXT 301157] Predicted next UID 111 OK [READ-WRITE] Select completed. 112 copy 1:100 toBeProcessed Connection to host lost. I keep getting dropped... My original idea was to move the files via command prompt, but I wasn't sure if that was allowed, thought I might mess up the UIDs. How could I move the emails into other directories (folders) so that a regular IMAP conector can process the emails? Thanks for your help Marcelo -- Marcelo Iturbe ■ CIO ■ Tigabytes Chile ■ Google Enterprise Partner T: 562 264 1044 ■ www.tigabytes.com

5 5

[Dovecot] Received Dates/Squirrelmail
by Jeff Grossman 21 Nov '07

21 Nov '07

I am trying to figure out an issue I have with the e-mails in my inbox showing up in Squirrelmail. I sometimes get (more often than I care for it to happen) e-mails which show up as new either many hours ago or days ago. I have one particular e-mail that in Squirrelmail is showing a data of Tue, 8:23PM. The received header of that e-mail shows: Received: from murphy.debian.org (murphy.debian.org [70.103.162.31]) by apple.stikman.com (8.14.1/8.14.1/Debian-9) with ESMTP id lA1JGTli011052 for <x>; Thu, 1 Nov 2007 12:16:35 -0700 And the date header of that e-mail shows: Date: Tue, 30 Oct 2007 23:23:11 -0400 I have tried changing the Squirrelmail setting under Display Settings which says Use Received Date. Both options, yes and no makes the mail display the same way in Squirrelmail. Is this a problem with the way Dovecot is sending the information to Squirrelmail, or is this a problem with the way Squirrelmail is interpreting the data from Dovecot? Dovecot version is 1.1beta5 Squirrelmail is version 1.4.11 Thanks for any help you can offer me. Jeff

2 2

[Dovecot] Throttle New Connections?
by Joe Allesi -X (joallesi - Coyote Creek Consulting at Cisco) 21 Nov '07

21 Nov '07

All, Is anyone using iptables (recent module), or any other alternatives, to throttle the number of new imap or pop connections per minute? We have some applications that like to login every second to pull mail using imap, so we'd like to protect the entire dovecot server from these applications. We've already made the change over to high-perf mode, but we still need some type of denial of service protection. Any real-world data would be appreciated. Thanks!

4 4

[Dovecot] Just getting started
by Randall Donaldson 20 Nov '07

20 Nov '07

This is my first attempt at creating a mail server. I'm running postfix and dovecot on Fedora 7. So far the process has been very enlightening. I currently have the server able to send and receive messages for a domain from the server machine itself. In addition, I can SMTP from any client set up on the LAN by logging in. However, I cannot retrieve messages from remote clients on the LAN. Thunderbird reads "Connected to" {servername} across the bottom, then times out. I tried to telnet to port 110 on the server, and I no response, just hangs. Not sure where the problem lies. Thanks for any assistance. here's the output of dovecot -n: # 1.0.7: /etc/dovecot.conf login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd Randall Donaldson Information Technology Stolze Printing

2 2

[Dovecot] virtual user login
by Paul A 20 Nov '07

20 Nov '07

Hi, I have server with multiple virtual domains and this server also accepts mail for the local domain. I'm using postfix and have the following setup for a virtual sales(a)domain.com mapped to custsales@localhost I was wondering if there is a way to login with the virtual email address, for example sales(a)domain.com? I would also like to still be able to login with the local user as well. TIA, P

2 1

[Dovecot] IMAP Proxy and Namespaces
by it-dovecot＠ml.epigenomics.com 20 Nov '07

20 Nov '07

Hi! Is it possible to combine these two features of dovecot, i.e. to have a specific namespace that proxies to another IMAP server? Greetings -- Robert Sander

2 1

[Dovecot] How to write plugin
by Eugene Prokopiev 20 Nov '07

20 Nov '07

Hi, Where can I find documentation for plugin writers? Now I see mail-log-plugin source, but I can't understand how entry points (functions mail-log-plugin-init and mail-log-plugin-deinit) are defined to execute some actions on load/unload/copy messages. Can anybody comments this?

2 2

[Dovecot] Mailbox is in inconsistent state
by Nikolay Shopik 20 Nov '07

20 Nov '07

I have few such messages should I aware about them or just ignore? Disconnected: Mailbox is in inconsistent state, please relogin.

2 2

[Dovecot] Helping OS's page cache
by Timo Sirainen 20 Nov '07

20 Nov '07

http://dovecot.org/patches/1.1/fadvise.diff http://dovecot.org/patches/1.0/fadvise.diff These patches try to tell kernel when mail files are wanted to be read and when they're wanted out of memory, so the memory could be used for more important things such as index files. I'd like to hear if someone sees any actual changes (for better or worse) in the system load because of this. I'm not sure if I should add this to v1.1 and if it should be enabled by default.

1 0

[Dovecot] src/lib/Makefile.am: a trivial ``$(srcdir)'' patch
by Ivan Shmakov 20 Nov '07

20 Nov '07

May I suggest the following trivial patch? diff -r ff9e591a2aa5 src/lib/Makefile.am --- a/src/lib/Makefile.am Sun Nov 18 21:44:22 2007 +0200 +++ b/src/lib/Makefile.am Tue Nov 20 00:29:04 2007 +0600 @@ -4,9 +4,9 @@ BUILT_SOURCES = unicodemap.c EXTRA_DIST = unicodemap.c unicodemap.pl -unicodemap.c: +$(srcdir)/unicodemap.c: test -f UnicodeData.txt || wget http://www.unicode.org/Public/UNIDATA/UnicodeData.txt - perl unicodemap.pl < UnicodeData.txt > $@ + perl $(srcdir)/unicodemap.pl < UnicodeData.txt > $@ liblib_a_SOURCES = \ backtrace-string.c \

2 1

[Dovecot] imap process consuming 100% CPU (Dovecot 1.0.3)
by Robert Tomanek 20 Nov '07

20 Nov '07

Hi, I have yet another problem with Dovecot: sometimes (rarely, maybe once every few days) one of the imap processes will 'hang', consuming all available CPU time. It does not seem to 'finish' in any reasonable amount of time (in one instance I waited a few days). This process will not even exit gracefully, it needs to be killed with 'kill -9 <PID>'. It has just happened again. The output from gdb is: > # gdb attach 29401 > GNU gdb 6.3 > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and you are > welcome to change it and/or distribute copies of it under certain conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for details. > This GDB was configured as "i586-suse-linux"...attach: No such file or directory. > > Attaching to process 29401 > Reading symbols from /usr/local/libexec/dovecot/imap...done. > Using host libthread_db library "/lib/tls/libthread_db.so.1". > Reading symbols from /lib/libdl.so.2...done. > Loaded symbols for /lib/libdl.so.2 > Reading symbols from /lib/tls/libc.so.6...done. > Loaded symbols for /lib/tls/libc.so.6 > Reading symbols from /lib/ld-linux.so.2...done. > Loaded symbols for /lib/ld-linux.so.2 > 0x0806049d in imap_sync_more (ctx=0x80d9770) at imap-sync.c:104 > 104 if (ctx->seq == 0) { > (gdb) bt full > #0 0x0806049d in imap_sync_more (ctx=0x80d9770) at imap-sync.c:104 > flags = 1075042320 > keywords = <value optimized out> > str = (string_t *) 0x80c31e0 > ret = 1 > #1 0x08060797 in cmd_sync_continue (cmd=0x80ccdbc) at imap-sync.c:207 > ctx = (struct cmd_sync_context *) 0x80cf000 > ret = <value optimized out> > #2 0x0805ad5a in _client_output (context=0x80ccd78) at client.c:465 > cmd = (struct client_command_context *) 0x80ccdbc > ret = 0 > #3 0x080af0bd in stream_send_io (context=0x80cceb0) at ostream-file.c:356 > ostream = (struct ostream *) 0x80ccee0 > ret = <value optimized out> > #4 0x080aa441 in io_loop_handler_run (ioloop=0x80cb9b0) at ioloop-epoll.c:203 > ctx = (struct ioloop_handler_context *) 0x80cb9d8 > list = (struct io_list *) 0x80d7780 > io = (struct io *) 0x80dc430 > tv = {tv_sec = 2, tv_usec = 540048} > events_count = 4 > t_id = 2 > msecs = <value optimized out> > ret = 1 > i = 0 > j = 1 > call = <value optimized out> > #5 0x080a9889 in io_loop_run (ioloop=0x80cb9b0) at ioloop.c:329 > No locals. > #6 0x08062087 in main (argc=1, argv=0xbffffaf4, envp=0xbffffafc) at main.c:290 > plugin_dir = <value optimized out> Mail log does not reveal anything immediately interesting. Thoughts? Server config ('dovecot -n -c /etc/dovecot/dovecot.conf'): > # 1.0.3: /etc/dovecot/dovecot.conf > base_dir: /var/run/dovecot/ > protocols: imap imaps pop3 pop3s > ssl_ca_file: /etc/ssl/current/cacert.pem > ssl_cert_file: /etc/ssl/current/server.pem > ssl_key_file: /etc/ssl/current/private.pem > disable_plaintext_auth: no > login_dir: /var/run/dovecot//login > login_executable(default): /usr/local/libexec/dovecot/imap-login > login_executable(imap): /usr/local/libexec/dovecot/imap-login > login_executable(pop3): /usr/local/libexec/dovecot/pop3-login > first_valid_uid: 50 > mail_debug: yes > mail_drop_priv_before_exec: yes > mail_executable(default): /usr/local/libexec/dovecot/imap > mail_executable(imap): /usr/local/libexec/dovecot/imap > mail_executable(pop3): /usr/local/libexec/dovecot/pop3 > mail_plugin_dir(default): /usr/local/lib/dovecot/imap > mail_plugin_dir(imap): /usr/local/lib/dovecot/imap > mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 > mail_log_prefix: %Us(%u)(%p): > pop3_uidl_format(default): > pop3_uidl_format(imap): > pop3_uidl_format(pop3): %08Xu%08Xv > auth default: > debug_passwords: yes > passdb: > driver: passwd-file > args: /etc/dovecot/passwd > userdb: > driver: passwd-file > args: /etc/dovecot/passwd > socket: > type: listen > client: > path: /var/spool/postfix/private/auth > mode: 432 > user: postfix > group: postfix -- Best regards, Robert Tomanek mailto:rth23@poczta.onet.pl

4 14

[Dovecot] mail_location backends
by Harrison Metzger 19 Nov '07

19 Nov '07

Hello, Where I work we have have an interesting setup, we have 2 machines with mail accounts on them and both have dovecot. We would really like to centralize all the mail accounts on one machine, but unfortunately the administration has not approved it. However, if we could create the "illusion" that they are on the same machine that would be acceptable. If we have a 3rd machine, lets say called mail.example.com, could we install dovecot on it (using LDAP authorization), such that when a user connects to this machine, it then connects to one of the 2 other machines to retrieve their mail (instead of reading from /var/spool/mail). So in essence, the mail backend is just another POP or IMAP server. In the ldap directory we could have a field that says the mail location is: "imap://machine1.example.com" for some users and "imap://machine2.example.com" (Of course it dosent have to look like that, but I hope you get my idea), then dovecot would make a connection to those servers and read the user's mail. Does such a backend even exist? Can dovecot's plugin support register a mail_location backend (such as mbox:/blah/blah, ...)? Harrison Metzger

2 1

[Dovecot] deliver and namespaces in 1.1
by Nikolay Shopik 19 Nov '07

19 Nov '07

> Namespaces are supported everywhere now. Does this means what we can finally use "deliver" to deliver messages in namespaces?

4 5

[Dovecot] MANAGESIEVE patch v9 for dovecot 1.0.7
by Stephan Bosch 19 Nov '07

19 Nov '07

Hello Dovecot users, Since v8, I have updated the MANAGESIEVE patch to fix various issues reported by users. Although I planned to upgrade the next release after v8 to Dovecot v1.1, I release these changes for Dovecot 1.0 first. If no further major issues are found, I can upgrade to Dovecot 1.1. Change Log V9 ------------- + Definitively fixed the segfault mentioned in V8. It proved to be very time-constrained and thus hard to reproduce. The error turned out to be related to the input handling of the login daemon during authentication. + Checked for changes in the imap daemon that weren't propagated to the managesieve implementation due to code duplication. + Fixed a bug in the autodetection of the sieve storage location. + Fixed bug in the sieve storage that failed to refresh the symlink if the storage was moved. + Improved error handing in the sieve-storage implementation in various places. + Fixed the situation in which the active script link is located in the sieve storage. + Added managesieve configuration to dovecot-example.conf and made the example in this file more concise. This patch still includes (yet another) instance of the CMU Sieve source, as explained in one of my previous e-mails (http://dovecot.org/list/dovecot/2006-July/015016.html) The latest patch can be downloaded at: http://sinas.rename-it.nl/~sirius/ The README.managesieve is located in the root of the dovecot source tree after applying the patch. The dovecot-example.conf file is updated with a configuration example for managesieve. Have fun testing the patch. Don't hesitate to notify me when there are problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl IRC: Freenode, #dovecot, S[r]us

1 0

[Dovecot] Search inside body of message
by Nikolay Shopik 18 Nov '07

18 Nov '07

Hi list, I was wondering about server-side search inside entire message, is dovecot support only english encoding now? I'm using Thunderbird but it can't find anything if I'm using language other than English.

3 9

[Dovecot] unlink_directory(....Trash.NewFolder) failed: Directory not empty
by Adam McDougall 18 Nov '07

18 Nov '07

I noticed the following this week. No idea how long its been happening because I have not tested deleting folders hardly at all. Steps to reproduce: 1. Create a folder "NewFolder", click on it in thunderbird so an index dir is created: ls -ldi Maildir/.NewFolder/ 1504062 drwx------ 5 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/.NewFolder/ ls -ldi Maildir/dovecot/boomhauer/private/indexes/.NewFolder/ 4198832 drwx------ 2 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/dovecot/boomhauer/private/indexes/.NewFolder/ ls -li Maildir/dovecot/boomhauer/private/indexes/.NewFolder/ total 0 4198833 -rw------- 1 mcdouga9 egrstaff 128 Nov 16 19:44 dovecot.index.log 2. Delete "NewFolder" which makes Thunderbird move both the folder under Trash, and seems to "rename" the .NewFolder index dir to .Trash.NewFolder (same inode #): ls -ldi Maildir/.Trash.NewFolder/ 1504062 drwx------ 5 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/.Trash.NewFolder/ ls -ldi Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ 4198832 drwx------ 2 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ ls -li Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ total 4 4198833 -rw------- 1 mcdouga9 egrstaff 128 Nov 16 19:44 dovecot.index.log 3. Right click on Trash folder in Thunderbird, choose "Empty Trash": Nov 16 19:47:25 boomhauer dovecot: IMAP(mcdouga9): unlink_directory(/home/mcdouga9/Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder) failed: Directory not empty ls -ldi Maildir/.Trash.NewFolder/ 1504062 drwx------ 5 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/.Trash.NewFolder/ ls -ldi Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ 4198832 drwx------ 2 mcdouga9 egrstaff 4096 Nov 16 19:47 Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ ls -li Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ (sometimes has a .nfs.blahblah file, I think I failed to catch it quick enough this time) The folder dissapears from Thunderbird's view but stays on disk, and will reappear in Thunderbird if you collapse and re-expand the folder tree, or close and open thunderbird. Repeatable after more "Empty Trash" or directly trying to delete the folder in thunderbird from in Trash. # 1.1.beta8: /usr/local/etc/dovecot.conf ssl_cert_file: /usr/local/etc/apache2/ssl/mail.egr.msu.edu.pem ssl_key_file: /usr/local/etc/apache2/ssl/mail.egr.msu.edu.pem login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_extra_groups: postlocal mail_location: maildir:%h/Maildir:CONTROL=%h/Maildir/dovecot/private/control:INDEX=%h/Maildir/dovecot/%q/private/indexes mmap_disable: yes dotlock_use_excl: yes mail_nfs_storage: yes mail_nfs_index: yes mail_plugins: acl fts fts_squat mail_log_max_lines_per_sec: 0 imap_client_workarounds: delay-newmail netscape-eoh tb-extra-mailbox-sep namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: mail/ hidden: yes subscriptions: yes namespace: type: private separator: / prefix: Mail/ hidden: yes subscriptions: yes namespace: type: public separator: / prefix: #shared/decs/ location: maildir:/egr/mail/shared/decs:CONTROL=%h/Maildir/dovecot/public/control/decs:INDEX=%h/Maildir/dovecot/%q/public/indexes/decs list: yes subscriptions: yes auth default: passdb: driver: pam userdb: driver: passwd args: system_user= socket: type: listen client: path: /var/spool/postfix/private/auth mode: 384 user: postfix group: postfix plugin: acl: vfile:/usr/local/etc/dovecot-acls:cache_secs=10 fts: squat

2 2

[Dovecot] umask not applied
by Thomas 18 Nov '07

18 Nov '07

Hi all! I am trying to get dovecot-1.0.rc15 to create files with mode 660 in my virtual mailboxes. I set umask=0007 in dovecot.conf, restarted dovecot (/etc/init.d/dovecot restart) and send me an e-mail but it is still 600. "dovecot -n" says "umask: 7" How come the zeros are not displayed? Is this by intention or is something wrong? Here is the complete output: # /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_extra_groups: mail mail_location: maildir:/home/vmail/%d/%n umask: 7 auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: static args: uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail I searched the wiki and googled but couldn't find anything helpful. Do you have any ideas? ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program.

4 4

[Dovecot] SIGSEGV (Segmentation fault) with antispam plugin
by Boky 18 Nov '07

18 Nov '07

Hi all. I am trying to get dovecot (1.0.rc17) running with antispam plugin. I have created another backend, which executes "sa-learn" from spamassassin's arsenal. The backend is modeled after sendmail backend. But I can't seem to get the plugin working wit either my backend or signature-log. This is my ".config": DOVECOT=/usr/src/dovecot-1.0.7 DOVECOT_VERSION=1.0 BACKEND=spamassassin-exec INSTALLDIR=/usr/lib/dovecot/modules/imap/ PLUGINNAME=antispam This is how I make the plugin: make && make install && chmod 644 /usr/lib/dovecot/modules/imap/lib90_antispam_plugin.so Since Ubuntu server does not come with dovecot sources, I have downloaded dovecot-1.0.7 and put it in /usr/src. As far as I understand, only the headers are needed, so this should not be the cause of the crash (if the headers hadn't changed). When invoked from dovecot process, the "imap" dies with signal 11. When running: strace /usr/sbin/dovecot --exec-mail imap This is how it ends: etdents64(8, /* 14 entries */, 4096) = 592 getdents64(8, /* 0 entries */, 4096) = 0 open("/usr/lib/dovecot/modules/imap/lib90_antispam_plugin.so", O_RDONLY) = 9 read(9, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\340\21"..., 512) = 512 fstat64(9, {st_mode=S_IFREG|0644, st_size=19252, ...}) = 0 mmap2(NULL, 16148, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 9, 0) = 0xb7f29000 mmap2(0xb7f2c000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 9, 0x2) = 0xb7f2c000 close(9) = 0 close(8) = 0 stat64("/var/mail/mailboxes/boky/Maildir/subscriptions", 0xbfc17d2c) = -1 EACCES (Permission denied) lstat64("/var/mail/mailboxes/boky/Maildir/cur", 0xbfc17c3c) = -1 EACCES (Permission denied) write(2, "imap(boky): ", 12imap(boky): ) = 12 write(2, "Error: ", 7Error: ) = 7 write(2, "lstat(/var/mail/mailboxes/boky/M"..., 69lstat(/var/mail/mailboxes/boky/Maildir/cur) failed: Permission denied) = 69 write(2, "\n", 1 ) = 1 open("/etc/localtime", O_RDONLY) = 8 fstat64(8, {st_mode=S_IFREG|0644, st_size=696, ...}) = 0 fstat64(8, {st_mode=S_IFREG|0644, st_size=696, ...}) = 0 mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7de2000 read(8, "TZif\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\6\0\0\0\6\0"..., 4096) = 696 close(8) = 0 munmap(0xb7de2000, 4096) = 0 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=696, ...}) = 0 --- SIGSEGV (Segmentation fault) @ 0 (0) --- +++ killed by SIGSEGV +++ Process 4707 detached antispam plugin was downloaded from: http://git.sipsolutions.net/?p=dovecot-antispam.git;a=snapshot;h=HEAD;sf=tgz Please advise me n next steps; I'm just a beginner with debugging C/C++. Thank you all. Boky

3 2

[Dovecot] crash with fts_squat on an identified email
by Adam McDougall 18 Nov '07

18 Nov '07

I have some folders with a good amount of spam. While demonstrating full text search to a user, we found a folder that would crash dovecot while doing a fts. While splitting up the mailbox to narrow it down, I found there are a good number of messages in that folder that all made it crash in the same manner. I figured I'd narrow down a single one, get that fixed, then retest the rest. I also added to my todo list to try a full text search on as much email as I can find, to try to weed out any other problems (and see if fts is realistic to use in production). Nov 17 09:03:26 boomhauer dovecot: IMAP(mcdouga9): file message-decoder.c: line 201 (translation_buf_decode): assertion failed: (*size >= skip) Nov 17 09:03:26 boomhauer dovecot: child 14668 (imap) killed with signal 6 Let me know if this is not reproducable with the attached tgz containing a maildir with one message, I could do a local gdb if needed.

2 1

[Dovecot] mailbox size limit
by Bazy 18 Nov '07

18 Nov '07

Hi guys, I was wondering... my Inbox is 1.3GB large, my mailbox size limit is 6GB (6442450941). Other users have 500+ MB in their Inbox. I have about 27GB of mail. I'm running dovecot 1.0.7 now under Fedora 7 with postfix. I have no trouble at all, everything is working perfect. I use ext3 as my file system, and I store mail in maildir format. Will I have any inode, file system, issues? Is anyone storing more then 27GB in maildir format on only one ext3 partition? Here is my dovecot -n output: # 1.0.7: /etc/dovecot.conf log_path: /var/log/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 ssl_cert_file: /etc/postfix/smtpd.cert ssl_key_file: /etc/postfix/smtpd.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_max_processes_count: 512 mail_location: maildir:/home/vmail/%d/%n/ mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): outlook-idle pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot-userdb-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix plugin: quota: maildir:storage=102400 [root:pts/0][~]# cat /etc/dovecot-sql.conf driver = mysql connect = host=/var/lib/mysql/mysql.sock user=mail_admin password=XXXXXXXX dbname=mail default_pass_scheme = CRYPT password_query = SELECT password FROM users WHERE CONCAT(SUBSTRING_INDEX(email,'@',1)) = '%n' AND CONCAT(SUBSTRING_INDEX(email,'@',-1)) = '%d'; [root:pts/0][~]# cat /etc/dovecot-userdb-sql.conf driver = mysql connect = host=/var/lib/mysql/mysql.sock user=mail_admin password=XXXXXXXX dbname=mail user_query = SELECT CONCAT(('/home/vmail/'), SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1),'/') as home, 5000 as uid, 5000 as gid, CONCAT('maildir:storage=', floor(quota/1024)) as quota FROM users WHERE email = '%u';

5 9

[Dovecot] can't rename folder whiten with non ASCI charters
by Nikolay Shopik 17 Nov '07

17 Nov '07

Running dovecot 1.0.5 on Debian testing. I've just tried to create folder using Russian charters after that I'm tried to renamed it without luck. Folder removed and no new created and I still subscribed to old folder even its not exist anymore.

2 2

[Dovecot] using # special charter in config
by Nikolay Shopik 17 Nov '07

17 Nov '07

Before dovecot I'm using # charter to mark public folders. So if I want set prefix = # its of course won't work, I tried using \# combination without luck. Is this possible anyway?

2 1

[Dovecot] Path to public folder subscription file not created in 1.1b7?
by Adam McDougall 17 Nov '07

17 Nov '07

I use CONTROL=%h/Maildir/dovecot/public/control/[namespace] for each of my public namespaces. A few nights ago, I noticed having a new user subscribe to public folders for the first time will silently fail, becuase the path up to the subscriptions file will not be created. I am pretty sure dovecot used to create it for me, but maybe that changed in a recent version, or maybe I did something to break it? Work around is to mkdir -p /home/[user]/Maildir/dovecot/public/control/[namespace] but I'd like to avoid having to do that. Once I create the directory and make sure it is writable, the client can subscribe to public folders in that namespace. If they do not have permission, it still silently fails. namespace: type: public separator: / prefix: #shared/decs/ location: maildir:/egr/mail/shared/decs:CONTROL=%h/Maildir/dovecot/public/control/decs:INDEX=%h/Maildir/dovecot/%q/public/indexes/decs list: yes subscriptions: yes

2 1

[Dovecot] RHEL 5.1 Can't compile with --with-linux-quota
by Laurent PELLISSIER 16 Nov '07

16 Nov '07

Hi, On a freshly installed RedHat RHEL 5.1 x86 with quota-3.13-1.2.3.2.el5.rpm I can't compile neither dovecot 1.0.7 nor 1.1beta8 : $ ./configure --with-linux-quota && make [...] gcc -DHAVE_CONFIG_H -I. -I. -I../../.. -I../../../src/lib -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -I/usr/kerberos/include -MT quota-fs.lo -MD -MP -MF .deps/quota-fs.Tpo -c quota-fs.c -fPIC -DPIC -o .libs/quota-fs.o quota-fs.c: In function 'fs_quota_get_linux': quota-fs.c:442: error: 'yes' undeclared (first use in this function) quota-fs.c:442: error: (Each undeclared identifier is reported only once quota-fs.c:442: error: for each function it appears in.) make[4]: *** [quota-fs.lo] Error 1 make[4]: leaving directory « /home/kermit/dovecot-1.1.beta8/src/plugins/quota » $ make distclean && ./configure --without-linux-quota && make -> same error $ make distclean && ./configure --disable-linux-quota && make -> compile fine Best regards, -- Laurent PELLISSIER @ Ecole des Mines d'Alès

2 2

[Dovecot] Mail.app IDLE support
by Martin R. Ehmsen 16 Nov '07

16 Nov '07

Hi, I'm trying to use the new IDLE support in Mail.app on Mac OS 10.5, and it works sort of, but it seems to miss some notifications. My guess is the IDLE support in Mail.app is implemented such that it sets up a connection for IDLE notifications and then checks the mail via another connection, and because of that the "IDLE-connection" gets disconnected for inactivity after 30 min. The reason for my guess is that I get the following in my logs: dovecot: Nov 14 17:00:29 Info: imap-login: Login: user=<amanda>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:00:29 Info: imap-login: Login: user=<ehmsen>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:00:30 Info: imap-login: Login: user=<amanda>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:00:50 Info: imap-login: Login: user=<ehmsen>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:00:51 Info: imap-login: Login: user=<ehmsen>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:04:58 Info: imap-login: Login: user=<ehmsen>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:30:40 Info: IMAP(amanda): Disconnected for inactivity dovecot: Nov 14 17:43:29 Info: IMAP(amanda): Disconnected for inactivity Is there something I can do about this problem? Is the IDLE implementation in the 1.1 branch different from the implementation in the 1.0 branch of dovecot? Or can I debug this issue further? I guess these things are standardized, but it seems hard for Apple to follow a standard :-) Thanks in advance, Martin R. Ehmsen

5 10

Re: [Dovecot] umask not applied
by Nikolay Shopik 15 Nov '07

15 Nov '07

- original message - Subject: Re: [Dovecot] umask not applied From: Thomas <lists(a)abelonline.de> Date: 15/11/2007 00:46 Quoting Troy Engel <tengel(a)fluid.com>: > I'll be the first to mention that 1.0rc15 is ancient by dovecot > standards, upgrade to 1.0x first and see if it's still broken. I am running a debian etch server. Unfortunately 1.0rc15 is the lastest version available in the stable tree. I would really like to remain in stable if somehow possible since I think combining stable and unstable will lead to chaos. I'll check the changes in later version and if they mention something about umask. ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program. If you are stick with debian stable just use backports so you don't mess up anything and still will be running stable and almost latest packages.

3 5

[Dovecot] Is there any way to query a secure imap server for certificate details
by Stewart Dean 15 Nov '07

15 Nov '07

? -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

3 2

[Dovecot] SSL/TLS with Outlook client
by Jonathan Bond-Caron 15 Nov '07

15 Nov '07

Anyone have any solution to this? I also getting a "The target principal name is incorrect." in Outlook 2007 Is this a problem with dovecot?

10 20

[Dovecot] dovecot.index mtime
by Matt 15 Nov '07

15 Nov '07

Is there anyway I can get Dovecot to update mtime on dovecot.index everytime a user successfully checks there email? Or perhaps there is a better way to do what I want here. I am working on a script that I want to check when the last time a user checked there email account. If a user has not checked it in say 6 months I want to automatically suspend the account through the MTA. If they start checking it again I also want to automatically reinstate it. What I thought was a good way was to look at the mtime on dovecot.index but a user can be checking there email daily but if they do not receive a new message in say 6 months the mtime will date back to 6 months still. Ran into this with an email address used by a fax machine. So is there a better way with dovecot to determine this? I am using dovecot-1.0.rc29 right now. Matt

5 17

[Dovecot] New full text search indexer
by Timo Sirainen 14 Nov '07

14 Nov '07

As described earlier (http://dovecot.org/list/dovecot/2006-December/018055.html) Dovecot nowadays has full text search indexing support in CVS HEAD. Currently there are two backends: Lucene and Squat. Lucene's problem is that standard IMAP SEARCH command can't be used with it without breaking IMAP RFC. So Lucene can be used only with non-standard X-BODY-FAST and X-TEXT-FAST search commands. Squat's code then is quite complex and it's pretty slow. It works with 4 character blocks, so it can answer: - Search string < 4 characters: Can't answer anything - Search string = 4 characters: Definite yes/no - Search string > 4 characters: Probable yes / definite no Since search strings are usually more than 4 characters, Dovecot uses the index only to filter out messages which definitely won't match and then does regular searching for the non-filtered messages. It works ok, but it could work better. The Squat indexes take maybe 30-50% of the mailbox's size. Most of the space goes to UID lists (list of messages matching each 4 character block). For example one UID list could be "2,4-10,20-30". This is already stored in a compressed format by storing the UID numbers relative to previous UID, which allows storing them usually with a single byte per UID, even if the UIDs are large. So, this morning I had an idea how this could maybe be improved with two changes: 1. Don't use 4 character blocks. Instead allow variable sized paths, and keep track of the UIDs for each node in the path. So for example adding "abc" to UID 1 will place the UID 1 to node "a", "ab" and "abc". 2. Use UIDs relative to parent's UIDs. For example if node "a" has UIDs 1,3,5 and "ab" is added for UID 5, the UID is changed to 2 (3th in 1,3,5 list - 1). This can help the compression a lot. The best case scenario for the above example is if "ab" contains also 1,3,5 UIDs. Then it can be written with a single 0-2 range. With these changes, the indexer can be configured to perform in different ways. Text can be indexed in two ways: full words, and substrings within those words (as required by IMAP). I think a useful combination of these would be to index all 4 character substrings and all full words up to 10 characters or so. This kind of an index can answer: - Search string <= 4 characters: Definite yes/no - For X-BODY-FAST / X-TEXT-FAST: - Search string 5-10 characters: Definite yes/no - Search string 11+ characters: Probable yes / definite no - For standard IMAP SEARCH: - Search string 5-10 characters: Definite yes if message contains the key as non-substring, otherwise same as below. This helps only if user does a search that matches a lot of messages. - Search string 11+ characters: Probable yes / definite no UTF-8 text is indexed as bytes, but the path depth can be counted as characters instead of as bytes. I've a test program finished, and unless there are some bugs left I think it shows that this can work pretty well: Squat-like 4 byte substrings (but can answer 1-3 char queries also): Message count: 7495 Index time: 4.19 CPU seconds (7.39MB/CPUs) Node memory: 3014072 bytes (2943 kB) in 90550 nodes UID memory: 8277212 bytes (8083 kB) in 352778 lists Total: 11291284 / 32474899 bytes = 34.77% Indexing the same mailbox file with squat-test gives: - Index time: 9.55 CPU seconds, 9.63 real seconds (3.24MB/CPUs) - 4145192 bytes in 102208 nodes (12.76%) - 7286058 bytes in 305501 uid_lists (22.44%) - 11431250 bytes total of 32474899 (35.20%) So the new indexer is over twice as fast and uses slightly less space. Indexing 4 char substrings and words up to 10 chars: Index time: 5.13 CPU seconds (6.04MB/CPUs) Node memory: 6002804 bytes (5862 kB) in 615501 nodes UID memory: 9044610 bytes (8832 kB) in 519488 lists Total: 15047414 / 32474899 bytes = 46.34% So it takes somewhat more space, but definitely less than having both Squat + Lucene. No substring indexing, words up to 10 chars (Lucene replacement): Index time: 1.39 CPU seconds (22.28MB/CPUs) Node memory: 3297663 bytes (3220 kB) in 548540 nodes UID memory: 1803735 bytes (1761 kB) in 213554 lists Total: 5101398 / 32474899 bytes = 15.71% Is there a need for Lucene anymore with this kind of a speed and disk space usage? :) The above tests are run with everything being indexed except space and control chars (ie. practically space + tab). If only alphanumeric characters are indexed, the total lines are (in same order as above): Total: 7048664 / 32474899 bytes = 21.70% (-13.07%) Total: 9610543 / 32474899 bytes = 29.59% (-16.75%) Total: 3963335 / 32474899 bytes = 12.20% (-3.51%) There are probably still a few optimizations that can be done to get the disk space usage even lower. I did spent quite a lot of time making it use less CPU though. Even tried a bit different coding style variations in the critical functions to get gcc to create faster code.. One interesting thing I noticed was that binary searching a character from a char array was slower than just sequentially going through the characters. I tried adding checks to do it only if the array was big, but it was always slower. Maybe something to do with CPU cache. If you want to try yourself, the test program is in http://dovecot.org/tmp/new-indexer.c

7 10

Re: [Dovecot] SSL/TLS with Outlook client
by Nikolay Shopik 14 Nov '07

14 Nov '07

Agree with Hugo most root CA have intermidate certificates which should supplied with your server certificate. Otherwise chain won't work and any client don't trust it. - original message - Subject: Re: [Dovecot] SSL/TLS with Outlook client From: Hugo Monteiro <hugo.monteiro(a)fct.unl.pt> Date: 14/11/2007 00:14 Eli Sand wrote: > Hugo Monteiro wrote: > >> Ah ... wildcard certs .. from what i recall, certs issued like >> *.example.com were not very well accepted by M$ clients. You should >> test against non wildcard certs and see how it behaves. >> > > Already have and no luck :( My domain is elisand.com and I have tried > *.elisand.com, mx1.elisand.com (I believe that's what my MX record is... if > not, whatever it is is what I tried) and mail.elisand.com which is the > smtp/imap server name I use in Outlook. All three yield the same result :( > > Eli. > > > I have taken the liberty to connect to your server, using openssl, i've seen the following: $ openssl s_client -CApath /usr/share/ca-certificates/cacert.org/ -connect mail.elisand.com:993 CONNECTED(00000003) depth=1 /O=Root CA/OU=http://www.cacert.org/CN=CA Cert Signing Authority/emailAddress=support(a)cacert.org verify return:1 depth=0 /CN=*.elisand.com verify return:1 --- Certificate chain 0 s:/CN=*.elisand.com i:/O=Root CA/OU=http://www.cacert.org/CN=CA Cert Signing Authority/emailAddress=support(a)cacert.org --- i believe you should change two things. If the name you wish to use on your clients is mail.alisand.com, then the certificate should read CN=mail.elisand.com. Furthermore, it's always a good idea to provide the chaining certificate path on dovecots side. Try using the ssl_ca_file directive on dovecot's configuration. Regards, Hugo Monteiro. -- ci.fct.unl.pt:~# cat .signature Hugo Monteiro Email : hugo.monteiro(a)fct.unl.pt Telefone : +351 212948300 Ext.15307 Centro de Informática Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa Quinta da Torre 2829-516 Caparica Portugal Telefone: +351 212948596 Fax: +351 212948548 www.ci.fct.unl.pt apoio(a)fct.unl.pt ci.fct.unl.pt:~# _

1 0

[Dovecot] Using Dovecot as Asterisk PBX voicemail server
by Kenneth Porter 14 Nov '07

14 Nov '07

I'm reading the Asterisk book, 2nd edition, and it describes how one can set up voicemail to be delivered by IMAP to a voicemail folder. Asterisk can monitor flags on the folder so that the "message available" light on one's phone tracks the state of the "read" flag in the folder. One can either dial in for one's voicemail or listen to it from one's favorite IMAP client. (Dovecot is mentioned in the book.) I'm wondering how one would set up auth for this? Asterisk needs to log in to the account to deliver the voicemail and to check its state, but I wouldn't want to put everyone's mail password in plaintext in Asterisk's voicemail.conf file. Would I set up a separate IMAP account for each user to hold their voicemail, and use simple passwords (such as the PIN they use for phone access to voicemail) in the Asterisk config? Or is there a way to set up Dovecot to allow a second user to login to a specific IMAP folder in all accounts, in the same way the local delivery agent has write access to all users' mailbox? Google's page for the book: <http://books.google.com/books?id=vtQxJ3oSm64C&dq=asterisk+book> Dovecot mentions: <http://books.google.com/books?id=vtQxJ3oSm64C&dq=asterisk+book&q=dovecot#se…>

3 3

[Dovecot] namespace public folders
by Nikolay Shopik 13 Nov '07

13 Nov '07

Hi list, Here is thing im trying to accomplish. I would like to setup public folders which resposible for delivering mails for some speical addresses like info(a)example.com. And it will be perfect if "seen" status for this folder will be saved per user. I mean if one user read message and set it as read other user should see it still as unread. As I far i know there some limitation in 1.0 tree but not in lates 1.1. My question is can I do such setup with dovecot+postfix. Im really appreciate for simple examples how can i accomplish this kind setup if it possible :)

3 3

[Dovecot] Caching?
by Bjørn T Johansen 13 Nov '07

13 Nov '07

Any way to minimize the number of sql statements that dovecot do? (and I tried adding userdb prefetch { } but number of sql calls are still the same) Am I doing something wrong or? Regards, BTJ -- ----------------------------------------------------------------------------------------------- Bjørn T Johansen btj(a)havleik.no ----------------------------------------------------------------------------------------------- Someone wrote: "I understand that if you play a Windows CD backwards you hear strange Satanic messages" To which someone replied: "It's even worse than that; play it forwards and it installs Windows" -----------------------------------------------------------------------------------------------

2 2

[Dovecot] v1.1.beta8 released
by Timo Sirainen 13 Nov '07

13 Nov '07

http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta8.tar.gz http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta8.tar.gz.sig Changes since beta7: - Added a new "raw" mail storage backend which allows opening files/streams as single mail mailboxes. deliver uses this now instead of opening the incoming mail as a mbox. So deliver should be now faster and it doesn't anymore remove Dovecot's private mbox headers if you're not using mbox. - Cache file tracks message expunges again - All kinds of other fixes - Some optimizations I think we're getting closer to v1.1 RCs.

9 17

[Dovecot] Dovecot does not fetch mails from Maildir
by Aras Koktas 13 Nov '07

13 Nov '07

Hello I have the following configuration. I am trying to login through pop3 and fetch e-mails but it does not fetch anything. I see that there is a mail there. Here is what i have List from my homedir. Set correct on MySQL as (home) -- [root@axis info]# ls -al new total 12 drwx------ 2 exim exim 4096 Nov 12 21:11 . drwxrwx--- 6 exim exim 4096 Nov 12 21:11 .. -rw------- 1 exim exim 1996 Nov 12 21:11 1194919868.H288251P7967.axis.phidot.com -- -- FROM sql File-- password_query = SELECT userid as user, password FROM mailacct WHERE userid = '%u' user_query = SELECT home, uid, gid FROM mailacct WHERE userid = '%' -- DOVECOT CONFIG -- # 1.0.7: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /usr/share/ssl/certs/dovecot.pem ssl_key_file: /usr/share/ssl/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login first_valid_uid: 93 mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: mechanisms: PLAIN passdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot-sql.conf

2 4

[Dovecot] Missing deliver
by Sean Smitz 13 Nov '07

13 Nov '07

I've installed Red Hat Enterprise Linux 5 on a new server. I'm configuring sendmail and dovecot; however, /usr/local/libexec/dovecot was not created when I installed the dovecot rpm (rpm -Uvh dovecot-1.0-1.2.rc15.el5.x86_64.rpm). The problem is I can't find the deliver executable which is supposed to be in this directory. Any help would be appreciated.

2 1

[Dovecot] login_process_size too small on x86_64 Fedora/RHEL
by Tomas Janousek 12 Nov '07

12 Nov '07

Hello, as described in [253363], login_process_size of 32M is not enough on 64-bit versions of Fedora and RHEL (and possibly other distributions as well). [253363] https://bugzilla.redhat.com/show_bug.cgi?id=253363 As I understand it, there's an intersegment gap between read-only/executable and writable segments of shared libs. That's probably a security feature or something. I found a similar issue here[1], if anyone wants a comment from someone who understands it. [1] http://gcc.gnu.org/ml/libstdc++/2006-12/msg00033.html Shall we just increase login_process_size or make it arch-dependent or something? Regards, -- Tomas Janousek, SW Engineer, Red Hat, Inc.

2 2

[Dovecot] Secure authentication?
by Bjørn T Johansen 12 Nov '07

12 Nov '07

I have enabled SSL support for my dovecot installation but if I enable secure authentication in my MUA, I get an error from dovecot telling me that this is not supported.. Is this because dovecot does not support this or am I missing some config? Regards, BTJ -- ----------------------------------------------------------------------------------------------- Bjørn T Johansen btj(a)havleik.no ----------------------------------------------------------------------------------------------- Someone wrote: "I understand that if you play a Windows CD backwards you hear strange Satanic messages" To which someone replied: "It's even worse than that; play it forwards and it installs Windows" -----------------------------------------------------------------------------------------------

7 9

[Dovecot] dovecot 1.1b7: mail-cache-lookup.c: line 68: unreached
by Adam McDougall 12 Nov '07

12 Nov '07

I have since upgraded to 1.1b8 but this morning my attention was called to this error from 1.1b7: Nov 11 06:35:17 hill dovecot: IMAP(voice): file mail-cache-lookup.c: line 68: unreached Nov 11 06:35:17 hill dovecot: child 70673 (imap) killed with signal 6 Nov 11 06:35:17 hill dovecot: IMAP(voice): Connection closed bytes=262/25869 I can't say for sure but it was probably a squirrelmail connection. It wasn't me, and I wasn't even awake at the time so I don't know how to reproduce it.

1 0

[Dovecot] dovecot: pipe() failed: Too many open files
by Ralf Hildebrandt 12 Nov '07

12 Nov '07

I'm encountering lots of Oct 31 11:14:25 postamt dovecot: pipe() failed: Too many open files errors around midday ever since the latest upgrade to 1.0.7. The errors appear in pairs like this one: Oct 31 11:20:01 postamt dovecot: pipe() failed: Too many open files Oct 31 11:20:01 postamt dovecot: imap-login: Internal login failure: user=<username>, method=PLAIN, rip=193.175.174.239, lip=141.42.4.250, TLS What gives? -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) plonk(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de We're using Postfix - it generally seems to take the approach that the message that arrives is the message that gets delivered, without any extra bits being added. -- Chris Stratford

2 3

[Dovecot] v2.0 / Master/config rewrite
by Timo Sirainen 12 Nov '07

12 Nov '07

If anyone's interested, I updated my master/config rewrite to latest Dovecot v1.1 tree and added it to hg: http://hg.dovecot.org/dovecot-master-rewrite/ It probably doesn't work, but with the exception of plugins it compiles anyway. :) I'm thinking that maybe after v1.1.0 I could continue with the rewrite and create v2.0 after all instead of v1.2. Just look at how much cleaner deliver.c is :) http://hg.dovecot.org/dovecot-master-rewrite/file/59ebbfcf21cb/src/deliver/… vs http://hg.dovecot.org/dovecot/file/eb4f1fbeecda/src/deliver/deliver.c Another thing with v2.0 I was thinking about was to change index file formats to be more efficient.

2 1

[Dovecot] some mail accesses in dovecot 1.1 stall for a bit (in progress)
by Adam McDougall 11 Nov '07

11 Nov '07

I noticed this in an earlier beta and took a note, and I still see it sometimes in 1.1b4, but it is only occasional so I have not tracked down yet what dovecot is doing. Just a FYI for the list incase others see it and to say that its an issue I tend to track down that I did not see in 1.0, and its been low on my list until now. Sometimes when I login to dovecot and read a message from an imap maildir folder, the message contents do not load for at least 10 seconds, sometimes closer to a minute, but after that first message loads, the rest seem fine in that mailbox. The time seems to vary some, usually longer rather than shorter.

2 9

[Dovecot] imap search/content-transfer-encoding assertion failed
by Andrew Garner 11 Nov '07

11 Nov '07

When performing an imap search, I hit the following assertion failure: imap(vmail): Panic: file unichar.c: line 128 (uni_ucs4_to_utf8_c): assertion failed: (chr <= 0x40000000) imap(vmail): Error: Raw backtrace: /usr/lib/dovecot/imap [0x80c7f7f] -> /usr/lib/dovecot/imap [0x80c7d6a] -> /usr/lib/dovecot/imap [0x80d8616] -> /usr/lib/dovecot/imap(uni_utf8_to_decomposed_titlecase+0x9f) [0x80d892f] -> /usr/lib/dovecot/imap(message_decoder_decode_next_block+0x679) [0x80c46e9] -> /usr/lib/dovecot/imap(message_search_more+0x3e) [0x80c2e8e] -> /usr/lib/dovecot/imap(message_search_msg+0x72) [0x80c3012] -> /usr/lib/dovecot/imap [0x8093f47] -> /usr/lib/dovecot/imap [0x80b7719] -> /usr/lib/dovecot/imap(mail_search_args_foreach+0x32) [0x80b77c2] -> /usr/lib/dovecot/imap(index_storage_search_next_nonblock+0x243) [0x8093af3] -> /usr/lib/dovecot/imap [0x805cdc7] -> /usr/lib/dovecot/imap [0x805d138] -> /usr/lib/dovecot/imap(io_loop_handle_timeouts+0x112) [0x80ce892] -> /usr/lib/dovecot/imap(io_loop_handler_run+0x66) [0x80cf316] -> /usr/lib/dovecot/imap(io_loop_run+0x28) [0x80ce768] -> /usr/lib/dovecot/imap(main+0x4ab) [0x806675b] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xc8) [0xb7e68ea8] -> /usr/lib/dovecot/imap [0x8059141] My quick analysis: This seemed to be caused by a single message in this mailbox. I think dovecot is expanding base64 encoded binary data and then inevitably failing on the utf8 conversion of the decoded random binary data. The mime headers for this message are: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="------------080305000603070709090808" ... This is a multi-part message in MIME format. --------------080305000603070709090808 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit <text content> ... --------------080305000603070709090808 Content-Type: application/x-zip-compressed; name="xxxxxxxx.zip" Content-Transfer-Encoding: base64 Content-Disposition: inline; filename="xxxxxxxxxxxx.zip" <base64 encoded zip file> ... --------------080305000603070709090808-- # dovecot -n # 1.1.beta6: /etc/dovecot/dovecot.conf protocols: imap pop3 listen: 127.0.0.1 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no first_valid_uid: 89 mail_location: maildir:~/Maildir mail_debug: yes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/rawlog /usr/lib/dovecot/pop3 mail_plugins(default): fts fts_lucene mail_plugins(imap): fts fts_lucene mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_log_prefix: %Us(%u[%r]): mail_log_max_lines_per_sec: 100 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %f auth default: mechanisms: plain cram-md5 verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: fts: lucene

2 1

[Dovecot] assertion failed: (mailbox_list_is_valid_existing_name(_list, name))
by Adam McDougall 11 Nov '07

11 Nov '07

Do you need a gdb backtrace for this one? I'm not sure why all of a sudden this started happening, its probably due to me adding a folder somewhere? not sure. It happened when I went to open my folder subscriptions in thunderbird. It was taking longer than usual (call this phase 1) and I noticed this in the logs: (cant remember if this was phase 1 or 2 but the error is probably the same) Nov 11 00:38:38 boomhauer dovecot: imap-login: Login: user=<mcdouga9>, method=PLAIN, rip=208.53.102.126, lip=35.9.37.190, TLS Nov 11 00:38:39 boomhauer dovecot: IMAP(mcdouga9): fchown(/egr/mail/shared/decs/temp.boomhauer.3050.af3db3ac545170a7) failed: Operation not permitted Nov 11 00:38:44 boomhauer dovecot: IMAP(mcdouga9): file mailbox-list-maildir.c: line 186 (maildir_list_get_path): assertion failed: (mailbox_list_is_valid_existing_name(_list, name)) Nov 11 00:38:44 boomhauer dovecot: child 3050 (imap) killed with signal 6 Nov 11 00:38:45 boomhauer dovecot: imap-login: Login: user=<mcdouga9>, method=PLAIN, rip=208.53.102.126, lip=35.9.37.190, TLS Nov 11 00:38:45 boomhauer dovecot: IMAP(mcdouga9): fchown(/egr/mail/shared/decs/temp.boomhauer.3052.5538be060c2f9c7d) failed: Operation not permitted Nov 11 00:38:46 boomhauer dovecot: IMAP(mcdouga9): file mailbox-list-maildir.c: line 186 (maildir_list_get_path): assertion failed: (mailbox_list_is_valid_existing_name(_list, name)) Nov 11 00:38:46 boomhauer dovecot: child 3052 (imap) killed with signal 6 When I cancelled the subscription window, "phase 2" is the same thing but happening more rapidly. I traced what tbird is doing and can reproduce it with: ? OK Logged in. a list "" "#shared/decs/%/%" Connection closed by foreign host. Doing a list on #shared/decs/% works though.

2 2

[Dovecot] Outlook can't see namespace folders
by James 10 Nov '07

10 Nov '07

Hi guys i understand that you can't subscribe to the Prefix names of namespace folders right now with dovecot. But for instance if i user outlook express and it can't see the prefix name then it can't see the subfolders of that "prefix folder" either. So even though it can detect and see the subfolders it won't display them cause it can't see the "parent" Is there any fix for this? it's also kind of annoying in thunderbird but at least you can still see the subfolders. TIA James Here's my config # /etc/dovecot/dovecot.conf protocols = imap imaps pop3 pop3s log_timestamp = "%Y-%m-%d %H:%M:%S " first_valid_uid = 100 login_user=vmail mail_extra_groups = mail mail_debug = yes pop3_uidl_format = %08Xu%08Xv mail_location = maildir:/home/vmail/domains/%n/Maildir #default_mail_env = maildir:/home/vmail/domains/%n/Maildir auth default { mechanisms = plain passdb ldap { args = /etc/dovecot/dovecot-ldap.conf } userdb ldap { args = /etc/dovecot/dovecot-ldap.conf } } # maildir namespace private { separator = / prefix = location = maildir:/home/vmail/domains/%n/Maildir inbox = yes hidden = no } # mbox namespace private { separator = / prefix = "Mbox/" location = mbox:/home/vmail/domains/%n/Mbox inbox = no hidden = no } #public spam folder namespace public { separator = / prefix = /Spam/ location = maildir:/home/vmail/domains/Spam/Maildir/ hidden = no } ssl_disable = no ssl_cert_file = /etc/ssl/certs/dovecot.pem ssl_key_file = /etc/ssl/private/dovecot.pem ssl_verify_client_cert = no ssl_cipher_list = ALL:!LOW:HIGH:MEDIUM:+SSLv2:RSA

3 10

[Dovecot] Request for variable unique to each server?
by Adam McDougall 10 Nov '07

10 Nov '07

I've been looking for a variable I can use in my dovecot.conf within the INDEX= setting so I can have one index dir per imap server on NFS. I've been looking at http://wiki.dovecot.org/Variables but no variable seems to contain something like server hostname, and I've been hunting for the variable expansion code in dovecot but haven't been able to find it. %l (local IP) won't help me because when using our load balancer, %l is the same IP on all of my servers. %r is close to useful but having a local webmail server on each server means I'd end up with 127.0.0.1 being shared (also I would end up with one directory per unique user/clientIP combo). Is there a variable that holds the server hostname or something else unique per server, or could one be added, or could someone point me at the code? Thanks.

2 2

[Dovecot] UTF-8 in dovecot-sieve ?
by Arthur Pétry 10 Nov '07

10 Nov '07

Hi, Reading http://tools.ietf.org/html/rfc3028#section-2.7.2 I thought that out-of-the-box dovecot can filter messages by matching header in UTF-8. But when I tested it, it failed : (I'm using 1.0.5 with sieve plugin) Here is my .dovecot.sieve file : ---------- require ["fileinto", "imapflags"]; if allof(header :contains "subject" "filtre") { addflag "test_1"; } if allof(header :contains "subject" "là") { addflag "test_2"; } if allof(header :comparator "i;ascii-casemap" :contains "subject" "hé") { addflag "test_3"; } ---------- Only the first of the three rules do work. When I try to match a subject string with accent encoded in ISO-8859 like "hélà" : "=?ISO-8859-1?Q?h=E9l=E0?=" there is no match Am I doing something wrong ?

2 1