- dovecot - dovecot.org

[Dovecot] Quota plugin, Maildir, dict backend loop problem
by David Jonas 25 Jul '07

25 Jul '07

Hello, I've been working with the quota plugin(s) the past few days and have been having some real trouble. Only a few entries are appearing in the database, a couple more when I restarted dovecot. None of the current entries were being updated either. I think I've tracked it down to somewhere in the dict backend. I put in a few i_info() statements and recompiled. A few queries get through, then it seems to try the same query about three times and then no new more queries at all (the i_info is right after the allocation of the query string). I couldn't find any errors in the log. An strace of the dict pid shows the following loop. Dovecot -n to follow as well. A quick tcpdump showed a loop something like this: < SELECT current FROM quota WHERE ... > 513965019 < BEGIN < INSERT INTO quota (current, ... < COMMIT > ?? (error_r appears to be (null)) .. repeat .. In all my tests it appears that the quota value being set during the loop is 0, but that would be the most common case anyway. An insert query would look like this: INSERT INTO quota (current, path, username) VALUES (0, 'quota/storage', 'user(a)example.com') ON DUPLICATE KEY UPDATE current = current + 0; Help on what to do/try next would greatly be appreciated. Thanks, David $ strace -p 19816 epoll_wait(5, {{EPOLLIN, {u32=153555248, u64=153555248}}, {EPOLLIN, {u32=153601240, u64=153601240}}, {EPOLLIN|EPOLLHUP, {u32=153567344, u64=153567344}}}, 29, 2147483647) = 3 gettimeofday({1185308526, 494477}, {420, 0}) = 0 read(20, "Lpriv/quota/storage\n", 4044) = 20 fcntl64(9, F_SETFL, O_RDWR|O_NONBLOCK) = 0 read(9, 0x9271eb8, 8192) = -1 EAGAIN (Resource temporarily unavailable) fcntl64(9, F_SETFL, O_RDWR) = 0 setsockopt(9, SOL_SOCKET, SO_SNDTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 write(9, "l\0\0\0\3SELECT current FROM quota W"..., 112) = 112 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\1\0\0\1", 4) = 4 read(9, "\1", 1) = 1 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "6\0\0\2", 4) = 4 read(9, "\3def\10vpopmail\5quota\5quota\7curren"..., 54) = 54 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\1\0\0\3", 4) = 4 read(9, "\376", 1) = 1 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\n\0\0\4", 4) = 4 read(9, "\t582670292", 10) = 10 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\5\0\0\5", 4) = 4 read(9, "\376\0\0\2\0", 5) = 5 write(20, "O582670292\n", 11) = 11 read(10, "B1\nA1\tpriv/quota/storage\t-24324\n"..., 4043) = 35 fcntl64(9, F_SETFL, O_RDWR|O_NONBLOCK) = 0 read(9, 0x9271eb8, 8192) = -1 EAGAIN (Resource temporarily unavailable) fcntl64(9, F_SETFL, O_RDWR) = 0 setsockopt(9, SOL_SOCKET, SO_SNDTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 write(9, "\6\0\0\0\3BEGIN", 10) = 10 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\7\0\0\1", 4) = 4 read(9, "\0\0\0\3\0\0\0", 7) = 7 fcntl64(9, F_SETFL, O_RDWR|O_NONBLOCK) = 0 read(9, 0x9271eb8, 8192) = -1 EAGAIN (Resource temporarily unavailable) fcntl64(9, F_SETFL, O_RDWR) = 0 setsockopt(9, SOL_SOCKET, SO_SNDTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 write(9, "\247\0\0\0\3INSERT INTO quota (current,"..., 171) = 171 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\7\0\0\1", 4) = 4 read(9, "\0\2\0\3\0\0\0", 7) = 7 fcntl64(9, F_SETFL, O_RDWR|O_NONBLOCK) = 0 read(9, 0x9271eb8, 8192) = -1 EAGAIN (Resource temporarily unavailable) fcntl64(9, F_SETFL, O_RDWR) = 0 setsockopt(9, SOL_SOCKET, SO_SNDTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 write(9, "\7\0\0\0\3COMMIT", 11) = 11 setsockopt(9, SOL_SOCKET, SO_RCVTIMEO, "\2003\341\1\0\0\0\0", 8) = 0 read(9, "\7\0\0\1", 4) = 4 read(9, "\0\0\0\2\0\0\0", 7) = 7 write(10, "O\n", 2) = 2 read(14, "", 3998) = 0 epoll_ctl(5, EPOLL_CTL_DEL, 14, {0, {u32=153567344, u64=153567344}}) = 0 close(14) = 0 epoll_wait(5, {{EPOLLIN|EPOLLHUP, {u32=153601240, u64=153601240}}}, 29, 2147483647) = 1 gettimeofday({1185308526, 500644}, {420, 0}) = 0 read(10, "", 4008) = 0 epoll_ctl(5, EPOLL_CTL_DEL, 10, {0, {u32=153601240, u64=153601240}}) = 0 close(10) = 0 epoll_wait(5, <unfinished ...> Process 19816 detached $ /usr/local/dovecot/sbin/dovecot -n # 1.0.2: /etc/dovecot.conf protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable(default): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3-login login_greeting: postoffice.no-ip.com login_log_format_elements: user=<%u@%d> method=%m rip=%r lip=%l %c login_process_per_connection: no verbose_proctitle: yes first_valid_uid: 89 maildir_stat_dirs: yes maildir_copy_with_hardlinks: yes mail_executable(default): /usr/local/dovecot/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot/lib/dovecot/pop3 mail_log_prefix: %Us(%u)[%p]: pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: cache_size: 100 cache_ttl: 600 user: nobody username_translation: %@ username_format: %Lu verbose: yes passdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: prefetch plugin: quota: dict:storage=102400000 proxy::quotadict dict: quotadict: mysql:/etc/dovecot-dict-quota.conf $ cat /etc/dovecot-dict-quota.conf connect = host=192.168.15.25 dbname=vpopmail user=xxx password=xxx table = quota select_field = current where_field = path username_field = username $ cat /etc/redhat-release Red Hat Enterprise Linux ES release 4 (Nahant Update 5) $ rpm -qa | grep -i mysql MySQL-devel-standard-4.1.22-0.rhel4 MySQL-shared-standard-4.1.22-0.rhel4 MySQL-client-standard-4.1.22-0.rhel4 $ lsof -c dict -n COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME dict 19816 root cwd DIR 8,5 4096 464289 /usr/local/dovecot/var/run/dovecot dict 19816 root rtd DIR 8,7 4096 2 / dict 19816 root txt REG 8,5 1868454 464309 /usr/local/dovecot/libexec/dovecot/dict dict 19816 root mem REG 8,7 47404 160369 /lib/libnss_files-2.3.4.so dict 19816 root mem REG 8,7 112168 160456 /lib/ld-2.3.4.so dict 19816 root mem REG 8,7 1529008 163193 /lib/tls/libc-2.3.4.so dict 19816 root mem REG 8,7 16732 165083 /lib/libdl-2.3.4.so dict 19816 root mem REG 8,7 213772 165079 /lib/tls/libm-2.3.4.so dict 19816 root mem REG 8,7 107800 165077 /lib/tls/libpthread-2.3.4.so dict 19816 root mem REG 8,7 28476 165086 /lib/libcrypt-2.3.4.so dict 19816 root mem REG 8,7 97120 165087 /lib/libnsl-2.3.4.so dict 19816 root 0r CHR 1,3 1797 /dev/null dict 19816 root 1r CHR 1,3 1797 /dev/null dict 19816 root 2w FIFO 0,7 52832717 pipe dict 19816 root 3u unix 0xf4e58180 52832640 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 4r CHR 1,9 466 /dev/urandom dict 19816 root 5r 0000 0,8 0 52832719 eventpoll dict 19816 root 6r FIFO 0,7 52832720 pipe dict 19816 root 7w FIFO 0,7 52832720 pipe dict 19816 root 8u unix 0xf6fac480 52884208 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 9u IPv4 52832745 TCP 192.168.15.55:46058->192.168.15.25:mysql (ESTABLISHED) dict 19816 root 10u unix 0xdae69240 52881759 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 11u unix 0xf36af680 52884148 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 12u unix 0xf505f6c0 52881064 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 13u unix 0xd5d84280 52884278 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 15u unix 0xd1ab9b00 52883941 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 16u unix 0xf6faca80 52884264 /usr/local/dovecot/var/run/dovecot/dict-server dict 19816 root 17u unix 0xf63cb1c0 52884235 /usr/local/dovecot/var/run/dovecot/dict-server

3 7

[Dovecot] assertion failed with KMail 3.5.6 and dovecot 1.0.0
by Sylvain Joyeux 25 Jul '07

25 Jul '07

Please CC me on answer, as I'm not subscribed on the list Here is the description of the problem. The system description follows. Everytime I read my email using KMail 3.5.6, dovecot hangs up near the end. I get the following in mail.err: IMAP(doudou): file ostream-crlf.c: line 339 (_send_istream): assertion failed: ((size_t)ret <= iov.iov_len) IMAP(doudou): Raw backtrace: imap [0x10080384] -> imap(i_info+0) [0x10080120] -> imap [0x1008f70c] -> imap(o_stream_send_istream+0x7c) [0x1008d57c] -> imap(maildir_save_continue+0x4c) [0x1002bacc] -> imap(mailbox_save_continue+0x20) [0x1006d910] -> imap [0x1000f4b4] -> imap [0x1000fe44] -> imap(io_loop_handler_run+0x1b8) [0x10087ea8] -> imap(io_loop_run+0x38) [0x10086cf8] -> imap(main+0x474) [0x1001f714] -> /lib/tls/libc.so.6 [0xfe84994] -> /lib/tls/libc.so.6(__libc_start_main+0xb0) [0xfe84ad0] child 18757 (imap) killed with signal 6 The attached dovecot.txt contains the end of the tcp dump (dovecot aborts just after) System information: [~] dovecot --version 1.0.0 [~] dovecot -n # /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_process_per_connection: no login_process_size: 16 login_processes_count: 1 login_max_connections: 3 max_mail_processes: 3 mail_extra_groups: mail mail_location: maildir:~/mail namespace: type: private separator: / inbox: yes auth default: mechanisms: plain login process_size: 16 passdb: driver: pam userdb: driver: passwd OS: linux debian etch, got dovecot 1.0.0-1~bpo.1 from www.backports.org CPU arch: powerpc Filesystem: ext3 -- Sylvain Joyeux

2 1

[Dovecot] qpopper -> dovecot migration : which pop3_uidl_format?
by bob passendon 25 Jul '07

25 Jul '07

Hello, I have read in lots of places about how I should use pop3_reuse_xuidl = yes to prevent pop3 users having to re-download mail (and duplicate their e-mail) after a migration. This fails with the message: pop3_uidl_format setting is missing from config file Which setting for pop3_uidl_format should I set to prevent the e-mail being downloaded again?

2 1

[Dovecot] inotify_rm_watch() failed: Invalid argument ?
by Ralf Hildebrandt 25 Jul '07

25 Jul '07

I'm seeing these in my log: Jul 25 15:22:27 postamt dovecot: IMAP(hdaebrit): inotify_rm_watch() failed: Invalid argument Jul 25 15:22:27 postamt dovecot: IMAP(hdaebrit): inotify_rm_watch() failed: Invalid argument Jul 25 15:22:34 postamt dovecot: IMAP(hdaebrit): inotify_rm_watch() failed: Invalid argument Jul 25 15:22:34 postamt dovecot: IMAP(hdaebrit): inotify_rm_watch() failed: Invalid argument Jul 25 15:25:12 postamt dovecot: IMAP(hdaebrit): inotify_rm_watch() failed: Invalid argument Jul 25 15:25:12 postamt dovecot: IMAP(hdaebrit): inotify_rm_watch() failed: Invalid argument Jul 25 15:27:26 postamt dovecot: IMAP(hdaebrit): inotify_rm_watch() failed: Invalid argument Jul 25 15:27:26 postamt dovecot: IMAP(hdaebrit): inotify_rm_watch() failed: Invalid argument Jul 25 15:29:45 postamt dovecot: IMAP(hdaebrit): inotify_rm_watch() failed: Invalid argument Jul 25 15:29:45 postamt dovecot: IMAP(hdaebrit): inotify_rm_watch() failed: Invalid argument should I worry? Kernel 2.6.22.1 and dovecot 1.0.x hg checkout. -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) plonk(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de Microsoft: A Proven Danger to National Security http://www.infowarrior.org/articles/msdanger.pdf

2 1

[Dovecot] v1.1 alpha1: can't pop/imap login with LDAP
by Katsu Yamamoto 25 Jul '07

25 Jul '07

Hi, We recentlty upgraded our dovecot from v1.0.2 to v1.1ahpha1 under CentOS 4.4. Also, we are using Postfix 2.4.3 and OpenLDAP 2.3.35. We've been using LDAP for our POP/IAMP user authentication, however after upgrading to v1.1alpha1, LDAP authentication does't seem to be working properly. We re-examined the source code, and made a few modification. We are suspecting that... (1) db-ldap.c is not handling value properly?? (2) userdb-ldap.c is not allocating memory for userdb_reply?? The modification we made are following: *** src/auth/db-ldap.c.orig Thu Jul 12 10:42:49 2007 --- src/auth/db-ldap.c Tue Jul 24 20:20:31 2007 *************** *** 55,60 **** --- 55,62 ---- BerElement *ber; string_t *var, *debug; + + int value_index; }; #define DEF_STR(name) DEF_STRUCT_STR(name, ldap_settings) *************** *** 764,769 **** --- 766,772 ---- ctx->vals = ldap_get_values(ctx->conn->ld, ctx->entry, ctx->attr); ctx->value = ctx->vals[0]; + ctx->value_index = 0; } static void *************** *** 797,804 **** db_ldap_result_change_attr(ctx); } else { /* continuing existing attribute */ ! if (ctx->value != NULL) ! ctx->value++; } if (ctx->value != NULL) { --- 800,806 ---- db_ldap_result_change_attr(ctx); } else { /* continuing existing attribute */ ! ctx->value = ctx->vals[++ctx->value_index]; } if (ctx->value != NULL) { *** src/auth/userdb-ldap.c.orig Thu Jul 12 10:42:49 2007 --- src/auth/userdb-ldap.c Tue Jul 24 20:33:45 2007 *************** *** 37,42 **** --- 37,44 ---- struct db_ldap_result_iterate_context *ldap_iter; const char *name, *const *values; + auth_request_init_userdb_reply(auth_request); + ldap_iter = db_ldap_result_iterate_init(conn, entry, auth_request, conn->user_attr_map); while (db_ldap_result_iterate_next_all(ldap_iter, &name, &values)) { With the modification, LDAP authentication is working without any problem, at least for our system. However we are not sure whether the above modification affect other functions of dovecot. Is there an official patch to fix the problem already released? And somehow we missed it? If there is no patch, then will there be any to be released sometime in near future? By the way, our dovecot configuration is: ----- protocols: imap pop3 listen(default): *:40143 listen(imap): *:40143 listen(pop3): *:40110 ssl_disable: yes disable_plaintext_auth: no login_dir: /opt/mrn/mss/var/run/dovecot/login login_executable(default): /opt/mrn/mss/libexec/dovecot/imap-login login_executable(imap): /opt/mrn/mss/libexec/dovecot/imap-login login_executable(pop3): /opt/mrn/mss/libexec/dovecot/pop3-login mail_location: maildir:~/mail mmap_disable: yes mail_executable(default): /opt/mrn/mss/libexec/dovecot/imap mail_executable(imap): /opt/mrn/mss/libexec/dovecot/imap mail_executable(pop3): /opt/mrn/mss/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /opt/mrn/mss/lib/dovecot/imap mail_plugin_dir(imap): /opt/mrn/mss/lib/dovecot/imap mail_plugin_dir(pop3): /opt/mrn/mss/lib/dovecot/pop3 auth default: mechanisms: plain login cram-md5 apop username_translation: %@ verbose: yes debug: yes passdb: driver: ldap args: /opt/mrn/mss/etc/dovecot-ldap.conf userdb: driver: prefetch userdb: driver: ldap args: /opt/mrn/mss/etc/dovecot-ldap.conf socket: type: listen master: path: /opt/mrn/mss/var/run/dovecot/auth-master mode: 384 user: mssmail group: mssmail plugin: quota: maildir:ignore=Trash ----- And our dovecot-ldap.conf is: ----- hosts =localhost:40389 dn =cn=Manager,o=internet,c=jp dnpass = ******** auth_bind = no ldap_version = 3 base = ou=mail,o=internet,c=jp user_attrs = mail=user,uidNumber=uid,gidNumber=gid,homeDirectory=home,mailQuota=quota=maildir:ignore=Trash:storage user_filter = (&(objectClass=mailAccount)(mail=%u)) pass_attrs = mail=user,userPassword=password,uidNumber=userdb_uid,gidNumber=userdb_gid,homeDirectory=userdb_home,mailQuota=userdb_quota=maildir:igno\ re=Trash:storage pass_filter = (&(objectClass=mailAccount)(mail=%u)) default_pass_scheme = PLAIN ----- Thanks in advance, -- Katsu Yamamoto Marino Ltd., Yokohama, JAPAN

2 1

[Dovecot] need to limit imap/pop processes per user.. possible?
by Jordan Tardif 25 Jul '07

25 Jul '07

Is it possible to limit the imap/pop connections per user in dovecot? If so i couldnt find the option to do that. Thanks! -- Jordan Tardif DreamHost

2 2

[Dovecot] Fwd: SSL / TSL no advertise????
by Rob Buch 25 Jul '07

25 Jul '07

> > Hello, I am new to this list, and I wanted to bring up an issue > that I have been struggling with. ( Now that I have subscribed to > the correct list!) > > I want to enable SSL for our mail server that runs Dovecot and > Exim. I have been told that if SSL is enabled then it can break > Eudora mail clients before 6.2 ish. > > So, I was wondering if any one knows a way to turn SSL on , but > not advertise it as an option. Apparently the advertisement of SSL > for pop / imap connections causes this issue. > > Thank you all in advance. > > Current version of Dovecot is : 1.0.beta5 > > Exim Version is: exim-4.54-1 > > Rob Buch > Network administration > www.mcn.org > Now offering DSL service in the village of Mendocino - and beyond! > (707) 937-1444 X 103 > tech9(a)mcn.org > Mendocino Community Network > 10700 Ford St. Mendocino > Ca. 95460 > > >

2 1

[Dovecot] Dovecot for HP-UX
by Bandi, Uma (GE Indust, Plastics, consultant) 25 Jul '07

25 Jul '07

Hi I am trying to install Dovecot on HP-UX .I did ./configure but when I did make i am getting following error, please advice me what I have to do . uasng074@root# make No suffix list. make all-recursive No suffix list. Making all in src No suffix list. Making all in lib source='ioloop-epoll.c' object='ioloop-epoll.o' libtool=no \ DEPDIR=.deps depmode=hp /bin/sh ../../depcomp \ cc -DHAVE_CONFIG_H -I. -I. -I../.. -g -D_XOPEN_SOURCE_EXTENDED -c ioloop-epoll.c cc: "array.h", line 63: error 1588: "__inline_func_array_create_from_buffer_para m_2_buffer__" undefined. cc: "array.h", line 63: error 1531: Invalid member of struct or union. cc: "array.h", line 64: error 1588: "__inline_func_array_create_from_buffer_para m_3_element_size__" undefined. cc: "array.h", line 64: error 1531: Invalid member of struct or union. *** Error exit code 1 Stop. *** Error exit code 1 Stop. *** Error exit code 1 Stop. *** Error exit code 1 Stop.

2 1

[Dovecot] Possible to run two dovecot accessing same directory?
by Simon Gao 25 Jul '07

25 Jul '07

Hi, Just wonder if it's possible to run two dovecot servers on two different machines, but serve out of the same directories. I would like to test second dovecot server before switching from first one to second one. Any suggestions? Simon

2 1

Re: [Dovecot] Can't connect to auth server at default: Resource temporarily unavailable
by Sergey A. Kobzar 24 Jul '07

24 Jul '07

Hi bob, Tuesday, July 24, 2007, 2:30:24 PM, you wrote: > auth default { > mechanisms = plain login > userdb passwd { > args = blocking=yes ^^^^^^^^^^^^^^^^^^^ - try comment this. > } > passdb pam { > args = dovecot > } > user = dovecot-auth > } http://wiki.dovecot.org/WhyDoesItNotWork >> But 'dovecot -n' will be more useful. > dovecot doesn't seem to like "-n" It must work. # "dovecot -n" command gives a clean output of the changed settings. Use it # instead of copy&pasting this file when posting to the Dovecot mailing list. >> Which service do you use to authenticate users? > saslauthd from cyrus Sorry, I don't use it, but I think the problem is there. -- Sergey

4 7