- dovecot - dovecot.org

[Dovecot] dovecot - mac firewall problem
by Patrick Fay 31 Aug '10

31 Aug '10

> >>>> Hi, >>>> I am running dovecot 1.2.11 on mac osx 1.5.8. Everything works >>>> perfectly with the application-level firewall off, but enabling the >>>> application firewall prevents dovecot connections. I have tried >>>> explicitly authorizing dovecot in the firewall, but it does not work. I >>>> have searched everywhere I can think of to look, and haven't found a >>>> solution, but have seen a couple other reports of what seems to be the >>>> same problem. The firewall logs the activity with what looks like a >>>> corrupt process name: a typical appfirewall.log entry looks like: >>>> >>>> Aug 26 20:43:45 hostname Firewall[55]: Deny ^L connecting from >>>> XX.XX.XX.XX:37310 uid = 0 proto=6 >>>> Aug 26 20:43:53 hostname Firewall[55]: Deny ^H?^U???^Z connecting from >>>> XX.XX.XX.XX:37310 uid = 0 proto=6 >>>> Aug 26 20:44:09 hostname Firewall[55]: Deny ^L connecting from >>>> XX.XX.XX.XX:37310 uid = 0 proto=6 >>>> Aug 26 20:44:34 hostname Firewall[55]: Deny ^L connecting from >>>> XX.XX.XX.XX:37312 uid = 0 proto=6 >>>> Aug 26 20:44:45: --- last message repeated 6 times --- >>>> >>>> where "hostname" is my server name and the XX's are my client's IP >>>> address. For all of the other services I've used, the process name >>>> (e.g. dovecot) should appear after "Deny" when blocking traffic, instead >>>> of the funny characters. Any advice on how I could resolve this issue >>>> would be greatly appreciated. Thanks! >>> >>> >> >> I was hoping to use the application firewall because this machine gets used both as a server as well as a client machine for more general use. I haven't been able to find any specific documentation for it, but I have found that the firewall works fine with postfix and several file services I use (enabling/disabling works as expected, process names get logged as expected, etc). Thanks! >> >> Patrick > > So, you're running Dovecot and Postfix on a laptop? WTF? > > -- > Stan Hi, Sorry for the confusion--no laptop involved. Postfix, dovecot, etc, all running on intel-based desktop mac (a mac pro). Patrick

5 5

[Dovecot] mixing 1.2 and 2.0?
by Cor Bosman 31 Aug '10

31 Aug '10

Hi all, anyone know if it's safe to mix a 1.2 environment with 2.0 servers? Im planning on adding some 2.0 servers for test purposes, but now im wondering if thats going to mess up index files or other files for users selecting the test server and then switching back to our normal servers. Regards, Cor

2 1

Re: [Dovecot] dovecot - mac firewall problem
by Patrick Fay 31 Aug '10

31 Aug '10

Hi, Thanks everyone for your help and input. I think perhaps my attempt to be brief and focused in posing my question has led to some confusion about my needs and configuration. I do not have the luxury of being able to segregate the server (postfix and dovecot) from client (GUI, etc) on different machines. I am, as Charles' surmised, using this to aggregate disparate mail streams into a single location, and using dovecot to serve it. Since I must run client-ish applications on this machine, the application firewall is desirable. The anticipated load on this system from the server side is quite light, so the throughput overhead incurred by the application firewall is negligible. The problem appears to be that--for some reason--dovecot identifies itself incorrectly to the application firewall, resulting in the garbage shown in the logs and failure to permit this connection (the firewall is configured to explicitly permit connections for dovecot). I note that other daemons (e.g. postfix, sshd, etc) do not exhibit this defect; the firewall works as expected for every other service I've tried except dovecot. The logs for the firewall appear as: Aug 26 20:43:45 hostname Firewall[55]: Deny ^L connecting from XX.XX.XX.XX:37310 uid = 0 proto=6 Aug 26 20:43:53 hostname Firewall[55]: Deny ^H?^U???^Z connecting from XX.XX.XX.XX:37310 uid = 0 proto=6 Both of these are dovecot hits--but the name is different each time. Also the ?'s aren't really "?" marks; they're trans-ascii characters with high bits set that my mailer doesn't like very much. It really looks like a misdirected pointer or something somewhere, but I'm not familiar enough with the codebase to know where to start looking, or if in fact it is something else that is misconfigured. Any thoughts on how to resolve this? Patrick

3 2

[Dovecot] getdents() with 4KB buffer - seems slow (Maildir, large inbox)
by Marinos Yannikos 31 Aug '10

31 Aug '10

Hi, I have a very large inbox (~146K mails) in Maildir format and dovecot seems to spend a lot of time rescanning the directory, especially when the server is loaded. I'm not sure whether this is triggered by Thunderbird or done regularly, but it takes longer when the server is loaded, so sometimes it seems that it is scanning continuously. Since it takes around 2000 getdents64() syscalls to scan my inbox, I'm wondering whether the buffer size is a bit small with 4KB and might benefit from being configurable: ... getdents64(8, /* 73 entries */, 4096) = 4088 getdents64(8, /* 73 entries */, 4096) = 4088 getdents64(8, /* 73 entries */, 4096) = 4088 getdents64(8, /* 73 entries */, 4096) = 4088 getdents64(8, /* 73 entries */, 4096) = 4088 ... (strace output of an imap process belonging to me) The behaviour is identical on 1.0.15 and 1.2.13 (I just upgraded). Regards, Marinos PS. I know that the main reason for slowness is my large inbox and the server being loaded (disk I/O), but still, so many syscalls just to rescan the inbox seems wasteful. # dovecot -n # 1.2.13: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-6-xen-686 i686 Debian 4.0 log_timestamp: %Y-%m-%d %H:%M:%S ssl_listen: * ssl_cert_file: XXXXX (censored) ssl_key_file: XXXXX login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_process_size: 32 login_processes_count: 8 verbose_proctitle: yes mail_privileged_group: mail mail_location: maildir:~/Maildir mbox_write_locks: fcntl dotlock mail_process_size: 2048 imap_client_workarounds: outlook-idle auth default: passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix

2 1

[Dovecot] Mail error in log
by Ian macdonald 31 Aug '10

31 Aug '10

Hi All, I am getting the following in the mail error log deliver(julie): safe_mkstemp(/home/julie/.temp.geomail.10443.) failed: Permission denied This is correct julie does not have access to write to her home directory Julie is a system user who is chrooted so her home is owned by root, this is for when she logs in via sftp to retrieve files she can only access folders below her home. I am using Maildir and julie does have access to ~Maildir, is there any reason why deliver is attempting to use her user directory and not her Maildir? Cheers Ian

3 3

[Dovecot] istream_read like zlib, but without zlib
by Alex Baule 31 Aug '10

31 Aug '10

Hy Timo ! I Made some modification in stream_read in zlib. I remove all zlib part, because i don't need this, but i need to read a istream to change it. Well, i create a size_t called supersize, with is a substitute for stream->zs.avail_in. The trouble is, my debug file have a lot of "READ Plugin\n", and i think it's because my read becomes a loop, i think it's because i don't know to identify the EOF from the istream. you can help me to identify the EOF and set it ? Tks .!!! static ssize_t i_stream_emx_read(struct istream_private *stream) { struct emx_istream *emxstream = (struct emx_istream *)stream; const unsigned char *data; uoff_t high_offset; size_t size; int ret; fprintf(emxstream->debug,"READ Plugin\n"); fflush(emxstream->debug); high_offset = stream->istream.v_offset + (stream->pos - stream->skip); if (emxstream->eof_offset == high_offset) { i_assert(emxstream->high_pos == 0); stream->istream.eof = TRUE; return -1; } if (stream->pos < emxstream->high_pos) { /* we're here because we seeked back within the read buffer. */ ret = emxstream->high_pos - stream->pos; stream->pos = emxstream->high_pos; emxstream->high_pos = 0; return ret; } emxstream->high_pos = 0; if (stream->pos + CHUNK_SIZE > stream->buffer_size) { /* try to keep at least CHUNK_SIZE available */ if (!emxstream->marked && stream->skip > 0) { /* don't try to keep anything cached if we don't have a seek mark. */ i_stream_compress(stream); } if (stream->max_buffer_size == 0 || stream->buffer_size < stream->max_buffer_size) i_stream_grow_buffer(stream, CHUNK_SIZE); if (stream->pos == stream->buffer_size) { if (stream->skip > 0) { /* lose our buffer cache */ i_stream_compress(stream); } if (stream->pos == stream->buffer_size) return -2; /* buffer full */ } } if(emxstream->supersize == 0){ /* need to read more data. try to read a full CHUNK_SIZE */ i_stream_skip(stream->parent, emxstream->prev_size); if (i_stream_read_data(stream->parent, &data, &size, CHUNK_SIZE-1) == -1 && size == 0) { if (stream->parent->stream_errno != 0) { stream->istream.stream_errno = stream->parent->stream_errno; } else { i_assert(stream->parent->eof); stream->istream.stream_errno = EPIPE; } return -1; } emxstream->prev_size = size; if (size == 0) { /* no more input */ stream->istream.eof = TRUE; i_assert(!stream->istream.blocking); return 0; } fprintf(emxstream->debug,"READ =|%s|= Plugin\n",data); fflush(emxstream->debug); memcpy(stream->w_buffer + stream->pos, data,size); emxstream->supersize = size; } size = stream->buffer_size - stream->pos; stream->pos += size; if(stream->istream.eof == TRUE){ emxstream->eof_offset = stream->istream.v_offset + stream->pos; i_stream_skip(stream->parent, emxstream->prev_size - emxstream->supersize); emxstream->supersize = 0; emxstream->prev_size = 0; } if (size == 0) { /* read more input */ return i_stream_emx_read(stream); } return size; }

1 0

Re: [Dovecot] fetchmail wakeup
by Amon Ott 31 Aug '10

31 Aug '10

On Tuesday 31 August 2010 wrote Peter Dungel: > Does someone know, if in the new release of dovecot 2.x.x there is a > feature implemented, that wakes fetchmail or any other program on a client > request, or is the "fetchmail wakeup" plugin still the only way to do this > (at least I've not found any other, and that plugin never worked for me),.. You could replace the imap or pop3 helper program with a wrapper that first sends the fetchmail daemon a wakeup signal, waits a few secs and then calls the original. Amon Ott -- Dr. Amon Ott - m-privacy GmbH Am Köllnischen Park 1, 10179 Berlin Tel: +49 30 24342334 Fax: +49 30 24342336 Web: http://www.m-privacy.de Handelsregister: Amtsgericht Charlottenburg HRB 84946 Geschäftsführer: Dipl.-Kfm. Holger Maczkowsky, Roman Maczkowsky GnuPG-Key-ID: EA898571

1 0

[Dovecot] fetchmail wakeup
by Peter Dungel 31 Aug '10

31 Aug '10

Does someone know, if in the new release of dovecot 2.x.x there is a feature implemented, that wakes fetchmail or any other program on a client request, or is the "fetchmail wakeup" plugin still the only way to do this (at least I've not found any other, and that plugin never worked for me),.. Yours Peter

1 0

[Dovecot] Wrong MySQL sintax, I can't login
by Pablo 31 Aug '10

31 Aug '10

Hi guys: I can't login as a user: The output of mail.log: Aug 31 08:39:45 socrates dovecot: auth(default): client in: AUTH^I1^IPLAIN^Iservice=imap^Ilip=178.63.82.247^Irip=81.39.27.227^Ilport=143^Irport=33715^Iresp=AHBhYmxvLnJvZHJpZ3VlekBlc2N1ZWxhc3VwZXJpb3JkZWNvYWNoaW5nLmNvbQBwZXJpa2l0YS4= Aug 31 08:39:45 socrates dovecot: auth-worker(default): sql(pablo.rodriguez(a)escuelasuperiordecoaching.com,81.39.27.227): query: SELECT password FROM mailbox WHERE username = 'pablo.rodriguez(a)escuelasuperiordecoaching.com' Aug 31 08:39:45 socrates dovecot: auth(default): client out: OK^I1^Iuser=pablo.rodriguez(a)escuelasuperiordecoaching.com Aug 31 08:39:45 socrates dovecot: auth(default): master in: REQUEST^I65^I16796^I1 Aug 31 08:39:45 socrates dovecot: auth-worker(default): sql(pablo.rodriguez(a)escuelasuperiordecoaching.com,81.39.27.227): SELECT maildir, 1001 AS uid, 1001 AS gid FROM mailbox WHERE username = 'pablo.rodriguez(a)escuelasuperiordecoaching.com Aug 31 08:39:45 socrates dovecot: auth-worker(default): sql(pablo.rodriguez(a)escuelasuperiordecoaching.com,81.39.27.227): User query failed: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ''pablo.rodriguez(a)escuelasuperiordecoaching.com' at line 1 Aug 31 08:39:45 socrates dovecot: auth(default): master out: FAIL^I65 Aug 31 08:39:45 socrates dovecot: imap-login: Internal login failure (auth failed, 1 attempts): user=<pablo.rodriguez(a)escuelasuperiordecoaching.com>, method=PLAIN, rip=81.39.27.227, lip=178.63.82.247 My Dovecot version: 1.2.9 My Dovecot configuration: # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-23-server x86_64 Ubuntu 10.04.1 LTS reiserfs log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/mail/dovecot.crt ssl_key_file: /etc/ssl/mail/dovecot.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_location: maildir:/home/vmail/%u/ mail_debug: yes mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: mechanisms: plain login verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail My Dovecot MySQL configuration: driver=mysql connect = host=localhost dbname=postfix user=postfix password=xxxxxx default_pass_scheme = CRYPT password_query = SELECT password FROM mailbox WHERE username = '%u' user_query = SELECT maildir, 1001 AS uid, 1001 AS gid FROM mailbox WHERE username = '%u Can anyone help me? I've seen that log told me "wrong syntax", but I think upper query is right, isn't it? Any hint? Thanks in advance :-)

2 2

[Dovecot] Combining ManageSieve with hand-written scripts
by Jason Bleazard 30 Aug '10

30 Aug '10

Hi, new to Dovecot, forgive me if I'm missing something basic... I'm trying to figure out if there's a way to use a couple of custom rules alongside ManageSieve. Most of the time I like the ManageSieve interface in Roundcube, but there's one rule that I can't get it to do the way I want (it's a notify rule, and I don't like the way Roundcube constructs the notify). I figured out how to write it by hand, but of course I can't put my own rules in Roundcube's file or it gets really confused. I tried adding an include to the generated file, but Roundcube politely removes it for me the next time I use the rule editor. (Squirrelmail doesn't seem to be any better in this regard.) I thought I could do something like sieve_before = ~/sieve/custom.sieve but that doesn't seem to work. I couldn't even see any evidence in the log that it attempted to look at that file. Apparently sieve_before isn't meant to work on a per-user basis. If I do a global sieve_before, can I have it "include :personal"? If so, what's going to happen with the script compilation? From what I understand, it can't be compiled globally, since each user has a different custom rule set. Am I trying to do the impossible here? Thanks for any ideas, Jason Bleazard

2 2