- dovecot - dovecot.org

Re: [Dovecot] pop3-login: Fatal: io_loop_handle_add: epoll_ctl(1, 5):
by Brandon Davidson 22 Oct '09

22 Oct '09

Hi Marco, On 10/22/09 1:50 AM, "Marco Nenciarini" <mnencia(a)prato.linux.it> wrote: > This morning it happened another time, another time during the daily > cron execution. > > Oct 22 06:26:57 server dovecot: pop3-login: Panic: Leaked file fd 5: dev > 0.12 inode 1005 > Oct 22 06:26:57 server dovecot: dovecot: Temporary failure in creating > login processes, slowing down for now > Oct 22 06:26:57 server dovecot: dovecot: child 21311 (login) killed with > signal 6 (core dumps disabled) > > I have dovecot 1.2.6 with Timo's patch to check leaked descriptors. I rebuilt the binaries on our hosts with optimization disabled, and I'm still waiting for it to reoccur so I can gather file descriptor information and a core. I don't have the leak-detect patch applied. Let's see what Timo has to say about that log file bit. Since it seems to happen to you fairly frequently, it might be worth enabling core dumps as well? -Brad

2 1

[Dovecot] NFS random redirects
by Thomas Hummel 22 Oct '09

22 Oct '09

Hello, Dovecot documentation states that the "random redirects to multiple servers" NFS solution is to be avoided and I'm investigation the actual risks of it and a way to put it to test. I'm running dovecot-1.2.6 with Maildir (indexes, mailboxes and control files are all on NFS) and I'm using procmail instead of deliver as the LDA. 1. Documentation says : "Dovecot locks the maildir while doing modifications to it or while looking for new messages in it" and then mention the "dovecot-uidlist.lock" dotlock file. a) if that file fcntl'ed in addition (i.e. dotlocked + fcntled or just dotlocked) ? b) is that file THE way to lock the Maildir mentionned above or is it just something else used only for updating that particular file (i.e. is Maildir locked in some way + dovecot-uidlist.lock created or just dovecot-uidlist.lock created) ? 2. Documentation says : "NFS caching is a big problem when multiple computers are accessing the same mailbox simultaneously" I guess it's because of the dotlocks files and not fcntl locking ? Is there anything else than dovecot-uidlist which is dotlocked ? If yes, is it dotlocked only or dotlocked and fcntled ? 3. Documentation says : "Dovecot v1.1 flushes NFS caches when needed if you set mail_nfs_storage=yes" How can a program flush the NFS caches ? By which (system) call ? 4. Documentation says : "Besides the NFS cache problems described above, mailbox contents can't be cached as well in the memory either." Is it about in-memory indexes or part of indexes loaded into memory ? 5. How can I torture-test concurrent access to the same mailbox through 2 dovecot servers ? I don't see imaptest.c anymore on http://dovecot.org/tools but I see 2 nfs_test ? Is there some command line options I should use ? 6. when and why can a random redirect to multiple server can cause mailbox corruption ? On flags only or on content as well ? Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

4 9

[Dovecot] deliver+sieve: Destination address (-a) parsing changes
by Frank Behrens 21 Oct '09

21 Oct '09

When I upgraded my old, long running dovecot 1.1 to newer dovecot-1.2.4 + doevecot-sieve- 0.1.12 I observed a change in destination address (-a) parsing. Old behaviour: When Timo introduced this feature (http://www.dovecot.org/list/dovecot/2007-September/025813.html) it was possible to hand over only the detail part. In my sendmail configuration I used "-a +$h", where $h contains the detail part and may be empty. By default sendmail can call the delivery agent with the following information: $u: The recipient user (always set) $h: Detail part, may be empty $g: The sender address (relative to the recipient). New behaviour: The current sieve version needs a complete address with local- and domain-part. Otherwise we get a warning like deliver(user): sieve: envelope recipient address 'user' is unparseable. The problem is, that the domain part is not always available, e.g. for local delivered emails. This is the main problem, although the setup could be simplified if deliver would accept the old syntax. I'm going to make modifications to sendmail to be able to have all address information available, but this will not solve the problem with missing domain. Now comes my question: Is it better to enhance the address parsing in sieve plugin or should I use a wrapper around deliver? The latter is not very difficult, but introduces an additional process (that may fail). Regards, Frank -- Frank Behrens, Osterwieck, Germany PGP-key 0x5B7C47ED on public servers available.

3 7

[Dovecot] Courier to dovecot migration issue
by Rami Rami 21 Oct '09

21 Oct '09

Hello, I am trying to migrate users form courier to dovecot 1.2.6. The main configuration parameters are as follows : ------------------------------------------------------------------------------------------------------ # 1.2.6: /usr/local/etc/dovecot.conf Warning: fd limit 1024 is lower than what Dovecot can use under full load (more than 2304). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: Linux 2.6.16-1.2133_FC5 i686 Fedora Core release 5 (Bordeaux) base_dir: /usr/local/var/run/ log_path: /var/log/dovecot.log info_log_path: /var/log/maillog protocols: imap imaps pop3 pop3s ssl: no disable_plaintext_auth: no login_dir: /usr/local/var/run//login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login max_mail_processes: 2048 verbose_proctitle: yes first_valid_uid: 100 last_valid_uid: 1000000 mail_location: maildir:~/Maildir:INDEX=/tmp/QUOTA/index/%u:CONTROL=/tmp/QUOTA/control/%u mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: passdb: driver: pam args: * userdb: driver: passwd plugin: quota: fs:acad_proto ------------------------------------------------------------------------------------------------ After using the "courier-dovecot-migrate.pl" script users using pop3 are re-downloading their old emails as duplicates. This issue is resolved by replacing : maildir:~/Maildir:INDEX=/tmp/QUOTA/index/%u:CONTROL=/tmp/QUOTA/control/%u with maildir:~/Maildir any idea on the reason of these duplicates or workarounds to prevent them while keeping indexes in /tmp. Thank you.

3 3

[Dovecot] testing needed
by Timo Sirainen 21 Oct '09

21 Oct '09

Can someone find an OS where the attached program doesn't work? It should print "success". So far tested for success: Linux 2.6, Solaris 10, FreeBSD 7.2, OpenBSD 4.2.

24 30

Re: [Dovecot] IMAP goes down from time to time
by Juan Felipe Estrada 21 Oct '09

21 Oct '09

Good afternoon again I was thinking about the Dovecot upgrading so i´m doing this in the next hours. in the other hand here i show you the dovecot-ldap.conf file I think it has just the necessary options to bind the LDAP server. /hosts = ********* base = ou=People,o=*****,o=****** ldap_version = 3 auth_bind = yes auth_bind_userdn = uid=%u,ou=People,o=******,o=****** /About the dovecot.conf should I use some login options as /login_process_per_connection = yes /or /login_processes_count = 1/? For now thanks so much for the help i´ll inform about the new version installation Juan Felipe Estrada dovecot-request(a)dovecot.org escribió: > Send dovecot mailing list submissions to > dovecot(a)dovecot.org > > To subscribe or unsubscribe via the World Wide Web, visit > http://dovecot.org/cgi-bin/mailman/listinfo/dovecot > or, via email, send a message with subject or body 'help' to > dovecot-request(a)dovecot.org > > You can reach the person managing the list at > dovecot-owner(a)dovecot.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of dovecot digest..." > > > Today's Topics: > > 1. Re: Need a little shadow to MySQL conversion help (Jerry) > 2. Re: Need a little shadow to MySQL conversion help (Marc Perkel) > 3. Re: Need a little shadow to MySQL conversion help > (Andreas Ntaflos) > 4. Re: Need a little shadow to MySQL conversion help > (Andreas Ntaflos) > 5. IMAP goes down from time to time (Juan Felipe Estrada) > 6. Re: VZW Blackberry BIS problems? (Patrick Domack) > 7. Re: IMAP goes down from time to time (Andreas Ntaflos) > 8. Re: IMAP goes down from time to time (Timo Sirainen) > 9. Re: VZW Blackberry BIS problems? (Timo Sirainen) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Tue, 20 Oct 2009 12:49:16 -0400 > From: Jerry <gesbbb(a)yahoo.com> > Subject: Re: [Dovecot] Need a little shadow to MySQL conversion help > To: dovecot(a)dovecot.org > Message-ID: <20091020124916.114b8820(a)scorpio.seibercom.net> > Content-Type: text/plain; charset=US-ASCII > > On Tue, 20 Oct 2009 17:57:35 +0200 > Andreas Ntaflos <daff(a)dword.org> wrote: > > >> On Tuesday 20 October 2009 17:07:49 Timo Sirainen wrote: >> >>> On Oct 20, 2009, at 9:45 AM, Andreas Ntaflos wrote: >>> >>>> I'd say you need a static userdb. Something like this: >>>> >>> A couple of small things: >>> >>>> passdb sql { >>>> args = /etc/dovecot/dovecot-sql.conf >>>> } >>>> >>>> userdb static { >>>> args = uid=vmail gid=vmail home=/var/vmail/%Ld/%Ln >>>> allow_all_users=yes } >>>> >>> %Ld/%Ln at this point works for now, but maybe not in future. I'd >>> have passdb already change it lowercase. Also allow_all_users=yes >>> isn't required (but maybe not harmful) since passdb sql is used. >>> >> That's good to know, thanks. And you're right of course, the passdb >> should already return the correct information, Dovecot shouldn't be >> asked to change anything afterwards. >> >> Fortunately I myself don't use MySQL anymore but have migrated >> everything to PostgreSQL. It does a much better job as a DBMS >> (remote, secured access to the DB, fine-grained permissions and >> rules) and also knows about case sensitivity. So foobar(a)example.com >> is not the same as FooBar(a)example.com. Which eliminates this problem >> class altogether. >> > > MySQL, since at least 5.x knows about case. You can Google for the > information if you want. > > >>>> password_query = SELECT password FROM view_users WHERE email='%u'; >>>> >>> SELECT password, email AS user FROM .. >>> >>> changes username to same case as it's in the database (so lowercase >>> probably) and there's no need to use %L anymore. >>> >> You mean something like >> >> SELECT password, LOWER(email) as user FROM view_users WHERE email='%u' >> >> should do the trick? I shall test this on my test server, just for >> fun. >> >> Andreas >>

1 0

[Dovecot] Expire plugin per domain
by Jose Luis Marin Perez 20 Oct '09

20 Oct '09

Dear Timo thank you for the help your giving me these. I want to set expire plugin only for some domains in the same way I set autocreate plugin. vchkpw-wrapper.sh #!/bin/bash DOMAIN=`echo $VPOPUSER|sed s/^.*@//` echo $USER > /tmp/autocreate echo $DOMAIN >> /tmp/autocreate if [ "$DOMAIN" = "operaciones.qnet.com.pe" ]; then export USERDB_AUTOCREATE=INBOX.Spam export USERDB_AUTOSUBSCRIBE=INBOX.Spam export USERDB_EXPIRE="INBOX.Spam 1 INBOX.Spam.* 1" export USERDB_EXPIRE_DICT="proxy::expire" export EXTRA="USERDB_AUTOCREATE USERDB_AUTOSUBSCRIBE USERDB_EXPIRE USERDB_EXPIRE_DICT" set > /tmp/environment fi unset USER exec $* Record the right information in the database but when you run /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool --test Displays the following message Fatal: expire and expire_altmove settings not set You told me it was to migrate to Dovecot 1.2.6 with support for userdb chkpassword to use the following configuration: userdb: driver: prefetch userdb: driver: checkpassword args: /usr/local/bin/userdb.sh My problem is that I have no idea how to create the userdb.sh Please could help in the creation of this script? Thanks Jose Luis _________________________________________________________________ Explore the seven wonders of the world http://search.msn.com/results.aspx?q=7+wonders+world&mkt=en-US&form=QBRE

2 4

[Dovecot] Panic when using QRESYNC
by Michael M. Slusarz 20 Oct '09

20 Oct '09

Been seeing these occasionally for the last few weeks. Only way to fix is to remove cache files in the affected mailbox. Reproduced with both 1.2.5 and 1.2.6. IMAP transaction: ----------------- * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH] Logged in as slusarz 1 enable qresync * ENABLED QRESYNC 1 OK Enabled. 2 EXAMINE "INBOX" (QRESYNC (1254166848 789 1,2,6,7,109,113,193,230,231,279,284)) Log output: ----------- Oct 9 12:49:30 bigworm EXT(slusarz): : /home/slusarz/Maildir/dovecot.index.log: Transaction log changed unexpectedly, can't get modseq Oct 9 12:49:30 bigworm EXT(slusarz): : Panic: file imap-fetch.c: line 227 (get_expunges_fallback): assertion failed: (mail->uid > next_uid) Oct 9 12:49:30 bigworm EXT(slusarz): : Raw backtrace: /usr/lib/dovecot/imap [0x4a199b] -> /usr/lib/dovecot/imap(i_syslog_fatal_handler+0x2b) [0x4a1a5b] -> /usr/lib/dovecot/imap [0x4a10f6] -> /usr/lib/dovecot/imap(imap_fetch_begin+0x6bb) [0x42415b] -> /usr/lib/dovecot/imap(cmd_select_full+0x54a) [0x41e5ba] -> /usr/lib/dovecot/imap [0x420b4d] -> /usr/lib/dovecot/imap [0x420c2d] -> /usr/lib/dovecot/imap(client_handle_input+0x135) [0x420e55] -> /usr/lib/dovecot/imap(client_input+0x5c) [0x42192c] -> /usr/lib/dovecot/imap(io_loop_handler_run+0xbd) [0x4a988d] -> /usr/lib/dovecot/imap(io_loop_run+0x18) [0x4a8d08] -> /usr/lib/dovecot/imap(main+0x531) [0x429441] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7ffff76a09ed] -> /usr/lib/dovecot/imap [0x4199f9] Oct 9 12:49:30 bigworm dovecot: dovecot: child 9556 (imap) killed with signal 6 (core dumps disabled) GDB output: ----------- Program received signal SIGABRT, Aborted. 0x00007ffff76b3f15 in raise () from /lib/libc.so.6 (gdb) bt full #0 0x00007ffff76b3f15 in raise () from /lib/libc.so.6 No symbol table info available. #1 0x00007ffff76b5340 in abort () from /lib/libc.so.6 No symbol table info available. #2 0x00000000004a19ad in ?? () No symbol table info available. #3 0x00000000004a1a5b in i_syslog_fatal_handler () No symbol table info available. #4 0x00000000004a10f6 in i_panic () No symbol table info available. #5 0x000000000042415b in imap_fetch_begin () No symbol table info available. #6 0x000000000041e5ba in cmd_select_full () No symbol table info available. #7 0x0000000000420b4d in ?? () No symbol table info available. #8 0x0000000000420c2d in ?? () No symbol table info available. #9 0x0000000000420e55 in client_handle_input () No symbol table info available. #10 0x000000000042192c in client_input () No symbol table info available. #11 0x00000000004a988d in io_loop_handler_run () No symbol table info available. #12 0x00000000004a8d08 in io_loop_run () No symbol table info available. #13 0x0000000000429441 in main () No symbol table info available.

3 9

[Dovecot] IMAP goes down from time to time
by Juan Felipe Estrada 20 Oct '09

20 Oct '09

Good Afternoon I´m really new at this and i don´t know if i´m posting at the right place. My problem is that our Dovecot IMAP is stopping from time to time with no info in the log, i just realize about this when our support person call me saying that the whatsup monitor is showing the IMAP4 process down. I can figure about this too by trying to get in our webmail Horde and i cannot login. Here i post my Dovecot -n command i´ll appreciate any help. /# 1.0.7: /etc/dovecot.conf protocols: imap pop3 imaps pop3s ssl_cert_file: /etc/httpd/conf/ssl.crt/unimail.uninorte.edu.co.crt ssl_key_file: /etc/httpd/conf/ssl.key/unimail.uninorte.edu.co.key ssl_cipher_list: ALL:!LOW:!SSLv2 login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: maildir:/home/vmail/%u/Maildir mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 auth default: mechanisms: plain login cache_size: 300 cache_ttl: 600 worker_max_count: 200 passdb: driver: ldap args: /etc/dovecot-ldap.conf passdb: driver: pam userdb: driver: static args: uid=500 gid=500 home=/home/vmail/%u userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix / Thanks so much Juan Felipe Estrada Universidad del Norte Barranquilla Colombia

3 2

[Dovecot] Question about IMAP IDLE (and Palm Pre)
by Ingo Thierack 20 Oct '09

20 Oct '09

Hello, i try to understand, how it works (IDLE). Try to get it successfully work with my new Palm Pre ;-) which looks like to have a lot issues wir imap... so i'll blame not dovecot for the issues. Sent a mail, from googlemail. processed by dovecot ad 12:11. what me now confusing, is, that there in the out-log is nothing visible, I expected, to see there was sent an notification, there was a new mail. Do i miss something? After arounde 15 minutes the Palm sent a "DONE" and reconnect. then the messages was received. Regards Ingo email come in 2009-10-19 12:11:27 | dovecot: | deliver(xxxxxxx(a)ghostdive.org): sieve: msgid=<ac2e3a8f0910190311t381d9e33j99e6aa4d1e07c88a(a)mail.gmail.com>: stored mail into mailbox 'INBOX' outfile-log * OK [RAWLOG TIMESTAMP] 2009-10-19 12:09:33 <<<~~A4 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH] Logged in >>> <<<* CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CH ILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH ~~A5 OK Capability completed. >>> <<<* FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk \*)] Flags permitted. * 42 EXISTS * 0 RECENT * OK [UIDVALIDITY 1252956599] UIDs valid * OK [UIDNEXT 156] Predicted next UID * OK [HIGHESTMODSEQ 132] Highest ~~A6 OK [READ-WRITE] Select completed. >>> <<<* SEARCH 124 125 126 127 128 129 130 131 132 133 134 136 137 138 139 140 141 142 144 145 146 147 148 149 150 155 ~~A7 OK Search completed (0.000 secs). >>> <<<* SEARCH ~~A8 OK Search completed (0.000 secs). >>> <<<* SEARCH ~~A9 OK Search completed (0.000 secs). >>> <<<* SEARCH ~~A10 OK Search completed (0.000 secs). >>> <<<* SEARCH 155 ~~A11 OK Search completed (0.000 secs). >>> <<<+ idling >>> * OK [RAWLOG TIMESTAMP] 2009-10-19 12:14:36 <<<* OK Still here >>> * OK [RAWLOG TIMESTAMP] 2009-10-19 12:19:36 <<<* OK Still here >>> in-log <<<~~A5 capability >>> <<<~~A6 select "Inbox" >>> <<<~~A7 UID SEARCH ALL UID 124:* >>> <<<~~A8 uid search unseen UID 124:* >>> <<<~~A9 uid search answered UID 124:* >>> <<<~~A10 uid search flagged UID 124:* >>> <<<~~A11 uid search deleted UID 124:* >>> <<<~~A12 IDLE >>> <<<DONE >>>

2 2