September 2008 - dovecot

Re: [Dovecot] Panic: IMAP: Trying to allocate 2273345672 bytes
by Mark Zealey 10 Sep '08

10 Sep '08

I've just found another user that has the exact same error message (same number of bytes). However, this error only happened once, the user has logged in successfully since then and there was not an error about the uidlist having duplicate entries. Thanks, Mark -- Mark Zealey -- Shared Hosting Team Leader Product Development * Webfusion 123-reg.co.uk, webfusion.co.uk, donhost.co.uk, supanames.co.uk This mail is subject to http://www.gxn.net/disclaimer > -----Original Message----- > From: dovecot-bounces+mark.zealey=webfusion.com(a)dovecot.org > [mailto:dovecot-bounces+mark.zealey=webfusion.com@dovecot.org] > On Behalf Of Mark Zealey > Sent: 10 September 2008 12:21 > To: dovecot(a)dovecot.org > Subject: [Dovecot] Panic: IMAP: Trying to allocate 2273345672 bytes > > Hi, we're running dovecot 1.1.2 (centos5 32-bit rpm from > atrpms) havn't > had any real issues with it, but today it looks like an index > has become > badly corrupted. We're seeing this in the logs every time we > log in to a > particular account: > > 2008-09-10T11:56:07+01:00 mail8 dovecot: Panic: IMAP(xxx): Trying to > allocate 2273345672 bytes > 2008-09-10T11:56:07+01:00 mail8 dovecot: IMAP(xxx): Raw backtrace: > /usr/libexec/dovecot/imap [0x80d0310] -> /usr/libexec/dovecot/imap > [0x80d036a] -> /usr/libexec/dovecot/imap [0x80cfc2c] -> > /usr/libexec/dovecot/imap [0x80d966c] -> /usr/libexec/dovecot/imap > [0x80ce750] -> /usr/libexec/dovecot/imap(buffer_create_dynamic+0x30) > [0x80ce800] -> > /usr/libexec/dovecot/imap(mail_index_sync_ext_intro+0x4d5) [0x80c0145] > -> /usr/libexec/dovecot/imap(mail_index_sync_record+0x135) [0x80b11b5] > -> /usr/libexec/dovecot/imap(mail_index_sync_map+0x269) [0x80b1d79] -> > /usr/libexec/dovecot/imap(mail_index_map+0x38e) [0x80ab17e] -> > /usr/libexec/dovecot/imap [0x80a825c] -> > /usr/libexec/dovecot/imap(mail_index_open+0x1f4) [0x80a8554] -> > /usr/libexec/dovecot/imap(index_storage_mailbox_open+0x79) [0x809ca39] > -> /usr/libexec/dovecot/imap [0x806d339] -> /usr/libexec/dovecot/imap > [0x806e1fa] -> /usr/libexec/dovecot/imap(mailbox_open+0x49) > [0x80a09e9] > -> /usr/libexec/dovecot/imap(cmd_select_full+0xa9) [0x805e459] -> > /usr/libexec/dovecot/imap(cmd_select+0x19) [0x805e629] -> > /usr/libexec/dovecot/imap [0x805fdec] -> /usr/libexec/dovecot/imap > [0x805fe95] -> /usr/libexec/dovecot/imap [0x8060655] -> > /usr/libexec/dovecot/imap(client_input+0x5e) [0x806086e] -> > /usr/libexec/dovecot/imap(io_loop_handler_run+0x100) [0x80d7c80] -> > /usr/libexec/dovecot/imap(io_loop_run+0x28) [0x80d6df8] -> > /usr/libexec/dovecot/imap(main+0x4ac) [0x80683ec] -> > /lib/libc.so.6(__libc_start_main+0xdc) [0x8c8dec] -> > /usr/libexec/dovecot/imap [0x805a171] > > This account has about 12 mails in cur, nothing in new. Shortly before > this corruption started, I saw entries like: > > 2008-09-10T10:20:15+01:00 mail9 dovecot: IMAP(xxx): > /var/spool/mail/supplier_2/xxx/Maildir/dovecot-uidlist: Duplicate file > entry at line 2: > 1217249435.M999046P25889.mail7.atlas.pipex.net,W=2673:2,S > (uid 1 -> 14) > ... > > For all the mails in the cur directory. > > About our setup: These are on an nfs-mounted file system. It's shared > between two computers and connections are randomly redirected > to either > box; so potentially it could be an nfs type corruption issue. > Timo, I'll > send you a tarball of the dovecot* files off-list > > Thanks, > > Mark > > -- > Mark Zealey -- Shared Hosting Team Leader > Product Development * Webfusion > 123-reg.co.uk, webfusion.co.uk, donhost.co.uk, supanames.co.uk > > This mail is subject to http://www.gxn.net/disclaimer >

1 0

[Dovecot] Data loss from removing dovecot.index* files?
by John Lightsey 10 Sep '08

10 Sep '08

Hi there, I've been rewriting the courier-dovecot-migrate script to handle dovecot->courier conversions in addition to courier->dovecot. One issue I've found is that when the courier->dovecot conversion is performed a second time (using --overwrite) and the dovecot-uidlist file is written again, Dovecot starts generating errors when accessing the maildir. The simple fix is to remove all of the dovecot.index* files so they are rebuilt when the maildir is scanned again. Is it safe to do this or is information stored in the index files that can't be rebuilt by Dovecot the next time it scans the maildir? J.D.

3 4

[Dovecot] Maildirsize file isn't updated after doing POP
by Nitass Sutaveephamochanon 09 Sep '08

09 Sep '08

Hello, I have a problem about updating Maildirsize file. It seems that the Maildirsize file is not updated after user does POP mail from his maildir. I do not want to use any quota limitation in Dovecot. I only want Dovevot to update the Maildirsize file after user retrieves his mail. The Maildirsize file is created by Postfix. Would it be possible to do like this? How can I configure it? Could you please advice me? The Dovecot version is 1.0.7. Thank you very much, Nitass

2 1

[Dovecot] No buffer space available
by Rick Romero 09 Sep '08

09 Sep '08

Hi, I'm running Dovecot 1.1.3 on FreeBSD 7.0. In the past couple days, I've been seeing errors like this: Sep 9 08:43:51 sysvol dovecot: pop3-login: socketpair() failed: No buffer space available Sep 9 08:43:51 sysvol dovecot: pop3-login: socket(default) failed: No buffer space available Sep 9 08:43:51 sysvol dovecot: pop3-login: Can't connect to auth server at default: No buffer space available Sep 9 08:25:15 sysvol dovecot: pop3-login: socketpair() failed: No buffer space available pop3-login: Can't connect to auth server at default: No buffer space available What ends up happening is that the port doesn't accept any new connections until there is enough buffer space. Yesterday, I saw it a LOT with POP3 and changed my config login processes: login_process_per_connection: no login_process_size: 256 login_processes_count: 6 This seemed to clear up the issues, but now it's occurring again this morning. I haven't had any of these since I made that change either.. So there's some progress... : Sep 8 12:53:40 sysvol dovecot: Temporary failure in creating login processes, slowing down for now TOP shows: Mem: 267M Active, 5558M Inact, 1637M Wired, 217M Cache, 214M Buf, 87M Free Swap: 4096M Total, 4096M Free At this time, there are 120 imap processes, 10 POP and 1 dovecot and 1 dovecot-auth pop and imap both have 6 login processes. It doesn't seem like a load issue, but obviously something is set too low or unavailable... It's fixed for a period of time when I restart dovecot. I did a netstat -m prior to restart, and after restart, and the only main difference was this line: Before: 11/414/425/12800 4k (page size) jumbo clusters in use (current/cache/total/max) After: 0/425/425/12800 4k (page size) jumbo clusters in use (current/cache/total/max) (After about 5 minutes 'current' went to 3) This machine also runs NFSd and MySQL. Any ideas? Thanks, Rick

2 3

[Dovecot] antispam plugin problem with dspam
by Harlan Stenn 09 Sep '08

09 Sep '08

I'm trying to use the dovecot antispam plugin with dspam. I'm running dovecot 1.1.2. Using thunderbird and IMAP, when I drag a spam message from the inbox into the SPAM folder, I get a popup saying "The current command did not succeed. The mail server responded: antispam signature not found. When I look at the message in the maildir folder, I see the dspam signature both in the header of the message and at the end of the body. What's a good way to debug this situation and figure things out? I'm not seeing anything in any log files, and I'm not seeing much in the way of debug capability in the dovecot antispam plugin. Harlan

4 7

[Dovecot] Maildir: directory instead of file
by Luigi Rosa 09 Sep '08

09 Sep '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Since 1.0 sometimes happens that in the 'cur' directory of a maildir handled by Dovecot I find a directory instead of a file, just like this: drwx------ 2 mailvirtuale mailvirtuale 4096 Aug 25 15:11 1219669940.M113849P13510.gw.areanet.it:2,S drwx------ 2 mailvirtuale mailvirtuale 20480 Aug 25 09:49 :2,S This is the first time I find a directory named as a file, all other times I found a directory named just ":2,S" Looking to the dovecot log I found this regarding the second directory: Aug 25 09:46:27 gw dovecot: imap-login: Login: user=<dsimonutti(a)areanet.it>, method=PLAIN, rip=192.168.0.100, lip=192.168.0.254 Aug 25 09:46:27 gw dovecot: IMAP(dsimonutti(a)areanet.it): /var/spool/mail/areanet.it/dsimonutti/.DNS/dovecot-uidlist: Duplicate file entry at line 4673: 1171533630.P28442Q0M560589.gw.areanet.it:2,Sa (uid 2260 -> 4827) Aug 25 09:46:27 gw dovecot: IMAP(dsimonutti(a)areanet.it): /var/spool/mail/areanet.it/dsimonutti/.DNS/dovecot-uidlist: Duplicate file entry at line 4674: 1176880103.P23548Q8M176396.gw.areanet.it:2,S (uid 819 - > 4828) Aug 25 09:46:27 gw dovecot: IMAP(dsimonutti(a)areanet.it): /var/spool/mail/areanet.it/dsimonutti/.DNS/dovecot-uidlist: Duplicate file entry at line 4675: 1178089300.P27489Q19M500157.gw.areanet.it:2,Sa (uid 941 -> 4829) (and many other lines like the last ones) But regarding the first directory I just found this entry: Aug 25 15:12:27 gw dovecot: IMAP(dsimonutti(a)areanet.it): Fixed a duplicate: /var/spool/mail/areanet.it/dsimonutti/cur/:2, -> 1219669940.M113849P13510.gw.areanet.it In the maildir section of configuration file I enabled just this: maildir_copy_with_hardlinks = yes Ciao, luigi - -- / +--[Luigi Rosa]-- \ There are three possibilities: Pioneer's solar panel has turned away from the sun; there's a large meteor blocking transmission; or someone loaded Star Trek 3.2 into our video processor. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIxor/3kWu7Tfl6ZQRAnDHAJ9HAQwTmqqWYjBeqTjg2IQNpcuf3wCgl+lM 0hekHvqK2jBHDCfboe2pHEw= =4s3G -----END PGP SIGNATURE-----

2 2

[Dovecot] Sieve, and logging.
by Scott Sharkey 09 Sep '08

09 Sep '08

Hi All, Relatively new to Dovecot - converting from courier-imap. So far, I've got it working with virtual users (postfixadmin tables), and it seems to be working. I'm trying to get sieve working. It's not, so I tried turning up the logging, and putting it into a separate log file to get it out of the syslog for now. I can get the main dovecot to log, but I cannot get any log out of dovecot-deliver. I am thinking of replacing the dovecot-deliver with a shell script to see if it's even being called. Suggestions welcome! -Scott Logs and other relevant info follows: .# 1.1.2: /etc/dovecot/dovecot.conf log_path: /var/log/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps pop3s managesieve ssl_ca_file: /etc/ssl/certs/ca.crt ssl_cert_file: /etc/ssl/certs/mail.linuxunlimited.com.crt ssl_key_file: /etc/ssl/private/mail.linuxunlimited.com.key login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_greeting_capability(managesieve): no first_valid_uid: 2000 mail_privileged_group: mail mail_location: maildir:/home/virtual/%d/%n/Maildir mail_debug: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve imap_client_workarounds(default): outlook-idle tb-extra-mailbox-sep imap_client_workarounds(imap): outlook-idle tb-extra-mailbox-sep imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls pop3_client_workarounds(managesieve): sieve_storage(default): sieve_storage(imap): sieve_storage(pop3): sieve_storage(managesieve): /home/virtual/%d/%n/sieve sieve(default): sieve(imap): sieve(pop3): sieve(managesieve): ~/.dovecot.sieve auth default: mechanisms: plain login user: nobody passdb: driver: pam passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: vmail plugin: sieve: /home/virtual/%d/%n/sieve ------------------------------------------------------------------------ # 1.1.2: /etc/dovecot/dovecot-sql.conf driver = mysql connect = host=127.0.0.1 dbname=mail user=postfixadmin password=xxxxxxxx default_pass_scheme = MD5-CRYPT password_query = SELECT password FROM mailbox WHERE username = '%u' AND active = 1 user_query = SELECT maildir, 2000 AS uid, 2000 AS gid FROM mailbox WHERE username = '%u' AND active = 1 ------------------------------------------------------------------------ Directories: /home: -rwxrwxrwx 1 root root 0 2008-09-07 23:06 dovecot-deliver.log drwxrwxrwx 2 root root 4096 2008-09-07 22:41 sieve drwxrwx--- 8 vmail vmail 4096 2008-08-27 22:26 virtual /home/sieve: -rw-r--r-- 1 root root 353 2008-09-07 22:41 global_rules.sieve -rw-r--r-- 1 root root 388 2008-09-07 23:22 global_rules.sievec /home/sieve/global_rules.sieve: require ["fileinto"]; require ["imapflags"]; if header :contains "Subject" "TestSPAM" { setflag "\\Seen"; fileinto "Junk"; stop; } ------------------------------------------------------------------------ Section of postfix main.cf virtual_transport = dovecot # limit dovecot service to one at a time... dovecot_destination_recipient_limit = 1 local_transport = virtual transport_maps = proxy:mysql:/etc/postfix/mysql_transport_map.cf ------------------------------------------------------------------------ Section of postfix master.cf # Dovecot Local Delivery Agent dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${recipient} ------------------------------------------------------------------------ dovecot.log dovecot: 2008-09-07 23:02:49 Info: Dovecot v1.1.2 starting up dovecot: 2008-09-07 23:02:50 Info: auth-worker(default): mysql: Connected to 127.0.0.1 (mail) dovecot: 2008-09-07 23:03:25 Info: auth-worker(default): mysql: Connected to 127.0.0.1 (mail) dovecot: 2008-09-07 23:03:25 Info: auth-worker(default): mysql: Connected to 127.0.0.1 (mail) dovecot: 2008-09-07 23:03:27 Error: auth-worker(default): pam(ssharkey(a)linuxunlimited.com,24.192.79.39): pam_authenticate() failed: User not known to the underlying authentication module dovecot: 2008-09-07 23:03:27 Info: auth-worker(default): mysql: Connected to 127.0.0.1 (mail)

3 2

[Dovecot] cyrus2courier or cyrus2maildir.py, which to choose?
by Steinar Bang 09 Sep '08

09 Sep '08

What's the best utility to use to convert mail folders from a cyrus 2.2.13-10, on a debian 4.0 Etch system, to folders that can be used by dovecot? The http://wiki.dovecot.org/Migration/Cyrus page isn't too clear on what's the difference. cyrus2courier says "It should be able to preserve message UIDs, flags and 26 first keywords." cyrus2maildir.py says "preserves delivery timestamps and \Seen flags." But does that means that what cyrus2maildir.py preserves is in addition to what cyrus2courier preserves? Or is what cyrus2maildir preserves a subset of what cyrus2courier preserves? Thanx! - Steinar

2 2

[Dovecot] Error in Sieve + Dovecot 1.1.3
by Allan Cassaro 09 Sep '08

09 Sep '08

Hi, when I upgrade my dovecot to lastest version (from 1.1.1 to 1.1.3) and sieve plugins I discover a little problem in deliver (LDA) or in Sieve interface. With version 1.1.1 I have this in my dovecot.conf (and works fine) protocol lda { postmaster_address = root(a)mct.gov.br hostname = faraday.mct.gov.br mail_debug = no mail_plugins = cmusieve quota sieve_global_dir = /etc/dovecot/scriptssieve/ sieve = /home/%u/.dovecot.sieve } When I upgrade, the deliver/LDA stop to work and show me this message (in logs): deliver(acassaro): cmusieve: /home/%u/.dovecot.sieve doesn't exist So, when I change the "sieve" parameter, everything works fine again. protocol lda { postmaster_address = root(a)mct.gov.br hostname = faraday.mct.gov.br mail_debug = no mail_plugins = cmusieve quota sieve_global_dir = /etc/dovecot/scriptssieve/ sieve = ~/.dovecot.sieve } So, I don't know if this error is on LDA or Sieve patch (probably in sieve patch) Versions: dovecot-1.1.3 dovecot-sieve-1.1.5 dovecot-1.1-managesieve-0.10.3 dovecot-1.1.2-managesieve-0.10.3.diff Regards.

4 3

[Dovecot] Thunderbird, subscriptions, and upgrade to 1.1.3
by Jack Stewart 08 Sep '08

08 Sep '08

Hi, I've upgraded from 1.0.7 to 1.1.3. When I did this, my Thunderbird lost its brain and did not show some subscribed folders. squirrelmail also seemed to have issues. Applemail and mutt were fine. The configuration output is below. Hopefully this is just me and just random bizarreness. There wasn't a problem in 1.0.7 but I could have been caught in mid-upgrade. Thunderbird did not seem to update the subscription file (or at least I could not find the one it thought it was using). Any pointers are appreciated. Thanks in advance. ---Jack /opt/dovecot/sbin/dovecot -c /etc/dovecot.conf -n # 1.1.3: /etc/dovecot.conf Warning: fd limit 1024 is lower than what Dovecot can use under full load (more than 6144). Either grow the limit or change login_max_processes_count and max_mail_processes settings base_dir: /var/run/dovecot/default-imap syslog_facility: local4 protocols: imap imaps listen: *:143 ssl_listen: *:993 ssl_ca_file: /etc/pki/dovecot/certs/caltech-ca.pem ssl_cert_file: /etc/pki/dovecot/certs/imap.caltech.edu.pem ssl_key_file: /etc/pki/dovecot/private/imap.caltech.edu.pem disable_plaintext_auth: yes login_dir: /var/run/dovecot/default-imap/login login_executable: /opt/dovecot/libexec/dovecot/imap-login login_greeting_capability: yes login_processes_count: 16 login_max_processes_count: 2048 max_mail_processes: 4096 verbose_proctitle: yes mail_location: maildir:/var/spool/maildir/%1Ln/%Ln:INDEX=/var/spool/dovecot/indexes/%1Ln/%Ln:CONTROL=/var/spool/dovecot/uidl/imap/%1Ln/%L mail_debug: yes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes maildir_copy_preserve_filename: yes mail_plugins: fts fts_squat imap_client_workarounds: delay-newmail outlook-idle netscape-eoh pop3_reuse_xuidl: yes pop3_uidl_format: UID%u-%v namespace: type: private separator: . prefix: Mail. inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login verbose: yes passdb: driver: ldap args: /etc/dovecot.conf-ldap userdb: driver: static args: uid=vmail gid=mail home=/var/spool/maildir/%1Ln/%Ln socket: type: listen master: path: /var/run/dovecot/default-imap/auth-master mode: 384 user: vmail group: mail plugin: fts: squat fts_squat: partial=4 full=8

2 2