November 2011 - dovecot

[Dovecot] 2.0.14 doveadm proxy list segfault
by Tom Pawlowski 09 Feb '12

09 Feb '12

Hi Timo, Periodic segfaults with doveadm proxy list: root@director1:~) doveadm proxy list doveadm(root): Error: LIST failed: Disconnected Segmentation fault (core dumped) Sometimes it's just the 'LIST failed' error, other times it's the error with the segfault. Usually the first attempt to call it works, subsequent attempts fail. I've attached a strace log of it in action. -- Tom Pawlowski OIT-CSS System Administrator office: Hill 147 email: tompru(a)jla.rutgers.edu phone: (732) 445-2634

2 1

[Dovecot] movming mail out of alt storage
by Micah Anderson 31 Jan '12

31 Jan '12

I moved some mail into the alt storage: doveadm altmove -u johnd(a)example.com seen savedbefore 1w and now I want to move it back to the regular INBOX, but I can't see how I can do that with either 'altmove' or 'mailbox move'. thanks! micah --

3 5

[Dovecot] compressed mboxes very slow
by kjonca＠o2.pl 29 Jan '12

29 Jan '12

I have some archive mails in gzipped mboxes. I could use them with dovecot 1.x without problems. But recently I have installed dovecot 2.0.12, and they are slow. very slow. Creating index files takes about 10 minutes for ~20M file with 560 messages for bzipped mbox, for gzipped is little better but still unusable :( Stracing dovecot process shows that every ~ 20 messages it rereads complete mbox file. Am I doing something wrong? KJ -- http://modnebzdury.wordpress.com/2009/10/01/niewiarygodny-list-prof-majewsk…

4 13

[Dovecot] Dovecot crashes totally
by Gordon Grubert 18 Jan '12

18 Jan '12

Hello, our dovecot server crashes totally without any really useful log messages. The error log can be found in the attachment. The only way to get dovecot running again is a complete system restart. Dovecot version: 2:2.0.15-0~auto+5 (2.0.15 (6b7242ead6ed)) Configuration : see attachment OS : Debian Squeeze amd64 Dovecot source : http://xi.rename-it.nl/debian/ \ stable-auto/dovecot-2.0 main This problem has already occurred with the version 2.0.13 where the log says as few as the current logs :-( Best regards, Gordon -- Leiter AG Technische Infrastruktur und Basisdienste Universitaetsrechenzentrum (URZ) E.-M.-Arndt-Universitaet Greifswald Felix-Hausdorff-Str. 12 17489 Greifswald Germany Tel. +49 3834 86-1456 Fax. +49 3834 86-1401

3 3

[Dovecot] Mail lost - maybe a bug???
by Marco Carcano 21 Dec '11

21 Dec '11

Hello everybody I'm struggling against what seems a really serious trouble: sometimes mail get lost I did all the possible checks, but they seems really lost - I know is absurd, but it seems so it has been noticed by two users on my server: intially I tought that was their mistake (mail deleted, mail into spam, ecc), but it wasn't I deeply checked mail logs, and it seems that mail are delivered (the path is postfix->amavis->dovecotlda) - log files says that messages are delivered, but sometimes we lost a message. I also tried to get into the Maildir and grep the subject of the lost email: if it was addressed to more recipients I'm able to get it on some of them, but not to all (look at the example below) I hope I have clearly explained everything, otherwise let me knowmydomain now an extract from the log file: Oct 27 11:20:29 srv001 postfix/smtpd[24562]: connect from usstlz- psecap06.emerson.com[144.191.128.17] Oct 27 11:20:30 srv001 postfix/smtpd[24562]: CE0B74E4A9F: client=usstlz-psecap06.emerson.com[144.191.128.17] Oct 27 11:20:31 srv001 postfix/cleanup[25157]: CE0B74E4A9F: warning: header Subject: =?utf-8?B? RW1lcnNvbiBHbG9iYWwgVXNlcnMgRXhjaGFuZ2UgMjAxMiBpbiBEw7xzc2VsZG9yZiA6IFJlaWNoZW4gU2llIGpldHp0IElocmUgUHLDpHNlbnRhdGlvbmVuIGVpbg ==?= from usstlz-psecap06.emerson.com[144.191.128.17]; from=<Emerson.News(a)emersonprocess.com > to=<oil(a)mydomain.ch> proto=ESMTP helo=<USSTLZ-PSECAP06.EMERSON.COM> Oct 27 11:20:31 srv001 postfix/cleanup[25157]: CE0B74E4A9F: message- id=<e9447410-51fe-45ff-b624-197840b9a862(a)usstlz-pinfez02.emrsn.org> Oct 27 11:20:31 srv001 postfix/qmgr[11827]: CE0B74E4A9F: from=<Emerson.News(a)emersonprocess.com >, size=22689, nrcpt=3 (queue active) Oct 27 11:20:33 srv001 dovecot: imap(lromano): Disconnected: Logged out bytes=632/34319 Oct 27 11:20:34 srv001 postfix/smtpd[25162]: connect from localhost.localdomain[127.0.0.1] Oct 27 11:20:34 srv001 postfix/smtpd[25162]: B16284E4AA2: client=localhost.localdomain[127.0.0.1] Oct 27 11:20:34 srv001 postfix/cleanup[25157]: B16284E4AA2: message- id=<e9447410-51fe-45ff-b624-197840b9a862(a)usstlz-pinfez02.emrsn.org> Oct 27 11:20:34 srv001 postfix/qmgr[11827]: B16284E4AA2: from=<Emerson.News(a)emersonprocess.com >, size=23094, nrcpt=3 (queue active) Oct 27 11:20:34 srv001 amavis[22923]: (22923-01) Passed CLEAN, [144.191.128.17] [155.177.20.144] <Emerson.News(a)emersonprocess.com> -> <user1(a)mydomain.local>,<user2(a)mydomain.local>,<user3(a)mydomain.local>, Message-ID: <e9447410-51fe-45ff-b624-197840b9a862(a)usstlz-pinfez02.emrsn.org >, mail_id: 6rtF4927FAjt, Hits: -0.518, size: 22687, queued_as: B16284E4AA2, 3293 ms Oct 27 11:20:34 srv001 postfix/lmtp[25158]: CE0B74E4A9F: to=<user1(a)mydomain.local >, orig_to=<oil(a)mydomain.ch>, relay=127.0.0.1[127.0.0.1]:10024, delay=4.2, delays=0.95/0.01/0.01/3.3, dsn=2.0.0, status=sent (250 2.0.0 from MTA([127.0.0.1]:10025): 250 2.0.0 Ok: queued as B16284E4AA2) Oct 27 11:20:34 srv001 postfix/lmtp[25158]: CE0B74E4A9F: to=<user2(a)mydomain.local >, orig_to=<oil(a)mydomain.ch>, relay=127.0.0.1[127.0.0.1]:10024, delay=4.2, delays=0.95/0.01/0.01/3.3, dsn=2.0.0, status=sent (250 2.0.0 from MTA([127.0.0.1]:10025): 250 2.0.0 Ok: queued as B16284E4AA2) Oct 27 11:20:34 srv001 postfix/lmtp[25158]: CE0B74E4A9F: to=<user3(a)mydomain.local >, orig_to=<oil(a)mydomain.ch>, relay=127.0.0.1[127.0.0.1]:10024, delay=4.2, delays=0.95/0.01/0.01/3.3, dsn=2.0.0, status=sent (250 2.0.0 from MTA([127.0.0.1]:10025): 250 2.0.0 Ok: queued as B16284E4AA2) Oct 27 11:20:34 srv001 postfix/qmgr[11827]: CE0B74E4A9F: removed Oct 27 11:20:34 srv001 dovecot: lda(user1): msgid=<e9447410-51fe-45ff-b624-197840b9a862(a)usstlz-pinfez02.emrsn.org >: saved mail to INBOX Oct 27 11:20:34 srv001 postfix/pipe[25165]: B16284E4AA2: to=<user1(a)mydomain.local >, relay=dovecot, delay=0.04, delays=0.01/0.01/0/0.02, dsn=2.0.0, status=sent (delivered via dovecot service) Oct 27 11:20:34 srv001 dovecot: lda(user2): msgid=<e9447410-51fe-45ff-b624-197840b9a862(a)usstlz-pinfez02.emrsn.org >: saved mail to INBOX Oct 27 11:20:34 srv001 postfix/pipe[25168]: B16284E4AA2: to=<user2(a)mydomain.local >, relay=dovecot, delay=0.04, delays=0.01/0.01/0/0.02, dsn=2.0.0, status=sent (delivered via dovecot service) Oct 27 11:20:34 srv001 dovecot: lda(user3): msgid=<e9447410-51fe-45ff-b624-197840b9a862(a)usstlz-pinfez02.emrsn.org >: saved mail to INBOX Oct 27 11:20:34 srv001 postfix/pipe[25170]: B16284E4AA2: to=<user3(a)mydomain.local >, relay=dovecot, delay=0.05, delays=0.01/0.02/0/0.02, dsn=2.0.0, status=sent (delivered via dovecot service) Oct 27 11:20:34 srv001 postfix/qmgr[11827]: B16284E4AA2: removed Oct 27 11:20:36 srv001 postfix/smtpd[24562]: disconnect from usstlz- psecap06.emerson.com[144.191.128.17] as you can see there was a message for oil(a)mydomain.ch (I obviously changed the domain for privacy) - logs says that all the three users got the email, but the third user didn't. I do not know why and when it happens, but seldom we have this issue maybe is there some kind of bug in the maildrop version I use? by the way, I had this issue also before installing amavisd-new now some infos: CentOS 5.3 postfix-2.3.3-2.1.el5_2 amavisd-new-2.6.6-1.el5.rf dovecot-2.0.11-1_126 dovecot-managesieve-0.2.2-15 dovecot-pigeonhole-0.2.2-15 users are on a Kerberized OpenLDAP please help me because this is really driving me crazy - don't leave me alone, please Marco Carcano

4 10

[Dovecot] mail_max_userip_connections=10
by Tom Clark 12 Dec '11

12 Dec '11

Hi, A couple of questions rather than a problem for once! We've got our Dovecot server running smoothly now apart from our MD. He's having problems with mail_max_userip_connections. He has 3 (Phone/Laptop/Tablet) items that all connect to the server at about the same time. Which means he's frequently running over the max_userip_connections. My questions are: Is there anyway of whitelisting an IP so that it can ignore mail_max_userip_connections=10? What should we set mail_max_userip_connections too realistically? 10 seems a bit low? Thanks Tom

6 10

[Dovecot] using dsync to convert mailboxes looses caching options
by Mark Zealey 10 Dec '11

10 Dec '11

Hi there, We're trying to convert users from Maildir to sdbox at present; I'm using dsync to achieve this (2.0.16) however when the user's have been converted we only get minimal information in the caching files. Is there some way to preserve all the caching decisions that were previously made so that when the user logs in to the new mailbox we don't have to cause an io storm rebuilding the cache that we know was good? Dovecot seems to be partially doing this - if i remove the logs/cache from the source mailbox no cache files are built in the conversion; if i put them back then we get a cache file built but it only contains a few bits of information (guid, date.save). Looking into this a bit further i find that when the caches are present at source the fields are preserved but the 'last used' date and caching decisions are not which I suspect means dsync doesn't bother caching on import - only fields with a yes decision in the source are copied (but their decision is only copied as a tmp with the date of import). For example: Source idxview cache: -- Cache fields -- # Name Type Size Dec Last used 0: flags bit 4 tmp 2011-11-25 16:09 1: date.received fix 4 yes 2011-11-26 16:17 2: size.virtual fix 8 tmp 2011-11-25 16:09 3: imap.bodystructure str - tmp 2011-11-25 16:09 4: mime.parts var - tmp 2011-11-25 16:09 5: hdr.IMPORTANCE hdr - tmp 2011-11-25 16:09 6: hdr.X-PRIORITY hdr - tmp 2011-11-25 16:09 7: hdr.CONTENT-TYPE hdr - tmp 2011-11-25 16:09 ... 18: date.sent fix 8 no 1970-01-01 01:00 19: date.save fix 4 yes 2011-11-26 16:17 20: size.physical fix 8 no 1970-01-01 01:00 21: imap.body str - no 1970-01-01 01:00 ... (24 total entries. stripped ones are just hdr. with a tmp decision) dst cache: # Name Type Size Dec Last used 0: flags bit 4 tmp 1970-01-01 01:00 1: date.sent fix 8 no 1970-01-01 01:00 2: date.received fix 4 tmp 1970-01-01 01:00 3: date.save fix 4 tmp 2011-11-26 16:19 4: size.virtual fix 8 tmp 1970-01-01 01:00 5: size.physical fix 8 no 1970-01-01 01:00 6: imap.body str - no 1970-01-01 01:00 7: imap.bodystructure str - tmp 1970-01-01 01:00 8: imap.envelope str - no! 1970-01-01 01:00 9: pop3.uidl str - no 1970-01-01 01:00 10: guid str - tmp 2011-11-26 16:19 11: mime.parts var - tmp 1970-01-01 01:00 12: hdr.IMPORTANCE hdr - tmp 1970-01-01 01:00 13: hdr.X-PRIORITY hdr - tmp 1970-01-01 01:00 ... and dst cached message for example: RECORD: seq=57, uid=12207, flags=0x09 (Seen Answered) - ext 1 modseq : 1 (0100000000000000) - ext 3 cache : 5516 (8c150000) - cache offset=5516 size=92, prev_offset = 0 - guid: 1321895282.XXXt,S=7399760,W=7496225 - date.save: 1322324286 (3e11d14e) src idx record for this message contains pretty much all fields. Thanks, Mark

3 9

[Dovecot] POP - preventing re-download with server move
by Trutwin, Joshua 10 Dec '11

10 Dec '11

Hi, Curious if anyone has any good suggestions to handle this. I try to get my hosting users to use IMAP but most use Outhouse and the IMAP support is somewhat annoying for many so I typically have them change their settings when using POP to leave copies on the server. That way when they get the inevitable virus or wanna use webmail they have a backup copy and webmail sees their saved mail. So now I have to move my sites to a new server and I'm trying to avoid having all these messages re-downloaded by POP clients. Some of the sites I've moved with low email usage have just dealt with the re-download and cleaned up afterwards. I have a few other accounts though that I'm more concerned about that have massive amounts of stored email. The mail is stored in Maildirs - a sample file: 1280409166.23580.foo:2,S If I move this to server "bar" would renaming the file to 1280409166.23580.bar:2,S prevent this somehow? Old server uses qmail-pop, new server uses dovecot 2.0. Thanks for any tips, Josh

3 2

[Dovecot] Assertion failure in 2.0.16 - SEARCH ()
by Daniel Colascione 08 Dec '11

08 Dec '11

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Nov 25 22:25:39 dancol dovecot: master: Error: service(imap): child 25115 killed with signal 6 (core dumps disabled) Nov 25 22:25:59 dancol dovecot: imap(dancol): Panic: file mail-search-build.c: line 59 (mail_search_build_key_int): assertion failed: (sarg->value.subargs != NULL) Nov 25 22:25:59 dancol dovecot: imap(dancol): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x3d291) [0xb7636291] -> /usr/lib/dovecot/libdovecot.so.0(+0x3d2ff) [0xb76362ff] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0xb760bb7a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x24109) [0xb7692109] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x24177) [0xb7692177] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_search_build+0x82) [0xb7692242] - -> dovecot/imap [dancol 127.0.0.1 SEARCH](imap_search_args_build+0x4a) [0x805db5a] -> dovecot/imap [dancol 127.0.0.1 SEARCH](cmd_search+0xbf) [0x80537ef] -> dovecot/imap [dancol 127.0.0.1 SEARCH]() [0x80568cc] -> dovecot/imap [dancol 127.0.0.1 SEARCH]() [0x80569a2] -> dovecot/imap [dancol 127.0.0.1 SEARCH](client_handle_input+0x175) [0x8056c25] -> dovecot/imap [dancol 127.0.0.1 SEARCH](client_input+0x5f) [0x80574cf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x51) [0xb76430d1] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd3) [0xb7644193] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0xb7643050] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2a) [0xb762ec1a] -> dovecot/imap [dancol 127.0.0.1 SEARCH](main+0x315) [0x805fef5] -> /lib/i686/cmov/libc.so.6(__libc_start_main+0xe6) [0xb74b6c76] -> dovecot/imap [dancol 127.0.0.1 SEARCH]() [0x804eb81] $ telnet localhost imap Trying 127.0.0.1... Connected to localhost.localdomain. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. . LOGIN dancol XXXXXXXX . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in . SELECT rss * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 8 EXISTS * 0 RECENT * OK [UIDVALIDITY 1322264663] UIDs valid * OK [UIDNEXT 11] Predicted next UID * OK [HIGHESTMODSEQ 1] Highest . OK [READ-WRITE] Select completed. . SEARCH () Connection closed by foreign host. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (Darwin) Comment: GPGTools - http://gpgtools.org iEYEARECAAYFAk7QiNcACgkQ17c2LVA10VvhHACgihmbmTjVNl/PbKcreIDRTKpC 5wkAoJd9FHXM4GhPfnVUjwrpdsqnVQ6E =RlpQ -----END PGP SIGNATURE-----

2 1

[Dovecot] POP3/IMAP crash signal 10
by Patrick Wood 08 Dec '11

08 Dec '11

Hi, I'm building a Postfix/Dovecot mail server and while I am able to send/receive emails using telnet, after establishing a connection to Dovecot via a client (Mail Live, Thunderbird etc) the following appears in the logs: Nov 28 14:11:02 mailserver dovecot: [ID 583609 mail.info] pop3-login: Login: user=<user(a)domain.com>, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=xxx.xxx.xxx.xxx, mpid=282 78 Nov 28 14:11:02 mailserver dovecot: [ID 583609 mail.error] master: Error: service(pop3-login): child 28277 killed with signal 10 (core not dumped - set service pop3-log in { drop_priv_before_exec=yes }) Nov 28 14:11:02 mailserver dovecot: [ID 583609 mail.info] pop3(user(a)domain.com): Disconnected: Logged out top=0/0, retr=0/0, del=0/5, size=3250 I also experience very poor connectivity to the server, with Microsoft Mail and Thunderbird regularly failing to connect (connection errors in the client and no login attempt in the dovecot logs). I assume this is related to the issue above. I am running dovecot 2.0.16 on Solaris 10 SPARC using a ZFS filesystem for mailbox storage. Here is my configuration: # 2.0.16: /usr/local/etc/dovecot/dovecot.conf # OS: SunOS 5.10 sun4u zfs auth_mechanisms = plain login disable_plaintext_auth = no mail_location = maildir:/storage0/home/vmail/%d/%n/Maildir mail_plugins = quota passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = maildir:User quota quota_rule = *:storage=1G } postmaster_address = root(a)domain.com sendmail_path = /usr/lib/sendmail ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_plugins = quota quota imap_quota } protocol lda { mail_plugins = quota quota } protocol pop3 { mail_plugins = quota quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } I'm tearing my hair out! Hopefully someone can see something I'm missing

2 1