Yes,
I did switch from sparc server to x86. I also removed all the dovecot.indexes and .imap folders. I will try 2.2 again tomorrow with the process limits specified for imap, pop, and auth.
My concern is with auto detection of user accounts using mbox or Maildir formats. Is it still the case to support mix mbox and Maildir by commenting out the mail_location lines?
CJ Keist. Email: cj.keist@colostate.edu Systems Group Manager. Solaris 10 OS (SAI) Engineering Network Services. Phone: 970-491-0630 College of Engineering, CSU. Fax: 970-491-5569 Ft. Collins, CO 80523-1301
On Jul 14, 2014, at 4:50 PM, Timo Sirainen tss@iki.fi wrote:
Did you actually switch from sparc to x86 CPU in the server? If yes, then looks like the code to handle the switching could use some fixing.
But in any case you can just delete the .imap/ directories and have the indexes be rebuilt.
On 14.7.2014, at 21.10, CJ Keist cj.keist@colostate.edu wrote:
Here are the log entires just before the signal 6 error:
Jul 10 00:19:56 mail2 dovecot: [ID 583609 mail.error] imap(tjs): Error: Rebuilding index file /top/admin/AcadAffairs/people/tjs/home/mail/.imap/DailySmarts/dovecot.index: CPU architecture changed Jul 10 00:19:58 mail2 dovecot: [ID 583609 mail.error] imap(tjs): Error: Rebuilding index file /top/admin/AcadAffairs/people/tjs/home/mail/.imap/engr101/dovecot.index: CPU architecture changed Jul 10 00:19:59 mail2 dovecot: [ID 583609 mail.error] imap(tjs): Error: Rebuilding index file /top/admin/AcadAffairs/people/tjs/home/mail/.imap/INTO/dovecot.index: CPU architecture changed Jul 10 00:19:59 mail2 dovecot: [ID 583609 mail.error] imap(tjs): Error: Rebuilding index file /top/admin/AcadAffairs/people/tjs/home/mail/.imap/Drafts/dovecot.index: CPU architecture changed Jul 10 00:20:00 mail2 dovecot: [ID 583609 mail.error] imap(tjs): Error: Index /top/admin/AcadAffairs/people/tjs/home/mail/Local/.imap/RM-MSMSP/dovecot.index: Lost log for seq=1 offset=0 Jul 10 00:20:00 mail2 dovecot: [ID 583609 mail.warning] imap(tjs): Warning: fscking index file /top/admin/AcadAffairs/people/tjs/home/mail/Local/.imap/RM-MSMSP/dovecot.index Jul 10 00:20:00 mail2 dovecot: [ID 583609 mail.error] imap(tjs): Error: Fixed index file /top/admin/AcadAffairs/people/tjs/home/mail/Local/.imap/RM-MSMSP/dovecot.index: log_file_seq 1 -> 33554432 Jul 10 00:20:00 mail2 dovecot: [ID 583609 mail.error] imap(tjs): Error: Corrupted transaction log file /top/admin/AcadAffairs/people/tjs/home/mail/Local/.imap/FundingOpportunities/dovecot.index.log seq 33554432: log file shrank (1124 < 6144) (sync_offset=6144) Jul 10 00:20:00 mail2 dovecot: [ID 583609 mail.crit] imap(tjs): Panic: file buffer.c: line 307 (buffer_set_used_size): assertion failed: (used_size <= buf->alloc) Jul 10 00:20:00 mail2 dovecot: [ID 583609 mail.error] imap(tjs): Error: Raw backtrace: /userM/mail-services/dovecot/lib/dovecot/libdovecot.so.0.0.0'default_fatal_finish+0x51 [0xfede0f41] -> /userM/mail-services/dovecot/lib/dovecot/libdovecot.so.0.0.0'i_internal_fatal_handler+0x31 [0xfede1071] -> /userM/mail-services/dovecot/lib/dovecot/libdovecot.so.0.0.0'i_fatal+0x0 [0xfee0c4e2] -> /userM/mail-services/dovecot/lib/dovecot/libdovecot.so.0.0.0'0x6d595 [0xfeddd595] -> /userM/mail-services/dovecot/lib/dovecot/libdovecot-storage.so.0.0.0'mail_transaction_log_file_add_to_list+0x9c [0xfef3f5cc] -> /userM/mail-services/dovecot/lib/dovecot/libdovecot-storage.so.0.0.0'mail_transaction_log_file_open+0x25c [0xfef401dc] -> /userM/mail-services/dovecot/lib/dovecot/libdovecot-storage.so.0.0.0'mail_transaction_log_open+0xda [0xfef3bdba] -> /userM/mail-services/dovecot/lib/dovecot/libdovecot-storage.so.0.0.0'mail_index_open_files+0x23 [0xfef239e3] -> /userM/mail-services/dovecot/lib/dovecot/libdovecot-storage.so.0.0.0'
Jul 10 00:20:00 mail2 dovecot: [ID 583609 mail.crit] imap(tjs): Fatal: master: service(imap): child 2238 killed with signal 6 (core not dumped - set service imap { drop_priv_before_exec=yes }) Jul 10 00:20:01 mail2 dovecot: [ID 583609 mail.info] imap-login: Login: user=<tjs>, method=PLAIN, rip=129.82.226.98, lip=129.82.20.15, mpid=2943, TLS, session=<qJOQ0ND9HQCBUuJi> Jul 10 00:20:01 mail2 dovecot: [ID 583609 mail.error] imap(tjs): Error: Transaction log file /top/admin/AcadAffairs/people/tjs/home/mail/Local/.imap/FundingOpportunities/dovecot.index.log: marked corrupted
On 7/11/14, 5:40 PM, Timo Sirainen wrote: Find the first error/warning that Dovecot logs, which should happen just before you reach the limit.
On 10.7.2014, at 21.33, CJ Keist cj.keist@colostate.edu wrote:
It's not fixed. Now the limit looks to be around 500 processes and we start to get number of connections exceeded. Any ideas?
On 7/10/14, 10:35 AM, CJ Keist wrote: I fixed this issue about the process limit in the 10-master.conf file:
default_process_limit = 5000 default_client_limit = 30000
On 7/10/14, 10:03 AM, CJ Keist wrote: It looks like on the system that once we hit around 200 imap processes it stops there and no more imap processes can be created. Is there a number of max imap processes in the config file somewhere. By the way running on OmniOS:
SunOS mail2 5.11 omnios-6de5e81 i86pc i386 i86pc
> On 7/10/14, 9:50 AM, CJ Keist wrote: > Thanks for the reply. I have seen threads about setting the > mail_max_userip_connections, I have set this to 5000 and still people > getting the exceeding connections errorl > > > root@mail2:/userM/mail-services/dovecot/sbin# ./dovecot -n > # 2.2.13: /userM/mail-services/dovecot/etc/dovecot/dovecot.conf > # OS: SunOS 5.11 i86pc > auth_failure_delay = 5 secs > auth_mechanisms = plain login cram-md5 > auth_worker_max_count = 3000 > base_dir = /userM/mail-services/dovecot/var/run/dovecot/ > disable_plaintext_auth = no > hostname = mail2.engr.colostate.edu > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave duplicate > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > driver = pam > } > passdb { > driver = passwd > } > postmaster_address = cjay@engr.colostate.edu > service auth { > unix_listener /var/lib/postfix/private/auth { > mode = 0666 > } > unix_listener auth-userdb { > group = postfix > mode = 0666 > user = postfix > } > user = root > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service pop3-login { > inet_listener pop3 { > port = 110 > } > inet_listener pop3s { > port = 995 > ssl = yes > } > } > ssl_cert = ssl_key = userdb { > args = blocking=yes > driver = passwd > } > protocol imap { > mail_max_userip_connections = 5000 > } > protocol lda { > mail_plugins = sieve > } > > >> On 7/10/14, 9:45 AM, Reindl Harald wrote: >> >> >> Am 10.07.2014 17:32, schrieb CJ Keist: >>> Another problem is people are getting error message from their >>> clients stating >>> they have exceeded their number of connections. >> >> mail_max_userip_connections = 50 >> >> well, how much folders do the have >> >> keep in mind that fpr IDLE you have one connection per user and folder >> 10 users with 10 folders behind the same NAT router are 100 connections >> from the same IP >> >>>> On 7/10/14, 9:09 AM, CJ Keist wrote: >>>> Added info: These errors seem to come from users using mbox format. >>>> >>>> >>>>> On 7/10/14, 9:04 AM, CJ Keist wrote: >>>>> All, >>>>> Just move our mail servers over to a new mail server running >>>>> postfix >>>>> 2.11.1 and dovecot 2.2.13 and getting the subject line errors in my >>>>> /var/adm/files. People are complaining of loosing their >>>>> connections to >>>>> the mail server. >>>>> >>>>> I've been able to google this error but haven't found fix for this >>>>> yet. >>>>> NOt sure where to put the drop-priv option in the config files >>>>> either. >>>>> >>>>> Any suggestions? >>>>> >>>>> Var adm message: >>>>> Jul 10 08:54:29 mail2 dovecot: [ID 583609 mail.crit] imap(chen): >>>>> Fatal: >>>>> master: service(imap): child 20258 killed with signal 6 (core not >>>>> dumped >>>>> - set service imap { drop_priv_before_exec=yes }) >>>>> >>>>> Here is config output: >>>>> >>>>> root@mail2:/userM/mail-services/dovecot/sbin# ./dovecot -n >>>>> # 2.2.13: /userM/mail-services/dovecot/etc/dovecot/dovecot.conf >>>>> # OS: SunOS 5.11 i86pc >>>>> auth_failure_delay = 5 secs >>>>> auth_mechanisms = plain login cram-md5 >>>>> auth_worker_max_count = 300 >>>>> base_dir = /userM/mail-services/dovecot/var/run/dovecot/ >>>>> disable_plaintext_auth = no >>>>> hostname = mail2.engr.colostate.edu >>>>> managesieve_notify_capability = mailto >>>>> managesieve_sieve_capability = fileinto reject envelope >>>>> encoded-character vacation subaddress comparator-i;ascii-numeric >>>>> relational regex imap4flags copy include variables body enotify >>>>> environment mailbox date ihave duplicate >>>>> namespace inbox { >>>>> inbox = yes >>>>> location = >>>>> mailbox Drafts { >>>>> special_use = \Drafts >>>>> } >>>>> mailbox Junk { >>>>> special_use = \Junk >>>>> } >>>>> mailbox Sent { >>>>> special_use = \Sent >>>>> } >>>>> mailbox "Sent Messages" { >>>>> special_use = \Sent >>>>> } >>>>> mailbox Trash { >>>>> special_use = \Trash >>>>> } >>>>> prefix = >>>>> } >>>>> passdb { >>>>> driver = pam >>>>> } >>>>> passdb { >>>>> driver = passwd >>>>> } >>>>> postmaster_address = cjay@engr.colostate.edu >>>>> service auth { >>>>> unix_listener /var/lib/postfix/private/auth { >>>>> mode = 0666 >>>>> } >>>>> unix_listener auth-userdb { >>>>> group = postfix >>>>> mode = 0666 >>>>> user = postfix >>>>> } >>>>> user = root >>>>> } >>>>> service imap-login { >>>>> inet_listener imap { >>>>> port = 143 >>>>> } >>>>> inet_listener imaps { >>>>> port = 993 >>>>> ssl = yes >>>>> } >>>>> } >>>>> service pop3-login { >>>>> inet_listener pop3 { >>>>> port = 110 >>>>> } >>>>> inet_listener pop3s { >>>>> port = 995 >>>>> ssl = yes >>>>> } >>>>> } >>>>> ssl_cert = >>>> ssl_key = >>>> userdb { >>>>> args = blocking=yes >>>>> driver = passwd >>>>> } >>>>> protocol imap { >>>>> mail_max_userip_connections = 50 >>>>> } >>>>> protocol lda { >>>>> mail_plugins = sieve >>>>> }
-- C. J. Keist Email: cj.keist@colostate.edu Systems Group Manager Solaris 10 OS (SAI) Engineering Network Services Phone: 970-491-0630 College of Engineering, CSU Fax: 970-491-5569 Ft. Collins, CO 80523-1301
All I want is a chance to prove 'Money can't buy happiness'
-- C. J. Keist Email: cj.keist@colostate.edu Systems Group Manager Solaris 10 OS (SAI) Engineering Network Services Phone: 970-491-0630 College of Engineering, CSU Fax: 970-491-5569 Ft. Collins, CO 80523-1301
All I want is a chance to prove 'Money can't buy happiness'