customers application is hanging in what looks like the C2 compiler spinning in
PhaseIdealLoop::spinup()

The pstack shows ad naseum

----------------- lwp# 16 / thread# 16 --------------------
 fed69e6c __1cOPhaseIdealLoopGspinup6MpnENode_2222pnLsmall_cache__2_ (628fd9a8, 2f45d24, 5510990, 56b1548, 4, 56b1548) + 150
 fed69e68 __1cOPhaseIdealLoopGspinup6MpnENode_2222pnLsmall_cache__2_ (628fd9a8, 2f45ce4, 5510990, 56b1548, 8, 5510ae4) + 14c
 fed69e68 __1cOPhaseIdealLoopGspinup6MpnENode_2222pnLsmall_cache__2_ (628fd9a8, 2f45ca4, 5510990, 56b1548, 8, 5510b7c) + 14c
 fed69e68 __1cOPhaseIdealLoopGspinup6MpnENode_2222pnLsmall_cache__2_ (628fd9a8, 2f45c64, 5510990, 56b1548, 8, 5510ae4) + 14c
 fed69e68 __1cOPhaseIdealLoopGspinup6MpnENode_2222pnLsmall_cache__2_ (628fd9a8, 2f45c24, 5510990, 56b1548, 8, 5510b7c) + 14c
 fed69e68 __1cOPhaseIdealLoopGspinup6MpnENode_2222pnLsmall_cache__2_ (628fd9a8, 2f45be4, 5510990, 56b1548, 8, 5510ae4) + 14c
.
.
.
 fed69e68 __1cOPhaseIdealLoopGspinup6MpnENode_2222pnLsmall_cache__2_ (628fd9a8, 5510aa4, 5510990, 56b1548, 8, 5510ae4) + 14c
 fed6d0e0 __1cOPhaseIdealLoopKhandle_use6MpnENode_2pnLsmall_cache_22222_v_ (628feee0, 550f790, 56b1548, 628fd9a8, 56aaebc, 55108d0) + 58
 fee2068c __1cOPhaseIdealLoopLdo_split_if6MpnENode__v_ (124184c, 55108d0, 5510990, 56b188c, 56b17ec, 5afab30) + 928
 feccf590 __1cOPhaseIdealLoopUsplit_if_with_blocks6MpnENode_rnJVectorSet__v_ (628feee0, 56aef90, 628feb30, 2, fffffff8, 5afb530) + 204
 feccf568 __1cOPhaseIdealLoopUsplit_if_with_blocks6MpnENode_rnJVectorSet__v_ (628feee0, 56ad644, 628feb30, 1000, 1a, 5afb230) + 1dc
 feccf568 __1cOPhaseIdealLoopUsplit_if_with_blocks6MpnENode_rnJVectorSet__v_ (628feee0, 56ac7f8, 628feb30, 1, 0, 46e088) + 1dc
.
.
 
 feccf568 __1cOPhaseIdealLoopUsplit_if_with_blocks6MpnENode_rnJVectorSet__v_ (628feee0, eefc58, 628feb30, ff170000, 0, 46e088) + 1dc
 feccf568 __1cOPhaseIdealLoopUsplit_if_with_blocks6MpnENode_rnJVectorSet__v_ (628feee0, eefd3c, 628feb30, 628feb20, 0, 5afb331) + 1dc
 feccf568 __1cOPhaseIdealLoopUsplit_if_with_blocks6MpnENode_rnJVectorSet__v_ (628feee0, 35c8fe8, 628feb30, 628feb20, 0, 5afb339) + 1dc
 fedc080c __1cOPhaseIdealLoop2t5B6MrnMPhaseIterGVN_pk0i_v_ (ff1bbbe4, 0, 628fef24, 1, 2ad4, 1) + d78
 fee0211c __1cHCompileIOptimize6M_v_ (628ff500, ff1335c4, 628ff414, ff170000, 0, 0) + 27c
 fee008b4 __1cHCompile2t6MpnFciEnv_pnHciScope_pnIciMethod_iii_v_ (ff1333f9, 35c9024, 5b5a33c, 2c98834, 8d, 1) + bac
 fedfd08c __1cKC2CompilerOcompile_method6MpnFciEnv_pnHciScope_pnIciMethod_ii_v_ (2b8a8, 628ffd1c, 0, 4674a48, 8d, 0) + 64
 fedfc850 __1cNCompileBrokerZinvoke_compiler_on_method6FpnLCompileTask__v_ (11a, 1, 8d, ff1aee50, ff1bbbe4, 13aaa8) + 61c
 feeac1f8 __1cNCompileBrokerUcompiler_thread_loop6F_v_ (ff133c01, ff1af218, 13aaa8, 13b058, 306d10, fee69254) + 428
 fee6927c __1cKJavaThreadDrun6M_v_ (13aaa8, 10, 40, 0, 40, 0) + 284
 fee6575c _start (13aaa8, ff261e00, 0, 0, 0, 0) + 134
 ff3858c0 _lwp_start (0, 0, 0, 0, 0, 0)
customer did a gcore at the time and only one frame is showing
t@16 (l@16) terminated by signal SEGV (Segmentation Fault)
0xfed69e6c: spinup+0x0150: st %i0, [%sp + 92]
(dbx) where
current thread: t@16
=>[1] PhaseIdealLoop::spinup(), at 0xfed69e6c
(dbx) regs
current thread: t@16
current frame: [1]
g0-g3 0x00000000 0x00003800 0x0550f074 0x0000a800
g4-g7 0x00002a00 0x02f45d58 0x00000000 0xff261e00
o0-o3 0x00000000 0x00000000 0x00000000 0x00000000
o4-o7 0x00000000 0x00000000 0x00000000 0x00000000
l0-l3 0x00000000 0x00000000 0x00000000 0x00000000
l4-l7 0x00000000 0x00000000 0x00000000 0x00000000
i0-i3 0x00000000 0x00000000 0x00000000 0x00000000
i4-i7 0x00000000 0x00000000 0x00000000 0x00000000
y 0x00000000
ccr 0xfe001005
pc 0xfed69e6c:spinup+0x150 st %i0, [%sp + 92]
npc 0xfed69d1c:spinup save %sp, -96, %sp

full pstack of the (running)hung process is at
/net/cores/cores/64439244/0211/pstack.20040210

SA is not showing thread 16 when I try to examine with it.

Core file is at
/net/cores/cores/64439244/0211

all libs are in /net/cores/cores/64439244/0211/app with the exception of the customers /usr/lib/lwp libthread libraries with are in the base dir /net/cores/cores/64439244/0211

should be able to simply run opencore to launch into it.


###@###.### 2005-2-15 20:44:54 GMT
###@###.### 2005-2-15 20:54:58 GMT