This is IBIS case 70066876

data location: /net/cores.central/cores/dir10/70066876/0122


hs_err:
#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
# SIGILL (0x4) at pc=0xf9c342e4, pid=25789, tid=321
#
# Java VM: Java HotSpot(TM) Server VM (1.4.2_10-b03 mixed mode)
# Problematic frame:
# v ~RuntimeStub::_complete_monitor_locking_Java
#

--------------- T H R E A D ---------------

Current thread (0x007efff0): JavaThread "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon [_thread_in_Java, id=321]

siginfo:si_signo=4, si_errno=0, si_code=1, si_addr=0xf9c342e4

Registers:
 O0=0xbea528d8 O1=0x8cf7f8c0 O2=0x007efff0 O3=0xb490b008
 O4=0x00000008 O5=0x8cf7f7b0 O6=0x8cf7f800 O7=0xf9c342dc
 G1=0x00005400 G2=0x00000000 G3=0x80000000 G4=0x007efff0
 G5=0x8cf7f800 G6=0x00000000 G7=0xf984c000 Y=0x00000000
 PC=0xf9c342e4 nPC=0xf9c342e8


Top of Stack: (sp=0x8cf7f800)
0x8cf7f800: 007efff0 ffffffff 8cf7f858 b4851aa0
0x8cf7f810: b490b068 bea52808 00000000 007efff0
0x8cf7f820: bea528d8 8cf7f8c0 b490b220 bea5a3d4
0x8cf7f830: 00000000 8cf7f7f0 8cf7f860 fa077cf8
0x8cf7f840: 8cf7f858 8cf7f854 00000005 aabce0c8
0x8cf7f850: c8390340 bea5a3b8 00000001 007efff0
0x8cf7f860: 8cf7f8c0 00000001 bea528d8 fb7dc000
0x8cf7f870: bea52808 b490b220 bea64038 ad89dd98

Instructions: (pc=0xf9c342e4)
0xf9c342d4: dc 24 20 88 94 10 00 10 41 46 25 50 ae 10 00 02
0xf9c342e4: 84 10 00 17 c0 24 20 88 c0 24 20 90 e0 04 20 04

Stack: [0x8cf00000,0x8cf80000), sp=0x8cf7f800, free space=510k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
v ~RuntimeStub::_complete_monitor_locking_Java
J weblogic.socket.PosixSocketMuxer.processSockets()V
v ~OSRAdapter
j weblogic.socket.SocketReaderRequest.execute(Lweblogic/kernel/ExecuteThread;)V+13
j weblogic.kernel.ExecuteThread.execute(Lweblogic/kernel/ExecuteRequest;)V+23
j weblogic.kernel.ExecuteThread.run()V+66
v ~StubRoutines::call_stub
V [libjvm.so+0x15dbc4]
V [libjvm.so+0x24cab4]
V [libjvm.so+0x25fd10]
V [libjvm.so+0x271080]
V [libjvm.so+0x26a758]
V [libjvm.so+0x266c38]

dbx> mainargs
main's fp = 0xffbff368
argc = 19
argv = 0xffbff3cc
envp = 0xffbff41c
Arguments:
0xffbff518: "/opt/beasp5/jdk/bin/java"
0xffbff531: "-server"
0xffbff539: "-Xms1232m"
0xffbff543: "-Xmx1232m"
0xffbff54d: "-XX:MaxPermSize=128m"
0xffbff562: "-XX:SurvivorRatio=8"
0xffbff576: "-XX:-UseCompilerSafepoints"
0xffbff591: "-DLOG_HOME1=/opt/smc/gid_b/1/exec/1st-log"
0xffbff5bb: "-DLOG_HOME2=/opt/smc/gid_b/1/exec/2nd-log"
0xffbff5e5: "-DAPLLOG_HOME=/opt/smc/gid_b/1/exec/apllog"
0xffbff610: "-DDOMAIN_HOME=/opt/beasp5/user_projects/domains/gidaplb"
0xffbff648: "-DTRAP_SEND_HOME=/opt/smc/exec/bin/smc_trapsend.sh"
0xffbff67b: "-DSERVER_NAME=msgidaplb01"
0xffbff695: "-Dweblogic.Name=msgidaplb01"
0xffbff6b1: "-Dweblogic.management.username="
0xffbff6d1: "-Dweblogic.management.password="
0xffbff6f1: "-Dweblogic.management.server=http://smctgw-i0:7022"
0xffbff724: "-Djava.security.policy=/opt/beasp5/weblogic81/server/lib/weblogic.policy"
0xffbff76d: "weblogic.Server"

(dbx) where -l
current thread: t@321
  [1] 0xf9c00640(0x0, 0x0, 0x0, 0x0, 0x0, 0x0), at 0xf9c00640
  [2] libjvm.so:frame::next_younger_sp_or_null(0x8cf7f800, 0x0, 0x0, 0x8cf7ed08, 0x0, 0x0), at 0xfed069f0
  [3] libjvm.so:JavaFrameAnchor::make_walkable(0x7f0078, 0x0, 0x7efff0, 0x65290000, 0x61, 0xff00), at 0xff0a568c
  [4] libjvm.so:RegisterMap::pd_clear(0x8cf7eea8, 0x8cf7eea8, 0x0, 0x1, 0x1, 0x8cf7e664), at 0xfed834fc
  [5] libjvm.so:StackFrameStream::StackFrameStream(0x8cf7ee98, 0x7efff0, 0x1, 0x0, 0x0, 0x3eaaa4), at 0xfeda1be8
  [6] libjvm.so:VMError::report(0x8cf7f29c, 0x8cf7f1c0, 0x7d0, 0xff1cdc50, 0x81010100, 0xff00), at 0xff104e4c
  [7] libjvm.so:VMError::report_and_die(0xff1cdc50, 0x7efff0, 0x4, 0xf9c342e4, 0x8cf7f780, 0x8cf7f4c8), at 0xff1059f0
  [8] libjvm.so:JVM_handle_solaris_signal(0xf9c342e4, 0xf9c342e4, 0xff165685, 0x1, 0x0, 0x0), at 0xfedd9bf0
  [9] libthread.so.1:__sighndlr(0x4, 0x8cf7f780, 0x8cf7f4c8, 0xfedd91a4, 0x0, 0x0), at 0xff385bac
  ---- called from signal handler with signal 4 (SIGILL) ------
  [10] 0xf9c342e4(0xbea528d8, 0x8cf7f8c0, 0xb490b220, 0xbea5a3d4, 0x0, 0x8cf7f7f0), at 0xf9c342e4
  [11] 0xfa077cf8(0xf1818618, 0xb490b260, 0x0, 0xbeac14e0, 0x5, 0xbea528d8), at 0xfa077cf8
  [12] 0xfa0768f8(0x8cf7f9fc, 0xb6, 0xf3fffb88, 0xf9c14180, 0x8, 0x8cf7f8d0), at 0xfa0768f8
  [13] 0xf9c05804(0x8cf7fa84, 0xf19d2da0, 0x0, 0xf9c15ef8, 0x4, 0x8cf7f998), at 0xf9c05804
  [14] 0xf9c05a8c(0x8cf7fb14, 0xb6, 0x0, 0xf9c16430, 0x8, 0x8cf7fa20), at 0xf9c05a8c
  [15] 0xf9c05804(0x8cf7fb9c, 0x0, 0x0, 0xf9c15f00, 0x8, 0x8cf7fab0), at 0xf9c05804
  [16] 0xf9c0010c(0x8cf7fc28, 0x8cf7fe90, 0xa, 0xf20fc0f8, 0x4, 0x8cf7fb40), at 0xf9c0010c
  [17] libjvm.so:JavaCalls::call_helper(0x8cf7fe88, 0x8cf7fcf0, 0x8cf7fda8, 0x7efff0, 0x7efff0, 0x8cf7fd00), at 0xfed5dbbc
  [18] libjvm.so:JavaCalls::call_virtual(0xff180000, 0x1e51f8, 0x8cf7fd9c, 0x8cf7fd98, 0x8cf7fda8, 0x7efff0), at 0xfee4caac
  [19] libjvm.so:JavaCalls::call_virtual(0x8cf7fe88, 0x8cf7fe84, 0x8cf7fe7c, 0x8cf7fe74, 0x8cf7fe6c, 0x7efff0), at 0xfee5fd08
  [20] libjvm.so:thread_entry(0x7efff0, 0x7efff0, 0x9a1380, 0x1e51f8, 0x31583c, 0xfee6a728), at 0xfee71078
  [21] libjvm.so:JavaThread::run(0x7efff0, 0x141, 0x40, 0x0, 0x40, 0x0), at 0xfee6a750
  [22] libjvm.so:_start(0x7efff0, 0x0, 0x0, 0x0, 0x0, 0x0), at 0xfee66c30
Please note that under /net/cores.central/cores/dir10/70066876
there are 5 set of core files.
The core files has been reorganized under

% ls /net/cores.central/cores/dir10/70066876/CORES
0119/ 0122/ 0302/ 0615/ 0718/ 0814/

proc -map showed clean match for all core files
including /usr/ucblib/libucb.so.1

I also use Fui-Shien script to read the sighandler for SIGILL

(dbx) source /net/nemo.singapore/export/home/fschoong/bin/dbxscripts/why.txt
(dbx) sighandler 4
    Solaris 8 T2 or Solaris 9
    Signal 4 handler is defined in `libjvm.so`signalHandler /* No debugging info */



(dbx) proc -map
Loadobject mappings for current core file:
0x00010000 /opt/beasp5/jdk/bin/java
0xff370000 /usr/lib/libthread.so.1
0xff3fa000 /usr/lib/libdl.so.1
           is being filtered by: /usr/lib/ld.so.1
0xff280000 /usr/lib/libc.so.1
           is being filtered by: /usr/platform/SUNW,Sun-Blade-1000/lib/libc_psr.so.1
0xff3a0000 /usr/platform/sun4u-us3/lib/libc_psr.so.1
0xfec00000 /opt/beasp5/jdk/jre/lib/sparc/server/libjvm.so
0xff230000 /usr/lib/libCrun.so.1
0xff210000 /usr/lib/libsocket.so.1
0xfeb00000 /usr/lib/libnsl.so.1
0xfeab0000 /usr/lib/libm.so.1
0xfebe0000 /usr/lib/libsched.so.1
0xfebc0000 /usr/lib/libmp.so.2
0xfea50000 /opt/beasp5/jdk/jre/lib/sparc/native_threads/libhpi.so
0xfea30000 /usr/lib/nss_files.so.1
0xfe9f0000 /opt/beasp5/jdk/jre/lib/sparc/libverify.so
0xfe9a0000 /opt/beasp5/jdk/jre/lib/sparc/libjava.so
0xfe980000 /opt/beasp5/jdk/jre/lib/sparc/libzip.so
0xfe2c0000 /usr/lib/locale/ja/ja.so.2
0xfe920000 /usr/lib/locale/ja_JP.eucJP/methods_ja_JP.eucJP.so.2
0xf9890000 /opt/beasp5/jdk/jre/lib/sparc/libnet.so
0xf9990000 /opt/beasp5/weblogic81/server/lib/solaris/libweblogicunix1.so
0xf9820000 /opt/beasp5/weblogic81/server/lib/solaris/libstackdump.so
0xa47e0000 /opt/beasp5/weblogic81/server/lib/solaris/libmuxer.so
0xa47c0000 /usr/ucblib/libucb.so.1
0xa46a0000 /usr/lib/libresolv.so.2
0xa4790000 /usr/lib/libelf.so.1
0xa4410000 /opt/beasp5/jdk/jre/lib/sparc/libnio.so
0xa41e0000 /usr/lib/librt.so.1
0xa41c0000 /usr/lib/libaio.so.1
0xa41a0000 /usr/lib/libmd5.so.1
           is being filtered by: /usr/platform/SUNW,Sun-Blade-1000/lib/libmd5_psr.so.1
0xa3f60000 /usr/lib/libsendfile.so.1
0xa3f40000 /opt/beasp5/jdk/jre/lib/sparc/libioser12.so
0xff3b0000 /usr/lib/ld.so.1 [LM_ID_LDSO]