JVM received SEGV in interpreted Java code after running out of Metadata space

JRE 6 Update 18 JVM received SEGV in interpreted Java code after it
ran out of PermGen space. Two incidents were reported:

hs_err_pid21350.log Thu Mar 4 16:20:50 2010 137633 seconds
hs_err_pid5124.log Fri Mar 5 09:07:27 2010 587645 seconds

Stack traces look like follows
------------------------------
hs_err_pid21350.log

# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0xfc017368, pid=21350, tid=70
#
# JRE version: 6.0_18-b07
# Java VM: Java HotSpot(TM) Server VM (16.0-b13 mixed mode solaris-sparc )
# Problematic frame:
# j javax.management.JMRuntimeException.<init>(Ljava/lang/String;)V+2

Stack: [0xe5a80000,0xe5b00000], sp=0xe5afd340, free space=1f4fc017368k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
j javax.management.JMRuntimeException.(Ljava/lang/String;)V+2
j javax.management.RuntimeErrorException.(Ljava/lang/Error;Ljava/lang/String;)V+2
j com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.rethrow(Ljava/lang/Throwable;)V+35
j com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.rethrowMaybeMBeanException(Ljava/lang/Throwable;)V+13
j com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getAttribute(Ljavax/management/ObjectName;Ljava/lang/String;)Ljava/lang/Object;+122
j com.sun.jmx.mbeanserver.JmxMBeanServer.getAttribute(Ljavax/management/ObjectName;Ljava/lang/String;)Ljava/lang/Object;+10
j weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$12.run()Ljava/lang/Object;+15
v ~StubRoutines::call_stub
V [libjvm.so+0x15931c] __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_+0x210
V [libjvm.so+0x1afebc] JVM_DoPrivileged+0xc40
C [libjava.so+0xf0a0] Java_java_security_AccessController_doPrivileged__Ljava_security_PrivilegedExceptionAction_2+0x1c Java_java_security_AccessController_doPrivileged__Ljava_security_PrivilegedExceptionAction_2+0x1c


hs_err_pid5124.log

# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0xfc017368, pid=5124, tid=654
#
# JRE version: 6.0_18-b07
# Java VM: Java HotSpot(TM) Server VM (16.0-b13 mixed mode solaris-sparc )
# Problematic frame:
# j java.lang.VerifyError.<init>(Ljava/lang/String;)V+2


Stack: [0xccb80000,0xccc00000], sp=0xccbfe798, free space=1f9fc017368k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
j java.lang.VerifyError.(Ljava/lang/String;)V+2
v ~StubRoutines::call_stub
V [libjvm.so+0x15931c] void JavaCalls::call_helper(JavaValue*,methodHandle*,JavaCallArguments*,Thread*)+0x210
V [libjvm.so+0x1cada8] void JavaCalls::call_special(JavaValue*,KlassHandle,symbolHandle,symbolHandle,JavaCallArguments*,Thread*)+0x98
V [libjvm.so+0x47ba18] Handle Exceptions::new_exception(Thread*,symbolHandle,symbolHandle,JavaCallArguments*,Handle,Handle,Handle)+0x1f4
V [libjvm.so+0x47b450] void Exceptions::_throw_msg(Thread*,const char*,int,symbolHandle,const char*,Handle,Handle)+0x254
V [libjvm.so+0x47b614] void Exceptions::_throw_msg(Thread*,const char*,int,symbolHandle,const char*)+0x38
V [libjvm.so+0x825ca8] bool Verifier::verify(instanceKlassHandle,Verifier::Mode,bool,Thread*)+0x7e0
V [libjvm.so+0x4e36b4] bool instanceKlass::verify_code(instanceKlassHandle,bool,Thread*)+0x40
V [libjvm.so+0x4e3c58] bool instanceKlass::link_class_impl(instanceKlassHandle,bool,Thread*)+0x4e4
V [libjvm.so+0x1edc18] void instanceKlass::link_class(Thread*)+0x68
V [libjvm.so+0x1471c0] void instanceKlass::initialize_impl(instanceKlassHandle,Thread*)+0x2c
V [libjvm.so+0x13b7a4] void instanceKlass::initialize(Thread*)+0x78
V [libjvm.so+0x16d604] void InterpreterRuntime::_new(JavaThread*,constantPoolOopDesc*,int)+0x3a0
j weblogic.transaction.internal.ServerTransactionImpl.wakeUp(I)V+151
[ ... ]


PermGen space utilization
-------------------------
hs_err_pid21350.log

Heap
par new generation total 14784K, used 869K [0xebc00000, 0xecc00000, 0xecc00000)
  eden space 13184K, 6% used [0xebc00000, 0xebcd9780, 0xec8e0000)
  from space 1600K, 0% used [0xeca70000, 0xeca70000, 0xecc00000)
  to space 1600K, 0% used [0xec8e0000, 0xec8e0000, 0xeca70000)
concurrent mark-sweep generation total 114688K, used 61372K [0xecc00000, 0xf3c00000, 0xf3c00000)
concurrent-mark-sweep perm gen total 131072K, used 131071K [0xf3c00000, 0xfbc00000, 0xfbc00000)


hs_err_pid5124.log

Heap
par new generation total 29504K, used 4639K [0xd2800000, 0xd4800000, 0xd4800000)
  eden space 26240K, 17% used [0xd2800000, 0xd2c87e88, 0xd41a0000)
  from space 3264K, 0% used [0xd44d0000, 0xd44d0000, 0xd4800000)
  to space 3264K, 0% used [0xd41a0000, 0xd41a0000, 0xd44d0000)
concurrent mark-sweep generation total 229376K, used 229364K [0xd4800000, 0xe2800000, 0xe2800000)
concurrent-mark-sweep perm gen total 393216K, used 393214K [0xe2800000, 0xfa800000, 0xfa800000)