This is snippet hs_err_pid2641.log

#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
# SIGSEGV (0xb) at pc=0x0000002a95979f41, pid=2641, tid=1172871520
#
# Java VM: Java HotSpot(TM) 64-Bit Server VM (1.5.0_09-b01 mixed mode)
# Problematic frame:
# C [libc.so.6+0xf4f41]
#
[--snip--]
Stack: [0x0000000045c89000,0x0000000045e8a000), sp=0x0000000045e87e90, free space=2043k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C [libc.so.6+0xf4f41]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
J java.net.Inet4AddressImpl.getHostByAddr([B)Ljava/lang/String;
J java.net.InetAddress.getHostFromNameService(Ljava/net/InetAddress;Z)Ljava/lang/String;
J com.nokia.warlock.utils.matching.RequestAddress.implResolve()V
J com.nokia.warlock.hostresolver.impl.RequestKeyFactory.createRequestKey(Lcom/nokia/warlock/protocolstack/mime/http/HttpRequest;)Lcom/nokia/warlock/configuration/url/RequestKey;
J com.nokia.warlock.hostresolver.impl.HostResolverProcessor.processRequest(Lcom/nokia/warlock/messaging/MsgCtxProxyAsync;)V
J com.nokia.warlock.messaging.util.MsgCtxProcessorBean.processContext(Lcom/nokia/warlock/messaging/MsgCtxProxyAsync;)V
J sun.reflect.GeneratedMethodAccessor104.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(Lorg/jboss/invocation/Invocation;)Ljava/lang/Object;
J org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(Lorg/jboss/invocation/Invocation;)Ljava/lang/Object;
J org.jboss.ejb.plugins.CallValidationInterceptor.invoke(Lorg/jboss/invocation/Invocation;)Ljava/lang/Object;
J org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(Lorg/jboss/invocation/Invocation;Z)Ljava/lang/Object;
J org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(Lorg/jboss/invocation/Invocation;)Ljava/lang/Object;
J org.jboss.ejb.plugins.TxInterceptorCMT.invoke(Lorg/jboss/invocation/Invocation;)Ljava/lang/Object;
J org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(Lorg/jboss/invocation/Invocation;)Ljava/lang/Object;
J org.jboss.ejb.Container.invoke(Lorg/jboss/invocation/Invocation;)Ljava/lang/Object;
J org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(Ljava/lang/Object;Ljava/lang/reflect/Method;[Ljava/lang/Object;)Ljava/lang/Object;
J com.nokia.warlock.messaging.impl.StandardDestination.processContext(Lcom/nokia/warlock/messaging/impl/ContextContainer;)V
J com.nokia.warlock.messaging.impl.WorkerPoolImpl$Worker.run()V
v ~OSRAdapter
v ~StubRoutines::call_stub
[--snip--]
  0x0000002b0a5aa480 JavaThread "NBG/Messaging/HostResolverPool#3" daemon [_thread_blocked, id=3095]
=>0x0000002b0a5a66e0 JavaThread "NBG/Messaging/HostResolverPool#2" daemon [_thread_in_native, id=3094]
  0x0000002b0a5a5e60 JavaThread "NBG/Messaging/HostResolverPool#1" daemon [_thread_blocked, id=3093]
[--snip--]

VM Arguments:
jvm_args: -Djava.endorsed.dirs=/usr/nbg/system/lib/endorsed -Dnbg.home=/usr/nbg -Dnbg.config=/etc/nbg -Dnbg.hwuid=app20 -Dnbg.swuid=primary -Dnbg.management.ipaddress=10.190.2.20 -Dnbg.traffic.ipaddress=10.190.16.20 -Xss2m -Xbatch -Xms1536m -Xmx1536m -XX:NewSize=704M -XX:MaxNewSize=704M -XX:+UseParallelGC -XX:InitialSurvivorRatio=5 -XX:-UseAdaptiveSizePolicy -XX:-UsePSAdaptiveSurvivorSizePolicy -XX:TargetSurvivorRatio=90 -XX:+DisableExplicitGC -verbose:gc -XX:+PrintHeapAtGC -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCTimeStamps
java_command: org.jboss.Main -c primary -b 10.190.2.20
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=/usr/java/jdk1.5.0_09
PATH=/usr/java/jdk1.5.0_09/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/usr/nbg/system/bin:/opt/ibm/director/bin:/home/nokia/bin
LD_LIBRARY_PATH=/usr/java/jdk1.5.0_09/jre/lib/amd64/server:/usr/java/jdk1.5.0_09/jre/lib/amd64:/usr/java/jdk1.5.0_09/jre/../lib/amd64::/usr/lib/oracle/x86/client/lib
SHELL=/bin/bash

Signal Handlers:
SIGSEGV: [libjvm.so+0x656380], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004
SIGBUS: [libjvm.so+0x656380], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004
SIGFPE: [libjvm.so+0x55dd50], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004
SIGPIPE: SIG_IGN, sa_mask[0]=0x3e7bf217, sa_flags=0x14000004
SIGILL: [libjvm.so+0x55dd50], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: [libjvm.so+0x55fc00], sa_mask[0]=0x00000000, sa_flags=0x14000004
SIGHUP: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGQUIT: [libjvm.so+0x55f6d0], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004
SIGTERM: [libjvm.so+0x55f6d0], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004


--------------- S Y S T E M ---------------

OS:Red Hat Enterprise Linux AS release 4 (Nahant Update 3)

uname:Linux 2.6.9-34.ELsmp #1 SMP Fri Feb 24 16:56:28 EST 2006 x86_64
libc:glibc 2.3.4 NPTL 2.3.4
rlimit: STACK 10240k, CORE 0k, NPROC 24573, NOFILE 33000, AS infinity
load average:0.69 0.83 0.96

CPU:total 4 em64t ht

Memory: 4k page, physical 3083128k(923576k free), swap 0k(0k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (1.5.0_09-b01) for linux-amd64, built on Sep 7 2006 13:22:55 by java_re with gcc 3.2.2 (SuSE Linux)
Customer got JVM crashes on Red Hat Linux/x64. From the hs_err_pid2720.log, it crashes while executing java.net.Inet6AddressImpl.getHostByAddr(String) respectively it crashes while executing java.net.Inet4AddressImpl.getHostByAddr(String) if IPv6 support is removed from the kernel. See also hs_err_pid2641.log (JRE 1.5.0_09). The log files and a sysreport from the Red Hat server are attached to this report.

The problem is caused by load. If the system is not loaded it works fine. Customer can reproduce it every night during their stability tests. The workaround which is described in 6369541 didn't help to avoid the crashes. There is no testcase available.

Snippet from the hs_err_pid2720.log:
#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
# SIGSEGV (0xb) at pc=0x0000002a959795df, pid=2720, tid=1181276512
#
# Java VM: Java HotSpot(TM) 64-Bit Server VM (1.5.0_08-b03 mixed mode)
# Problematic frame:
# C [libc.so.6+0xf45df]
#

--------------- T H R E A D ---------------

Current thread (0x0000002b26703af0): JavaThread "NBG/Messaging/HostResolverPool#6" daemon [_thread_in_native, id=3195]

siginfo:si_signo=11, si_errno=0, si_code=1, si_addr=0x0000002b5984a340

[--snip--]
Stack: [0x000000004648d000,0x000000004668e000), sp=0x000000004668b6b0, free space=2041k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C [libc.so.6+0xf45df]

[error occurred during error reporting, step 120, id 0xb]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
J java.net.Inet6AddressImpl.getHostByAddr([B)Ljava/lang/String;
J java.net.InetAddress$1.getHostByAddr([B)Ljava/lang/String;
J com.nokia.warlock.utils.matching.RequestAddress.implResolve()V
J com.nokia.warlock.hostresolver.impl.RequestKeyFactory.createRequestKey(Lcom/nokia/warlock/protocolstack/mime/http/HttpRequest;)Lcom/nokia/warlock/configuration/url/RequestKey;
J com.nokia.warlock.hostresolver.impl.HostResolverProcessor.processRequest(Lcom/nokia/warlock/messaging/MsgCtxProxyAsync;)V
J com.nokia.warlock.messaging.util.MsgCtxProcessorBean.processContext(Lcom/nokia/warlock/messaging/MsgCtxProxyAsync;)V
J sun.reflect.GeneratedMethodAccessor104.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J org.jboss.resource.connectionmanager.CachedConnectionInterceptor.invoke(Lorg/jboss/invocation/Invocation;)Ljava/lang/Object;
J org.jboss.ejb.plugins.StatelessSessionInstanceInterceptor.invoke(Lorg/jboss/invocation/Invocation;)Ljava/lang/Object;
J org.jboss.ejb.plugins.CallValidationInterceptor.invoke(Lorg/jboss/invocation/Invocation;)Ljava/lang/Object;
J org.jboss.ejb.plugins.AbstractTxInterceptor.invokeNext(Lorg/jboss/invocation/Invocation;Z)Ljava/lang/Object;
J org.jboss.ejb.plugins.TxInterceptorCMT.runWithTransactions(Lorg/jboss/invocation/Invocation;)Ljava/lang/Object;
J org.jboss.ejb.plugins.ProxyFactoryFinderInterceptor.invoke(Lorg/jboss/invocation/Invocation;)Ljava/lang/Object;
J org.jboss.ejb.Container.invoke(Lorg/jboss/invocation/Invocation;)Ljava/lang/Object;
J org.jboss.ejb.plugins.local.BaseLocalProxyFactory.invoke(Ljava/lang/Object;Ljava/lang/reflect/Method;[Ljava/lang/Object;)Ljava/lang/Object;
J com.nokia.warlock.messaging.impl.StandardDestination.processContext(Lcom/nokia/warlock/messaging/impl/ContextContainer;)V
J com.nokia.warlock.messaging.impl.WorkerPoolImpl$Worker.run()V
v ~OSRAdapter
v ~StubRoutines::call_stub
[--snip--]
  0x0000002b26704f00 JavaThread "NBG/Messaging/HostResolverPool#validator" daemon [_thread_blocked, id=3196]
=>0x0000002b26703af0 JavaThread "NBG/Messaging/HostResolverPool#6" daemon [_thread_in_native, id=3195]
  0x0000002b267026e0 JavaThread "NBG/Messaging/HostResolverPool#5" daemon [_thread_blocked, id=3194]

[--snip--]

--------------- S Y S T E M ---------------

OS:Red Hat Enterprise Linux AS release 4 (Nahant Update 3)

uname:Linux 2.6.9-34.ELsmp #1 SMP Fri Feb 24 16:56:28 EST 2006 x86_64
libc:glibc 2.3.4 NPTL 2.3.4
rlimit: STACK 10240k, CORE 0k, NPROC 24573, NOFILE 33000, AS infinity
load average:2.26 2.55 2.11

CPU:total 4 em64t ht

Memory: 4k page, physical 3083128k(271908k free), swap 0k(0k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (1.5.0_08-b03) for linux-amd64, built on Jun 28 2006 00:27:03 by java_re with gcc 3.2.2 (SuSE Linux)