This bug relates to the JDK NIO related JVM crash reported in the original bug 7014061. 7014061 can be used to track the other JVM runtime related crash

The following JVM crash related to JDK NIO part was reported by GlassFish QA when running stress test with SSL with GlassFish 3.1 3-instance cluster. Each instance was crashed (not at same time) after the test running ~4 days normally. One of the instances had a crash related to JDK NIO.

Java Runtime: 1.6.0_23 Sun Microsystems Inc.
Windows Server 2008 R2 6.1 amd64 (4 cpu)

The hs_err file for this is attached.

On in1 - bigapp-oblade-1 : There is a JVM crash on 1/19/11 10:08 AM. Please see jvm crash log under file C:\export\glassfish3\glassfish\nodes\node1\in1\config

--------------- T H R E A D ---------------

Current thread (0x0000000008aae000): JavaThread "Grizzly-kernel-thread(1)" daemon [_thread_in_vm, id=3572, stack(0x0000000008360000,0x0000000008380000)]

siginfo: ExceptionCode=0xc0000005, reading address 0x0000000000000000

Registers:
RAX=0x0000000000000000, RBX=0x0000000008aae000, RCX=0x0000000000000e00, RDX=0x0000000000000000
RSP=0x000000000837f2b0, RBP=0x000000000a85bc50, RSI=0x0000000000000000, RDI=0x0000000000000000
R8=0x0000000000000032, R9=0x000000000a85bc50, R10=0x0000000000000000, R11=0x0000000000000246
R12=0x0000000000000032, R13=0x00000000c53922d8, R14=0x000000000837f448, R15=0x0000000008aae000
RIP=0x000000006dadf79e, EFLAGS=0x0000000000010202

Register to memory mapping:

RAX=0x0000000000000000
0x0000000000000000 is pointing to unknown location

RBX=0x0000000008aae000
"Grizzly-kernel-thread(1)" daemon prio=10 tid=0x0000000008aae000 nid=0xdf4 runnable [0x000000000837f000]
   java.lang.Thread.State: RUNNABLE

RCX=0x0000000000000e00
0x0000000000000e00 is pointing to unknown location

RDX=0x0000000000000000
0x0000000000000000 is pointing to unknown location

RSP=0x000000000837f2b0
0x000000000837f2b0 is pointing into the stack for thread: 0x0000000008aae000
"Grizzly-kernel-thread(1)" daemon prio=10 tid=0x0000000008aae000 nid=0xdf4 runnable [0x000000000837f000]
   java.lang.Thread.State: RUNNABLE

RBP=0x000000000a85bc50
0x000000000a85bc50 is pointing to unknown location

RSI=0x0000000000000000
0x0000000000000000 is pointing to unknown location

RDI=0x0000000000000000
0x0000000000000000 is pointing to unknown location

R8 =0x0000000000000032
0x0000000000000032 is pointing to unknown location

R9 =0x000000000a85bc50
0x000000000a85bc50 is pointing to unknown location

R10=0x0000000000000000
0x0000000000000000 is pointing to unknown location

R11=0x0000000000000246
0x0000000000000246 is pointing to unknown location

R12=0x0000000000000032
0x0000000000000032 is pointing to unknown location

R13=0x00000000c53922d8
{constMethod}
 - klass: {other class}
 - method: 0x00000000c53922e0 {method} 'accept0' '(Ljava/io/FileDescriptor;Ljava/io/FileDescriptor;[Ljava/net/InetSocketAddress;)I' in 'sun/nio/ch/ServerSocketChannelImpl'
 - exceptions: 0x00000000c4001ef8

R14=0x000000000837f448
0x000000000837f448 is pointing into the stack for thread: 0x0000000008aae000
"Grizzly-kernel-thread(1)" daemon prio=10 tid=0x0000000008aae000 nid=0xdf4 runnable [0x000000000837f000]
   java.lang.Thread.State: RUNNABLE

R15=0x0000000008aae000
"Grizzly-kernel-thread(1)" daemon prio=10 tid=0x0000000008aae000 nid=0xdf4 runnable [0x000000000837f000]
   java.lang.Thread.State: RUNNABLE


Top of Stack: (sp=0x000000000837f2b0)
0x000000000837f2b0: 0000000008aae000 0000000000002048
0x000000000837f2c0: 000000000837f438 000000000837f438
0x000000000837f2d0: 00000000000009a0 000000000837f430
0x000000000837f2e0: 0000000000000000 000000000837f438
0x000000000837f2f0: 0000000008aae1c8 00000000c4832e18
0x000000000837f300: 0000000000000000 000000006d6c3215
0x000000000837f310: 000000006dee6520 000000000837f430
0x000000000837f320: 0000000008aae1c8 00000000c4149600
0x000000000837f330: 0000000000000001 0000000000000001
0x000000000837f340: 0000000000000010 50bc850a8fa60002
0x000000000837f350: 0000000000000000 0000b74226c117d6
0x000000000837f360: 0000000000000001 00000000012258fa
0x000000000837f370: 00000000c4149600 000000000837f410
0x000000000837f380: 00000000c53922e0 00000000012312a0
0x000000000837f390: 0000000000000001 00000000c53c1f98
0x000000000837f3a0: 0000000008aae000 000000006da91dbd

Instructions: (pc=0x000000006dadf79e)
0x000000006dadf78e: 83 38 02 00 00 06 00 00 00 80 3d 2a ca 41 00 00
0x000000006dadf79e: 48 8b 16 74 17 44 8b 4a 08 0f b6 0d 0a b0 40 00


Stack: [0x0000000008360000,0x0000000008380000], sp=0x000000000837f2b0, free space=124k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [jvm.dll+0x24f79e]

[error occurred during error reporting (printing native stack), id 0xc0000005]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j sun.nio.ch.ServerSocketChannelImpl.accept0(Ljava/io/FileDescriptor;Ljava/io/FileDescriptor;[Ljava/net/InetSocketAddress;)I+0
j sun.nio.ch.ServerSocketChannelImpl.accept()Ljava/nio/channels/SocketChannel;+94
j com.sun.grizzly.TCPSelectorHandler.acceptWithoutRegistration(Ljava/nio/channels/SelectionKey;)Ljava/nio/channels/SelectableChannel;+11
j com.sun.enterprise.v3.services.impl.monitor.MonitorableSelectorHandler.acceptWithoutRegistration(Ljava/nio/channels/SelectionKey;)Ljava/nio/channels/SelectableChannel;+2
j com.sun.grizzly.http.SelectorThreadHandler.onAcceptInterest(Ljava/nio/channels/SelectionKey;Lcom/sun/grizzly/Context;)Z+2
J com.sun.grizzly.SelectorHandlerRunner.handleSelectedKey(Ljava/nio/channels/SelectionKey;Lcom/sun/grizzly/SelectorHandler;Lcom/sun/grizzly/NIOContext;)Z
J com.sun.grizzly.SelectorHandlerRunner.doSelect(Lcom/sun/grizzly/SelectorHandler;Lcom/sun/grizzly/NIOContext;)Z
J com.sun.grizzly.SelectorHandlerRunner.run()V
j java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Ljava/lang/Runnable;)V+59
j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+28
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
This bug separates the JVM crash related to JDk nio part in the orginal bug in 7014061

JVM crash was reported by GlassFish QA when running stress test with SSL with GlassFish 3.1 3-instance cluster. Each instance was crashed (not at same time) after the test running ~4 days normally.

Java Runtime: 1.6.0_23 Sun Microsystems Inc.
Windows Server 2008 R2 6.1 amd64 (4 cpu)

The following is from the JVM crash related to JDK nio part. The hs_err file is also attached

=====================================================================
On in1 - bigapp-oblade-1 : JVM crash on 1/19/11 10:08 AM. Please see jvm crash log under file C:\export\glassfish3\glassfish\nodes\node1\in1\config

--------------- T H R E A D ---------------

Current thread (0x0000000008aae000): JavaThread "Grizzly-kernel-thread(1)" daemon [_thread_in_vm, id=3572, stack(0x0000000008360000,0x0000000008380000)]

siginfo: ExceptionCode=0xc0000005, reading address 0x0000000000000000

Registers:
RAX=0x0000000000000000, RBX=0x0000000008aae000, RCX=0x0000000000000e00, RDX=0x0000000000000000
RSP=0x000000000837f2b0, RBP=0x000000000a85bc50, RSI=0x0000000000000000, RDI=0x0000000000000000
R8=0x0000000000000032, R9=0x000000000a85bc50, R10=0x0000000000000000, R11=0x0000000000000246
R12=0x0000000000000032, R13=0x00000000c53922d8, R14=0x000000000837f448, R15=0x0000000008aae000
RIP=0x000000006dadf79e, EFLAGS=0x0000000000010202

Register to memory mapping:

RAX=0x0000000000000000
0x0000000000000000 is pointing to unknown location

RBX=0x0000000008aae000
"Grizzly-kernel-thread(1)" daemon prio=10 tid=0x0000000008aae000 nid=0xdf4 runnable [0x000000000837f000]
   java.lang.Thread.State: RUNNABLE

RCX=0x0000000000000e00
0x0000000000000e00 is pointing to unknown location

RDX=0x0000000000000000
0x0000000000000000 is pointing to unknown location

RSP=0x000000000837f2b0
0x000000000837f2b0 is pointing into the stack for thread: 0x0000000008aae000
"Grizzly-kernel-thread(1)" daemon prio=10 tid=0x0000000008aae000 nid=0xdf4 runnable [0x000000000837f000]
   java.lang.Thread.State: RUNNABLE

RBP=0x000000000a85bc50
0x000000000a85bc50 is pointing to unknown location

RSI=0x0000000000000000
0x0000000000000000 is pointing to unknown location

RDI=0x0000000000000000
0x0000000000000000 is pointing to unknown location

R8 =0x0000000000000032
0x0000000000000032 is pointing to unknown location

R9 =0x000000000a85bc50
0x000000000a85bc50 is pointing to unknown location

R10=0x0000000000000000
0x0000000000000000 is pointing to unknown location

R11=0x0000000000000246
0x0000000000000246 is pointing to unknown location

R12=0x0000000000000032
0x0000000000000032 is pointing to unknown location

R13=0x00000000c53922d8
{constMethod}
 - klass: {other class}
 - method: 0x00000000c53922e0 {method} 'accept0' '(Ljava/io/FileDescriptor;Ljava/io/FileDescriptor;[Ljava/net/InetSocketAddress;)I' in 'sun/nio/ch/ServerSocketChannelImpl'
 - exceptions: 0x00000000c4001ef8

R14=0x000000000837f448
0x000000000837f448 is pointing into the stack for thread: 0x0000000008aae000
"Grizzly-kernel-thread(1)" daemon prio=10 tid=0x0000000008aae000 nid=0xdf4 runnable [0x000000000837f000]
   java.lang.Thread.State: RUNNABLE

R15=0x0000000008aae000
"Grizzly-kernel-thread(1)" daemon prio=10 tid=0x0000000008aae000 nid=0xdf4 runnable [0x000000000837f000]
   java.lang.Thread.State: RUNNABLE


Top of Stack: (sp=0x000000000837f2b0)
0x000000000837f2b0: 0000000008aae000 0000000000002048
0x000000000837f2c0: 000000000837f438 000000000837f438
0x000000000837f2d0: 00000000000009a0 000000000837f430
0x000000000837f2e0: 0000000000000000 000000000837f438
0x000000000837f2f0: 0000000008aae1c8 00000000c4832e18
0x000000000837f300: 0000000000000000 000000006d6c3215
0x000000000837f310: 000000006dee6520 000000000837f430
0x000000000837f320: 0000000008aae1c8 00000000c4149600
0x000000000837f330: 0000000000000001 0000000000000001
0x000000000837f340: 0000000000000010 50bc850a8fa60002
0x000000000837f350: 0000000000000000 0000b74226c117d6
0x000000000837f360: 0000000000000001 00000000012258fa
0x000000000837f370: 00000000c4149600 000000000837f410
0x000000000837f380: 00000000c53922e0 00000000012312a0
0x000000000837f390: 0000000000000001 00000000c53c1f98
0x000000000837f3a0: 0000000008aae000 000000006da91dbd

Instructions: (pc=0x000000006dadf79e)
0x000000006dadf78e: 83 38 02 00 00 06 00 00 00 80 3d 2a ca 41 00 00
0x000000006dadf79e: 48 8b 16 74 17 44 8b 4a 08 0f b6 0d 0a b0 40 00


Stack: [0x0000000008360000,0x0000000008380000], sp=0x000000000837f2b0, free space=124k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [jvm.dll+0x24f79e]

[error occurred during error reporting (printing native stack), id 0xc0000005]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j sun.nio.ch.ServerSocketChannelImpl.accept0(Ljava/io/FileDescriptor;Ljava/io/FileDescriptor;[Ljava/net/InetSocketAddress;)I+0
j sun.nio.ch.ServerSocketChannelImpl.accept()Ljava/nio/channels/SocketChannel;+94
j com.sun.grizzly.TCPSelectorHandler.acceptWithoutRegistration(Ljava/nio/channels/SelectionKey;)Ljava/nio/channels/SelectableChannel;+11
j com.sun.enterprise.v3.services.impl.monitor.MonitorableSelectorHandler.acceptWithoutRegistration(Ljava/nio/channels/SelectionKey;)Ljava/nio/channels/SelectableChannel;+2
j com.sun.grizzly.http.SelectorThreadHandler.onAcceptInterest(Ljava/nio/channels/SelectionKey;Lcom/sun/grizzly/Context;)Z+2
J com.sun.grizzly.SelectorHandlerRunner.handleSelectedKey(Ljava/nio/channels/SelectionKey;Lcom/sun/grizzly/SelectorHandler;Lcom/sun/grizzly/NIOContext;)Z
J com.sun.grizzly.SelectorHandlerRunner.doSelect(Lcom/sun/grizzly/SelectorHandler;Lcom/sun/grizzly/NIOContext;)Z
J com.sun.grizzly.SelectorHandlerRunner.run()V
j java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Ljava/lang/Runnable;)V+59
j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+28
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub