Name: jl125535 Date: 05/05/2004


FULL PRODUCT VERSION :
java version "1.5.0-beta"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0-beta-b32c)
Java HotSpot(TM) Client VM (build 1.5.0-beta-b32c, mixed mode)


FULL OS VERSION :
Microsoft Windows XP [Version 5.1.2600]

EXTRA RELEVANT SYSTEM CONFIGURATION :
not particularly relevant. standard hardware setup with network card. no known hardware issues.


A DESCRIPTION OF THE PROBLEM :
During execution the VM crashes with the given log. (See Error Messages). The application/system component uses only RMI. The supplied test case is pretty architecturally simple and as close to our implementation as reasonable.

This is always repeatable. The testcase is relatively intense. Actual use is less intensive. Nevertheless, the server will still crash after a couple of hours or a day or two.

There is nothing significantly out of the ordinary that would have me expect the VM to crash as a result of the application code.


STEPS TO FOLLOW TO REPRODUCE THE PROBLEM :
Use the attached test case.

Both client and server are running the same JVM version.
- On the client, the SDK is installed.
- On the server ONLY the JRE is installed.

Test Setup:

1. The server can be either Windows XP Professional or Windows 2003 Server.
Included here are logs from Windows 2003 Server. (See attached logs)

2. The client has only been tested from Windows XP (latest service packs and patches).

3. Copy all files to two (2) different machines.

4. execute 'runserver.bat' on the server.

5. execute 'runclient.bat REMOTEHOSTNAME' on the client. Choose appropriate host address.

6. Wait about 30 seconds or longer (not too much longer).

EXPECTED VERSUS ACTUAL BEHAVIOR :
EXPECTED -
As per the test case, the client should print out an exception and the server VM should NOT crash continually accepting requests from clients.
ACTUAL -
The test proceeds as expected (server throws exceptions, client catches them). At some point the server VM crashes causing error logs to be written.


ERROR MESSAGES/STACK TRACES THAT OCCUR :
#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x6d69e94b, pid=3200, tid=2784
#
# Java VM: Java HotSpot(TM) Client VM (1.5.0-beta-b32c mixed mode)
# Problematic frame:
# V [jvm.dll+0x7e94b]
#

--------------- T H R E A D ---------------

Current thread (0x0097ecf0): JavaThread "RMI TCP Connection(3)-192.168.10.162" daemon [_thread_in_vm, id=2784]

siginfo: ExceptionCode=0xc0000005, reading address 0x057d6264

Registers:
EAX=0x057d625c, EBX=0x011704e8, ECX=0x00000008, EDX=0x00000010
ESP=0x01c5f0b8, EBP=0x01c5f0bc, ESI=0x6cef01d0, EDI=0x0000011e
EIP=0x6d69e94b, EFLAGS=0x00010246

  Top of Stack: (sp=0x01c5f0b8)
0x01c5f0b8: 011704e8 01c5f0f0 6d72fc47 057d625c
0x01c5f0c8: 011704e8 00000010 4849e45e 6d72fd85
0x01c5f0d8: 0000011e 011704e8 00000010 4849e45e
0x01c5f0e8: 00000010 0097ecf0 01c5f138 6d72fed9
0x01c5f0f8: 00000000 011704e8 00000010 0097ecf0
0x01c5f108: 011704d0 011704e8 00000010 00000020
0x01c5f118: 006404d0 008c2274 0097ecf0 00000000
0x01c5f128: 009261a8 011704c8 011704e8 011708bc

Instructions: (pc=0x6d69e94b)
0x6d69e93b: 8b 45 08 8b 0d 28 70 7a 6d 8b 15 20 70 7a 6d 53
0x6d69e94b: 8b 1c 01 8b 0d 24 70 7a 6d 56 57 8b 0c 01 89 4d


Stack: [0x01b60000,0x01c60000), sp=0x01c5f0b8, free space=1020k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [jvm.dll+0x7e94b]
V [jvm.dll+0x10fc47]
V [jvm.dll+0x10fed9]
V [jvm.dll+0x7faed]
V [jvm.dll+0x7fa37]
V [jvm.dll+0x93002]
C [java.dll+0x3fc7]
J java.lang.Throwable.getOurStackTrace()[Ljava/lang/StackTraceElement;
J java.lang.Throwable.writeObject(Ljava/io/ObjectOutputStream;)V
J sun.reflect.GeneratedMethodAccessor5.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J java.io.ObjectStreamClass.invokeWriteObject(Ljava/lang/Object;Ljava/io/ObjectOutputStream;)V
J java.io.ObjectOutputStream.writeSerialData(Ljava/lang/Object;Ljava/io/ObjectStreamClass;)V
J java.io.ObjectOutputStream.writeOrdinaryObject(Ljava/lang/Object;Ljava/io/ObjectStreamClass;Z)V
J java.io.ObjectOutputStream.writeObject0(Ljava/lang/Object;Z)V
J java.io.ObjectOutputStream.writeObject(Ljava/lang/Object;)V
J sun.rmi.server.UnicastServerRef.dispatch(Ljava/rmi/Remote;Ljava/rmi/server/RemoteCall;)V
J sun.rmi.transport.Transport+1.run()Ljava/lang/Object;
v ~StubRoutines::call_stub
V [jvm.dll+0x7e22a]
V [jvm.dll+0xf4d6b]
V [jvm.dll+0x7e0fb]
C [java.dll+0x1061]
J sun.rmi.transport.Transport.serviceCall(Ljava/rmi/server/RemoteCall;)Z
J sun.rmi.transport.tcp.TCPTransport.handleMessages(Lsun/rmi/transport/Connection;Z)V
v ~OSRAdapter
j sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run()V+685
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
V [jvm.dll+0x7e22a]
V [jvm.dll+0xf4d6b]
V [jvm.dll+0x7e0fb]
V [jvm.dll+0x7de58]
V [jvm.dll+0x97998]
V [jvm.dll+0x11eba7]
V [jvm.dll+0x11eb75]
C [MSVCRT.dll+0x291ed]
C [kernel32.dll+0xa990]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
J java.lang.Throwable.getStackTraceElement(I)Ljava/lang/StackTraceElement;
J java.lang.Throwable.getOurStackTrace()[Ljava/lang/StackTraceElement;
J java.lang.Throwable.writeObject(Ljava/io/ObjectOutputStream;)V
J sun.reflect.GeneratedMethodAccessor5.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J java.io.ObjectStreamClass.invokeWriteObject(Ljava/lang/Object;Ljava/io/ObjectOutputStream;)V
J java.io.ObjectOutputStream.writeSerialData(Ljava/lang/Object;Ljava/io/ObjectStreamClass;)V
J java.io.ObjectOutputStream.writeOrdinaryObject(Ljava/lang/Object;Ljava/io/ObjectStreamClass;Z)V
J java.io.ObjectOutputStream.writeObject0(Ljava/lang/Object;Z)V
J java.io.ObjectOutputStream.writeObject(Ljava/lang/Object;)V
J sun.rmi.server.UnicastServerRef.dispatch(Ljava/rmi/Remote;Ljava/rmi/server/RemoteCall;)V
J sun.rmi.transport.Transport+1.run()Ljava/lang/Object;
v ~StubRoutines::call_stub
J java.security.AccessController.doPrivileged(Ljava/security/PrivilegedExceptionAction;Ljava/security/AccessControlContext;)Ljava/lang/Object;
J sun.rmi.transport.Transport.serviceCall(Ljava/rmi/server/RemoteCall;)Z
J sun.rmi.transport.tcp.TCPTransport.handleMessages(Lsun/rmi/transport/Connection;Z)V
v ~OSRAdapter
j sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run()V+685
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub

--------------- P R O C E S S ---------------

Java Threads: ( => current thread )
  0x008e2de0 JavaThread "RMI TCP Connection(5)-192.168.10.162" daemon [_thread_in_native, id=392]
  0x008e2a48 JavaThread "RMI TCP Connection(4)-192.168.10.162" daemon [_thread_in_native, id=2576]
=>0x0097ecf0 JavaThread "RMI TCP Connection(3)-192.168.10.162" daemon [_thread_in_vm, id=2784]
  0x008c1de8 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=3336]
  0x00946a18 JavaThread "RMI LeaseChecker" daemon [_thread_blocked, id=3284]
  0x009261f0 JavaThread "RMI TCP Connection(2)-192.168.10.162" daemon [_thread_in_native, id=3708]
  0x000357b8 JavaThread "DestroyJavaVM" [_thread_blocked, id=2092]
  0x0116ce70 JavaThread "GC Daemon" daemon [_thread_blocked, id=1648]
  0x0116cc50 JavaThread "RMI Reaper" [_thread_blocked, id=1828]
  0x0099fdd8 JavaThread "RMI TCP Accept-5051" daemon [_thread_in_native, id=2564]
  0x00905f68 JavaThread "Timer-0" daemon [_thread_blocked, id=3604]
  0x008d0c28 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=3780]
  0x008cf8e0 JavaThread "CompilerThread0" daemon [_thread_blocked, id=2844]
  0x008cebd0 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=3976]
  0x008cd3b8 JavaThread "Finalizer" daemon [_thread_blocked, id=3064]
  0x008cbf38 JavaThread "Reference Handler" daemon [_thread_blocked, id=2460]

Other Threads:
  0x008c9748 VMThread [id=3696]
  0x008d1d28 WatcherThread [id=2068]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap
 def new generation total 576K, used 51K [0x63a60000, 0x63b00000, 0x63f40000)
  eden space 512K, 10% used [0x63a60000, 0x63a6cea8, 0x63ae0000)
  from space 64K, 0% used [0x63ae0000, 0x63ae0000, 0x63af0000)
  to space 64K, 0% used [0x63af0000, 0x63af0000, 0x63b00000)
 tenured generation total 1636K, used 979K [0x63f40000, 0x640d9000, 0x67a60000)
   the space 1636K, 59% used [0x63f40000, 0x64034da0, 0x64034e00, 0x640d9000)
 compacting perm gen total 8192K, used 614K [0x67a60000, 0x68260000, 0x6ba60000)
   the space 8192K, 7% used [0x67a60000, 0x67af9bd8, 0x67af9c00, 0x68260000)
    ro space 8192K, 62% used [0x6ba60000, 0x6bf675d8, 0x6bf67600, 0x6c260000)
    rw space 12288K, 46% used [0x6c260000, 0x6c7f4428, 0x6c7f4600, 0x6ce60000)

Dynamic libraries:
0x00400000 - 0x0040b000 C:\WINDOWS\system32\java.exe
0x77f40000 - 0x77ffa000 C:\WINDOWS\system32\ntdll.dll
0x77e40000 - 0x77f34000 C:\WINDOWS\system32\kernel32.dll
0x77da0000 - 0x77e30000 C:\WINDOWS\system32\ADVAPI32.dll
0x77c50000 - 0x77cf4000 C:\WINDOWS\system32\RPCRT4.dll
0x77ba0000 - 0x77bf4000 C:\WINDOWS\system32\MSVCRT.dll
0x6d620000 - 0x6d7c7000 C:\Program Files\Java\j2re1.5.0\bin\client\jvm.dll
0x77d00000 - 0x77d8f000 C:\WINDOWS\system32\USER32.dll
0x77c00000 - 0x77c44000 C:\WINDOWS\system32\GDI32.dll
0x76aa0000 - 0x76acc000 C:\WINDOWS\system32\WINMM.dll
0x71bc0000 - 0x71bc8000 C:\WINDOWS\system32\rdpsnd.dll
0x76260000 - 0x76270000 C:\WINDOWS\system32\WINSTA.dll
0x71c40000 - 0x71c93000 C:\WINDOWS\system32\NETAPI32.dll
0x76b70000 - 0x76b7b000 C:\WINDOWS\system32\PSAPI.DLL
0x6d260000 - 0x6d267000 C:\Program Files\Java\j2re1.5.0\bin\hpi.dll
0x6d5f0000 - 0x6d5fb000 C:\Program Files\Java\j2re1.5.0\bin\verify.dll
0x6d2d0000 - 0x6d2ec000 C:\Program Files\Java\j2re1.5.0\bin\java.dll
0x6d610000 - 0x6d61e000 C:\Program Files\Java\j2re1.5.0\bin\zip.dll
0x0ffd0000 - 0x0fffd000 C:\WINDOWS\system32\rsaenh.dll
0x75970000 - 0x75a2a000 C:\WINDOWS\system32\USERENV.dll
0x6d490000 - 0x6d4a3000 C:\Program Files\Java\j2re1.5.0\bin\net.dll
0x71c00000 - 0x71c18000 C:\WINDOWS\system32\WS2_32.dll
0x71bf0000 - 0x71bf8000 C:\WINDOWS\system32\WS2HELP.dll
0x71b20000 - 0x71b63000 C:\WINDOWS\System32\mswsock.dll
0x76ed0000 - 0x76ef7000 C:\WINDOWS\system32\DNSAPI.dll
0x76f70000 - 0x76f77000 C:\WINDOWS\System32\winrnr.dll
0x76f10000 - 0x76f3f000 C:\WINDOWS\system32\WLDAP32.dll
0x76f80000 - 0x76f85000 C:\WINDOWS\system32\rasadhlp.dll
0x71ae0000 - 0x71ae8000 C:\WINDOWS\System32\wshtcpip.dll
0x6d5d0000 - 0x6d5d5000 C:\Program Files\Java\j2re1.5.0\bin\rmi.dll

VM Arguments:
java_command: crash.server.RMIServer

Environment Variables:
PATH=C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem
USERNAME=mpii
OS=Windows_NT
PROCESSOR_IDENTIFIER=x86 Family 6 Model 8 Stepping 1, AuthenticAMD


--------------- S Y S T E M ---------------

OS: Windows Server 2003 family Build 3790

CPU:total 1(active 1) family 6, cmov, cx8, fxsr, mmx, sse

Memory: 4k page, physical 228852k(55528k free), swap 563740k(364568k free)

vm_info: Java HotSpot(TM) Client VM (1.5.0-beta-b32c) for windows-x86, built on Jan 23 2004 01:52:20 by "java_re" with MS VC++ 6.0



REPRODUCIBILITY :
This bug can be reproduced always.

---------- BEGIN SOURCE ----------
Source code has been sent to ###@###.### as per a previous bug-report 250555.
---------- END SOURCE ----------

CUSTOMER SUBMITTED WORKAROUND :
adding VM option "-XX:+UseConcMarkSweepGC" seems to work.

I mark this as 'Difficult to make even minimal progress without resolving this bug' as the VM really should not / must not crash. We obviously have mechanisms in place to restart a crashed component and data is not lost on crash (system design). We expect that these are the issues to be found in any beta cycle.
(Incident Review ID: 260910)
======================================================================