Cu running home grown 32 bit java application on SuSE linux, Optron E325 box and java 1.4.2_06. The application takes an xml document, parses it, tokenizes it then puts the info on an on-line database.

Java app crashes on production machine. Using -XX:+PrintCompilation and excluding the last methods compiled before crash hasn't helped as it crashes in different methods each time. Does not see problem with 1.5_01 but for compatiblity issues, he cannot migrate his application at this time.

The process in question uses both Oracle and DB2.

When we first talked, our production systems were using type 2 drivers for
DB2 and type 2 drivers for Oracle and the JVM was crashing very frequently.
In our lab we were testing using type 4 drivers for DB2 and type 2 drivers
for Oracle and did not see any JVM failures.

Currently, our production system is using type 4 drivers for DB2 and type 2
drivers for Oracle and we are seeing about a 2% JVM failure rate.

Currently, in the lab, I'm using type 2 drivers for DB2 and type 2 drivers
for Oracle and can cause the JVM to crash almost at will. If I go to type 4
drivers for DB2, it is alot more difficult to get the JVM to crash.


java -server -Xms1500m -Xmx1500m
-Dworkarea=/novus/users/novus/scripts/loadserver/workarea
-Djava.ext.dirs=/novus/prod/releases/Novus:/novus/prod/releases/System:/novu
s/prod/releases/MQ:/novus/prod/releases/db -Ddomain=WLLOADB
com.westgroup.novus.message.SpecialRequestResponseServices
API=LoadManagerServ parmFile=LDAP queue=LOADMANAGERSERV.PROD.API.100
NovusId=100 numBldThreads=6 numEventDoc=8 env=PROD
Package=com.westgroup.novus.loadmanagerserv

>>JVM crash information
>>#
>># HotSpot Virtual Machine Error, Internal Error
>># Please report this error at
>># http://java.sun.com/cgi-bin/bugreport.cgi
>>#
>># Java VM: Java HotSpot(TM) Server VM (1.4.2_06-b03 mixed mode)
>>#
>># Error ID: 53484152454432554E54494D450E4350500161
>>#
>># Problematic Thread: prio=1 tid=0x0805b470 nid=0x6abc waiting on condition
>>#
>>
>>Heap at VM Abort:
>>Heap
>> def new generation total 204800K, used 182079K [0x44630000, 0x52460000,
>>0x52460000)
>> eden space 182080K, 99% used [0x44630000, 0x4f7ffff0, 0x4f800000)
>> from space 22720K, 0% used [0x4f800000, 0x4f800000, 0x50e30000)
>> to space 22720K, 0% used [0x50e30000, 0x50e30000, 0x52460000)
>> tenured generation total 1820480K, used 0K [0x52460000, 0xc1630000,
>>0xc1630000)
>> the space 1820480K, 0% used [0x52460000, 0x52460000, 0x52460200,
>>0xc1630000)
>> compacting perm gen total 16384K, used 11281K [0xc1630000, 0xc2630000,
>>0xc5630000)
>> the space 16384K, 68% used [0xc1630000, 0xc21345f8, 0xc2134600,
>>0xc2630000)

When I got the "Do you want to debug the problem?" prompt I didn't respond.
I brought up gdb in another terminal session with the same user as the
running application. I tried a backtrace and got the following.

Attaching to program: /usr/java/j2sdk1.4.2_06/bin/java, process 15910

warning: current_sos: Can't read pathname for load map: Input/output error

Cannot access memory at address 0x89f87589f45d8900
A program is being debugged already. Kill it? (y or n) n
Program not killed.
(gdb) bt
#0 0x000000004006cf19 in ?? ()
(gdb)

1) attached are two hs_err files for 142_06. Only two of the four runs
resulted in an hs_err file.

Cu tested 1.4.2_07 on the client and server side. It crashed and he did get
more information below. ( see attached hs_err_pid15706.log)

Unexpected Signal: 11, PC: 0x55588a24, PID: 15706
An error has just occurred.
To debug, use 'gdb /usr/java/j2sdk1.4.2_07/bin/java 15706'; then switch to
thread 64529
Otherwise, press RETURN to abort...


An unexpected exception has been detected in native code outside the VM.
Unexpected Signal : 11 occurred at PC=0x55588A24
Function=pthread_getspecific+0x64
Library=/lib/libpthread.so.0

Heap at VM Abort:
Heap
 def new generation total 141760K, used 91536K [0x59c60000, 0x63630000,
0x63630000)
  eden space 126016K, 72% used [0x59c60000, 0x5f5c4100, 0x61770000)
  from space 15744K, 0% used [0x61770000, 0x61770000, 0x626d0000)
  to space 15744K, 0% used [0x626d0000, 0x626d0000, 0x63630000)
 tenured generation total 1890496K, used 2083K [0x63630000, 0xd6c60000,
0xd6c60000)
   the space 1890496K, 0% used [0x63630000, 0x63838cb0, 0x63838e00,
0xd6c60000)
 compacting perm gen total 10752K, used 10524K [0xd6c60000, 0xd76e0000,
0xdac60000)
   the space 10752K, 97% used [0xd6c60000, 0xd76a72b0, 0xd76a7400,
0xd76e0000)

Local Time = Tue Nov 9 13:13:57 2004
Elapsed Time = 708
#
# The exception above was detected in native code outside the VM
#
# Java VM: Java HotSpot(TM) Client VM (1.4.2_07-b02 mixed mode)
#
# An error report file has been saved as hs_err_pid15706.log.
# Please refer to the file for further information.

********** Information using the -client option **********

********** Error from application ************

Unexpected Signal: 11, PC: 0x55588a24, PID: 3919
An error has just occurred.
To debug, use 'gdb /usr/java/j2sdk1.4.2_07/bin/java 3919'; then switch to
thread 65552
Otherwise, press RETURN to abort...


********** GDB Information ******************

(gdb) bt

#0 0x555c1f19 in sigsuspend () from /lib/libc.so.6
#1 0x55587d38 in __pthread_wait_for_restart_signal () from
/lib/libpthread.so.0
#2 0x55589d39 in __pthread_alt_lock () from /lib/libpthread.so.0
#3 0x55586190 in pthread_mutex_lock () from /lib/libpthread.so.0
#4 0x559137db in os::Linux::safe_mutex_lock () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/client/libjvm.so
#5 0x55903a40 in Mutex::lock_without_safepoint_check ()
   from /usr/java/j2sdk1.4.2_07/jre/lib/i386/client/libjvm.so
#6 0x55931dee in SafepointSynchronize::block () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/client/libjvm.so
#7 0x55912bc0 in os::sleep () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/client/libjvm.so
#8 0x558ba27d in JVM_Sleep () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/client/libjvm.so
#9 0x57bbecb2 in ?? ()
#10 0x57bb8e9b in ?? ()
#11 0x57bb8e9b in ?? ()
#12 0x57bb61c4 in ?? ()
#13 0x5585e794 in JavaCalls::call_helper () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/client/libjvm.so
#14 0x5591409d in os::os_exception_wrapper () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/client/libjvm.so
#15 0x5585e9e6 in JavaCalls::call () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/client/libjvm.so
#16 0x55866c5c in jni_invoke_static () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/client/libjvm.so
#17 0x558757cd in jni_CallStaticVoidMethod () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/client/libjvm.so
#18 0x08049abe in strcpy ()
#19 0x555b04f2 in __libc_start_main () from /lib/libc.so.6



********** Information using the -server option **********

********** Error from application ************

#
# HotSpot Virtual Machine Error, Internal Error
# Please report this error at
# http://java.sun.com/cgi-bin/bugreport.cgi
#
# Java VM: Java HotSpot(TM) Server VM (1.4.2_07-b02 mixed mode)
#
# Error ID: 53484152454432554E54494D450E4350500161
#
# Problematic Thread: prio=1 tid=0x0805b1f0 nid=0x113d waiting on condition
#
Internal Error
Fatal: exception happened outside interpreter, nmethods and vtable stubs (2)

Do you want to debug the problem?


********** GDB Information ******************
(gdb) bt

#0 0x555c1f19 in sigsuspend () from /lib/libc.so.6
#1 0x55587d38 in __pthread_wait_for_restart_signal () from
/lib/libpthread.so.0
#2 0x55589d39 in __pthread_alt_lock () from /lib/libpthread.so.0
#3 0x55586190 in pthread_mutex_lock () from /lib/libpthread.so.0
#4 0x55a6c91b in os::Linux::safe_mutex_lock () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/server/libjvm.so
#5 0x55a59f90 in Mutex::lock_without_safepoint_check ()
   from /usr/java/j2sdk1.4.2_07/jre/lib/i386/server/libjvm.so
#6 0x55ab678e in SafepointSynchronize::block () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/server/libjvm.so
#7 0x55a6bd00 in os::sleep () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/server/libjvm.so
#8 0x559e12bd in JVM_Sleep () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/server/libjvm.so
#9 0x57db502f in ?? ()
#10 0x57daeeeb in ?? ()
#11 0x57daeeeb in ?? ()
#12 0x57dac204 in ?? ()
#13 0x559857d4 in JavaCalls::call_helper () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/server/libjvm.so
#14 0x55a6d1bd in os::os_exception_wrapper () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/server/libjvm.so
#15 0x55985a26 in JavaCalls::call () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/server/libjvm.so
#16 0x5598dc9c in jni_invoke_static () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/server/libjvm.so
#17 0x5599c80d in jni_CallStaticVoidMethod () from
/usr/java/j2sdk1.4.2_07/jre/lib/i386/server/libjvm.so
#18 0x08049abe in strcpy ()
#19 0x555b04f2 in __libc_start_main () from /lib/libc.so.6
###@###.### 2004-11-17 23:38:55 GMT