Platform:
=========
- Linux RH 7.2 (JPN) (2.4.10-SMP and also 2.4.20SMP same effect)
- S1AS7SE Linux 7.0 - S1AS7 Linux Bundled JDK 1.4.1_b21
Problem
========
- S1AS7 Does not respond and all Java related webcontainer hang.
Only static web pages can be served.
- S1AS7 does not response even with kill -3 to dump java stack trace
#0 0x40d29aa5 in __sigsuspend (set=0x641fe520) at ../sysdeps/unix/sysv/linux/sigsuspend.c:45
#1 0x40c46079 in __pthread_wait_for_restart_signal (self=0x641ffbe0) at pthread.c:967
#2 0x40c42bdc in pthread_cond_wait (cond=0x4271773c, mutex=0x42717724) at restart.h:34
#3 0x41387934 in os::Linux::safe_cond_wait () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#4 0x4137506d in Monitor::wait () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#5 0x4141e7c1 in VMThread::execute () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#6 0x41227fe6 in TwoGenerationCollectorPolicy::mem_allocate_work () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#7 0x4127d8f0 in GenCollectedHeap::mem_allocate () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#8 0x41408052 in typeArrayKlass::allocate () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#9 0x41380aaa in oopFactory::new_typeArray () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#10 0x413c084c in OptoRuntime::new_typeArray_C () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#11 0x44630edd in ?? ()
#12 0x4f27d9f8 in ?? ()
Test Case
=========
Run NileJSP benchmark that is used by Net/IBM test benchmark with load and eventually hang (using 100 virtual users and a sample shopping logout) on S1AS7 Linux (Jpn locale)
NileJSP is a JSP acessing a shopping cart using Oracle9i (type-4)
Problem
========
- JDK does not respond and hang to jsp/servlet request although static content web page is ok.
- PS: When more load, it may end up into HTTP3069: Error accepting connection (PR_PROC_DESC_TABLE_FULL_ERROR: file descriptor table full) (since JSP/Servlet is not responding and many outstanding HTTP request is queued)
Trial elimination
================
Bundled JDK = 1.4.1_b21
- Bundled JDK (with 2.4.10smp and also newest kernel 2.4.20smp) --> hang
- Bundled JDK, -Xconcgc --> hang
- Bundled JDK, plain GC -Xmx=-Xms --> hang - JDK 1.4_1_03, plain gc --> hang (2.4.20)
- JDK 1.4.2_beta, plain gc --> OK (2.4.20)
Bottom line
============
JDK 1.4.2_beta does not have problem while the rest being
same. Other than that, not much able to find out
pstack (gdb), pmap and server.xml (contains the java options)
is within attachment.
###@###.### 2003-06-03
=========
- Linux RH 7.2 (JPN) (2.4.10-SMP and also 2.4.20SMP same effect)
- S1AS7SE Linux 7.0 - S1AS7 Linux Bundled JDK 1.4.1_b21
Problem
========
- S1AS7 Does not respond and all Java related webcontainer hang.
Only static web pages can be served.
- S1AS7 does not response even with kill -3 to dump java stack trace
#0 0x40d29aa5 in __sigsuspend (set=0x641fe520) at ../sysdeps/unix/sysv/linux/sigsuspend.c:45
#1 0x40c46079 in __pthread_wait_for_restart_signal (self=0x641ffbe0) at pthread.c:967
#2 0x40c42bdc in pthread_cond_wait (cond=0x4271773c, mutex=0x42717724) at restart.h:34
#3 0x41387934 in os::Linux::safe_cond_wait () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#4 0x4137506d in Monitor::wait () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#5 0x4141e7c1 in VMThread::execute () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#6 0x41227fe6 in TwoGenerationCollectorPolicy::mem_allocate_work () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#7 0x4127d8f0 in GenCollectedHeap::mem_allocate () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#8 0x41408052 in typeArrayKlass::allocate () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#9 0x41380aaa in oopFactory::new_typeArray () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#10 0x413c084c in OptoRuntime::new_typeArray_C () from /usr/java/j2sdk1.4.1_03/jre/lib/i386/server/libjvm.so
#11 0x44630edd in ?? ()
#12 0x4f27d9f8 in ?? ()
Test Case
=========
Run NileJSP benchmark that is used by Net/IBM test benchmark with load and eventually hang (using 100 virtual users and a sample shopping logout) on S1AS7 Linux (Jpn locale)
NileJSP is a JSP acessing a shopping cart using Oracle9i (type-4)
Problem
========
- JDK does not respond and hang to jsp/servlet request although static content web page is ok.
- PS: When more load, it may end up into HTTP3069: Error accepting connection (PR_PROC_DESC_TABLE_FULL_ERROR: file descriptor table full) (since JSP/Servlet is not responding and many outstanding HTTP request is queued)
Trial elimination
================
Bundled JDK = 1.4.1_b21
- Bundled JDK (with 2.4.10smp and also newest kernel 2.4.20smp) --> hang
- Bundled JDK, -Xconcgc --> hang
- Bundled JDK, plain GC -Xmx=-Xms --> hang - JDK 1.4_1_03, plain gc --> hang (2.4.20)
- JDK 1.4.2_beta, plain gc --> OK (2.4.20)
Bottom line
============
JDK 1.4.2_beta does not have problem while the rest being
same. Other than that, not much able to find out
pstack (gdb), pmap and server.xml (contains the java options)
is within attachment.
###@###.### 2003-06-03