P4
FULL PRODUCT VERSION :
java version "1.8.0_31"
FULL OS VERSION :
amd64 Kernel 2.6.18-406.0.0.0.1.el5
A DESCRIPTION OF THE PROBLEM :
JVM generates core dump on receiving QUIT signal.
The Java application is a scheduled application and it is started and stopped by a proprietary scheduler.
The stop operation guarantees the application is terminated, by sending QUIT and later KILL signals to the process.
In this phase, the JVM produces core dump.
the JVM is launched with the following options:
-Dcmp.name=${NAME} -Djava.library.path=${PATH}:${BINDIR} -server -Xrs -Xmx${MAXMEMORY} -Xms${MINMEMORY} -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCTimeStamps -XX:+PrintGCApplicationConcurrentTime -XX:+PrintTenuringDistribution -XX:+UseConcMarkSweepGC -XX:+PrintGCDateStamps -XX:+PrintCommandLineFlags -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.port=${JMXPORT} -Xloggc:${LOGS_DIR}/LOGS/${NAME}_${_TODAY}_${CURRENT_TIMESTAMP}_gc.log -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=85 -XX:+CMSParallelRemarkEnabled"
THE PROBLEM WAS REPRODUCIBLE WITH -Xint FLAG: Did not try
THE PROBLEM WAS REPRODUCIBLE WITH -server FLAG: Yes
STEPS TO FOLLOW TO REPRODUCE THE PROBLEM :
Start the application and terminate it with SIGQUIT.
EXPECTED VERSUS ACTUAL BEHAVIOR :
Expected: the process terminates.
Actual: the process terminates with a core dump.
ERROR MESSAGES/STACK TRACES THAT OCCUR :
Here is the core dump stack of the JVM:
GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-45.0.1.el5)
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /apps/etrading/jdk_64bit/1_8_0_31/bin/java...(no debugging symbols found)...done.
[New Thread 25965]
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
[Thread debugging using libthread_db enabled]
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /apps/etrading/jdk_64bit/1_8_0_31/bin/../lib/amd64/jli/libjli.so...(no debugging symbols found)...done.
Loaded symbols for /apps/etrading/jdk_64bit/1_8_0_31/bin/../lib/amd64/jli/libjli.so
Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so...(no debugging symbols found)...done.
Loaded symbols for /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so
Reading symbols from /lib64/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libm.so.6
warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7fff9e7ee000
Core was generated by `../jdk_64bit/1_8_0_31/bin/java -Dcmp.name=XXX -Djava.l'.
Program terminated with signal 3, Quit.
#0 0x00002b67a351db50 in global constructors keyed to jvmtiTagMap.cpp () from /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so
(gdb) bt
#0 0x00002b67a351db50 in global constructors keyed to jvmtiTagMap.cpp () from /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so
#1 0x00002b67a38388e6 in __do_global_ctors_aux () from /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so
#2 0x00002b67a2fae373 in _init () from /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so
#3 0x00002b67a2d9bff2 in ?? () from /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so
#4 0x0000003dd080d4ab in call_init () from /lib64/ld-linux-x86-64.so.2
#5 0x0000003dd080d5b5 in _dl_init_internal () from /lib64/ld-linux-x86-64.so.2
#6 0x0000003dd0811054 in dl_open_worker () from /lib64/ld-linux-x86-64.so.2
#7 0x0000003dd080d136 in _dl_catch_error () from /lib64/ld-linux-x86-64.so.2
#8 0x0000003dd08108bc in _dl_open () from /lib64/ld-linux-x86-64.so.2
#9 0x0000003dd1000f9a in dlopen_doit () from /lib64/libdl.so.2
#10 0x0000003dd080d136 in _dl_catch_error () from /lib64/ld-linux-x86-64.so.2
#11 0x0000003dd100150d in _dlerror_run () from /lib64/libdl.so.2
#12 0x0000003dd1000f11 in dlopen@@GLIBC_2.2.5 () from /lib64/libdl.so.2
#13 0x00002b67a2b88218 in LoadJavaVM () from /apps/etrading/jdk_64bit/1_8_0_31/bin/../lib/amd64/jli/libjli.so
#14 0x00002b67a2b85c07 in JLI_Launch () from /apps/etrading/jdk_64bit/1_8_0_31/bin/../lib/amd64/jli/libjli.so
#15 0x0000000000400696 in main ()
(gdb)
REPRODUCIBILITY :
This bug can be reproduced occasionally.
java version "1.8.0_31"
FULL OS VERSION :
amd64 Kernel 2.6.18-406.0.0.0.1.el5
A DESCRIPTION OF THE PROBLEM :
JVM generates core dump on receiving QUIT signal.
The Java application is a scheduled application and it is started and stopped by a proprietary scheduler.
The stop operation guarantees the application is terminated, by sending QUIT and later KILL signals to the process.
In this phase, the JVM produces core dump.
the JVM is launched with the following options:
-Dcmp.name=${NAME} -Djava.library.path=${PATH}:${BINDIR} -server -Xrs -Xmx${MAXMEMORY} -Xms${MINMEMORY} -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCTimeStamps -XX:+PrintGCApplicationConcurrentTime -XX:+PrintTenuringDistribution -XX:+UseConcMarkSweepGC -XX:+PrintGCDateStamps -XX:+PrintCommandLineFlags -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.port=${JMXPORT} -Xloggc:${LOGS_DIR}/LOGS/${NAME}_${_TODAY}_${CURRENT_TIMESTAMP}_gc.log -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=85 -XX:+CMSParallelRemarkEnabled"
THE PROBLEM WAS REPRODUCIBLE WITH -Xint FLAG: Did not try
THE PROBLEM WAS REPRODUCIBLE WITH -server FLAG: Yes
STEPS TO FOLLOW TO REPRODUCE THE PROBLEM :
Start the application and terminate it with SIGQUIT.
EXPECTED VERSUS ACTUAL BEHAVIOR :
Expected: the process terminates.
Actual: the process terminates with a core dump.
ERROR MESSAGES/STACK TRACES THAT OCCUR :
Here is the core dump stack of the JVM:
GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-45.0.1.el5)
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /apps/etrading/jdk_64bit/1_8_0_31/bin/java...(no debugging symbols found)...done.
[New Thread 25965]
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
[Thread debugging using libthread_db enabled]
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /apps/etrading/jdk_64bit/1_8_0_31/bin/../lib/amd64/jli/libjli.so...(no debugging symbols found)...done.
Loaded symbols for /apps/etrading/jdk_64bit/1_8_0_31/bin/../lib/amd64/jli/libjli.so
Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so...(no debugging symbols found)...done.
Loaded symbols for /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so
Reading symbols from /lib64/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libm.so.6
warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7fff9e7ee000
Core was generated by `../jdk_64bit/1_8_0_31/bin/java -Dcmp.name=XXX -Djava.l'.
Program terminated with signal 3, Quit.
#0 0x00002b67a351db50 in global constructors keyed to jvmtiTagMap.cpp () from /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so
(gdb) bt
#0 0x00002b67a351db50 in global constructors keyed to jvmtiTagMap.cpp () from /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so
#1 0x00002b67a38388e6 in __do_global_ctors_aux () from /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so
#2 0x00002b67a2fae373 in _init () from /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so
#3 0x00002b67a2d9bff2 in ?? () from /apps/etrading/jdk_64bit/1_8_0_31/jre/lib/amd64/server/libjvm.so
#4 0x0000003dd080d4ab in call_init () from /lib64/ld-linux-x86-64.so.2
#5 0x0000003dd080d5b5 in _dl_init_internal () from /lib64/ld-linux-x86-64.so.2
#6 0x0000003dd0811054 in dl_open_worker () from /lib64/ld-linux-x86-64.so.2
#7 0x0000003dd080d136 in _dl_catch_error () from /lib64/ld-linux-x86-64.so.2
#8 0x0000003dd08108bc in _dl_open () from /lib64/ld-linux-x86-64.so.2
#9 0x0000003dd1000f9a in dlopen_doit () from /lib64/libdl.so.2
#10 0x0000003dd080d136 in _dl_catch_error () from /lib64/ld-linux-x86-64.so.2
#11 0x0000003dd100150d in _dlerror_run () from /lib64/libdl.so.2
#12 0x0000003dd1000f11 in dlopen@@GLIBC_2.2.5 () from /lib64/libdl.so.2
#13 0x00002b67a2b88218 in LoadJavaVM () from /apps/etrading/jdk_64bit/1_8_0_31/bin/../lib/amd64/jli/libjli.so
#14 0x00002b67a2b85c07 in JLI_Launch () from /apps/etrading/jdk_64bit/1_8_0_31/bin/../lib/amd64/jli/libjli.so
#15 0x0000000000400696 in main ()
(gdb)
REPRODUCIBILITY :
This bug can be reproduced occasionally.