Uploaded image for project: 'JDK'
  1. JDK
  2. JDK-6353079

test nsk/jvmti/scenarios/multienv/MA08/ma08t00 is timed out intermittently

XMLWordPrintable

    • 6
    • x86
    • solaris

      The following is a part of nightly report from Dan:

      New nsk.jvmti failures (from 2005.11.07)
          nsk/jvmti/scenarios/multienv/MA08/ma08t001
              This test failed due to a status sync timeout on Solaris X86
              Client VM (machine ordmandell). This test was covered by the
              following bug:
                  4627997 4/4 JDI testcase crexreq001 failing with -client
                              -Xcomp only, all platforms
              which was fixed in Mustang-B59. The first run failed the same
              way. A status sync timeout usually indicates that the test
              machine is overloaded.
              Update: The test failed on 2005.11.09 on machine kashyyyk.
              Update: The test failed on 2005.11.14 on machine corellia.

      Link to the first nightly with this failure:
        http://vmsqe.sfbay.sun.com/nightly/mantis/DTWS/results/11-07-05/report.html

      This "TIMED OUT" problem is reproducible but has an intermittent nature.

      There is ma08t001.tlog below:

      #!/usr/bin/sh

      CLASSPATH=/net/vmsqe.sfbay/export/pit/log/NIGHTLY/11-07-05/ClientVM/solx86/Work/nsk.jvmti-NIGHTLY-Serv_Baseline-ClientVM-comp-solx86-2005-11-07-13-56-14/run2/fhsu.Solaris.x86/ma08t001:/net/vmsqe.sfbay/export/backup/testbase/testbase_vm.1.6_r02/vm/bin/classes:/net/vmsqe.sfbay/export/nightly/mantis/JDK/service_hs_baseline/jdk1.6/solaris-i586/lib/tools.jar
      HOME=/home/fhsu
      RAS_OPTIONS=
      LD_LIBRARY_PATH=/net/vmsqe.sfbay/export/backup/testbase/testbase_vm.1.6_r02/vm/bin/lib/intel/nsk/jvmti/scenarios/multienv/MA08:/net/vmsqe.sfbay/export/backup/testbase/testbase_vm.1.6_r02/vm/src/nsk/share/lib/intel:/net/vmsqe.sfbay/export/nightly/mantis/JDK/service_hs_baseline/jdk1.6/solaris-i586/jre/lib/i386/client
      PATH=/net/vmsqe.sfbay/export/nightly/mantis/JDK/service_hs_baseline/jdk1.6/solaris-i586/bin:/net/vmsqe.sfbay/export/nightly/mantis/JDK/service_hs_baseline/jdk1.6/solaris-i586/jre/bin:/bin:/usr/bin:/net/vmsqe.sfbay/export/nightly/mantis/JDK/service_hs_baseline/jdk1.6/solaris-i586/jre/bin
      DISPLAY=vmsqe.sfbay:0.0
      SHELL=/usr/bin/sh

      while [ $# -gt 0 ];
      do
        if [ $1 = "-jdk" ]; then
      shift 1
      PATH=${1}/bin:${PATH}
      shift 1
        else
      if [ $1 = "-d" ]; then
      shift 1
      if [ $# -gt 0 ]; then
      DISPLAY=$1
      shift 1
      else
      DISPLAY=:0.0
      fi
      fi
        fi
      done

      export CLASSPATH
      export HOME
      export RAS_OPTIONS
      export LD_LIBRARY_PATH
      export PATH
      export DISPLAY
      export SHELL

      #annotate TEST javaopt=-client -Xcomp -agentlib:ma08t001=-waittime=2 -agentlib:ma08t001a=-waittime=2
      /net/vmsqe.sfbay/export/nightly/mantis/JDK/service_hs_baseline/jdk1.6/solaris-i586/bin/java -client -Xcomp -DHANGINGJAVA9455 -agentlib:ma08t001=-waittime=2 -agentlib:ma08t001a=-waittime=2 nsk.jvmti.scenarios.multienv.MA08.ma08t001
      ##Exit status of execution step=143
      ##Test timed out
      ##!checkExitCode

      ## ERROR: agent_tools.c, 273: No status sync occured for timeout: 120000 ms
      ## ERROR: agent_tools.c, 273: No status sync occured for timeout: 120000 ms

      #TONGA: TIMED OUT nsk/jvmti/scenarios/multienv/MA08/ma08t001 execute_positive

      The test failure is well reproduced on Solaris x86 machines: corellia and others.

      I also checked and found that this bug is not a manifestation of the CR:
         6345274 ATG client failure due to bad immediate dominator info

      The CR 6345274 was fixed in the HotSpot b61.
      So, I checked that the test is still failed intermittently on the build b61.
      In a case it can be useful the following is the pstack dump for hanging process:

      ss45998@mho pstack 5847 | c++filt
      5847: /java/re/jdk/1.6.0/promoted/all/b61/binaries/solaris-i586/bin/java -cl
      ----------------- lwp# 1 / thread# 1 --------------------
       fef6e087 lwp_wait (2, 8046d00)
       fef6a2f0 _thrp_join (2, 0, 8046d50, 1) + 5a
       fef6a432 thr_join (2, 0, 8046d50) + 20
       08059787 ContinueInNewThread (8052460, 50000, 0, 80475f8, 80475b0) + 4f
       08051ff0 main (0, 8073260, 8047690) + afc
       08051466 _start (6, 80477a4, 80477e7, 80477ef, 80477f7, 8047816) + 7a
      ----------------- lwp# 2 / thread# 2 --------------------
       fef6e127 lwp_cond_wait (80793d0, 80793b8, fe83b988, 0)
       fef5b59f _lwp_cond_timedwait (80793d0, 80793b8, fe83b9b8) + 35
       fec9af0f int PlatformEvent::park(long long) (8079388, 1d4c0, 0) + e3
       fecdeb73 void ObjectMonitor::wait(long long,bool,Thread*) (8170188, 1d4c0, 0, 1, 8078900) + 2cf
       feaa373b void ObjectSynchronizer::wait(Handle,long long,Thread*) (8078f0c, 1d4c0, 0, 8078900, 1a1) + df
       feaa3462 JVM_MonitorWait (80789e4, fe83bb98, 1d4c0, 0, 80789e4, 8078f34) + 1fa
       fc609e0a ???????? (0, fc608019, 1d4c0, 0, f44510f8, 3)
       fc602e9d ???????? (1d4c0, 0, 0, 0, a2976d11, 107)
       fc602e9d ???????? (0, f4403e98, f4438e98, f4438ea8, fe83bc28, f85805d1)
       fc602d79 ???????? (f4403e98, f4438e98, fe83bc58, f8580534, fe83bc80, f8584030)
       fc602d79 ???????? (f4438e98, 8078900, 8078f04, 1f80, fedde000, 1)
       fc600202 ???????? (fe83bcd0, fe83bedc, a, f8580548, fc609020, fe83bdd4)
       fea990f3 void JavaCalls::call_helper(JavaValue*,methodHandle*,JavaCallArguments*,Thread*) (fe83bed8, fe83bda4, fe83bdd0, 8078900) + 1a3
       fea98f47 void os::os_exception_wrapper(void(*)(JavaValue*,methodHandle*,JavaCallArguments*,Thread*),JavaValue*,methodHandle*,JavaCallArguments*,Thread*) (fea98f50, fe83bed8, fe83bda4, fe83bdd0, 8078900) + 27
       fea98f17 void JavaCalls::call(JavaValue*,methodHandle,JavaCallArguments*,Thread*) (fe83bed8, 8078f04, fe83bdd0, 8078900) + 2f
       feaa5ef7 void jni_invoke_static(JNIEnv_*,JavaValue*,_jobject*,JNICallType,_jmethodID*,JNI_ArgumentPusher*,Thread*) (80789e4, fe83bed8, 0, 0, 8176299, fe83bee4) + 1e7
       feadb490 jni_CallStaticVoidMethod (80789e4, 80794dc, 8176299, 80794ec) + 18c
       08053001 JavaMain (80475f8) + ba1
       fef6d02f _thr_setup (feec2400) + 4e
       fef6d320 _lwp_start (feec2400, 0, 0, fe83bff8, fef6d320, feec2400)
      ----------------- lwp# 3 / thread# 3 --------------------
       fef6e127 lwp_cond_wait (8077e40, 8077e28, fe64da68, 0)
       fef5b59f _lwp_cond_timedwait (8077e40, 8077e28, fe64da98) + 35
       fec905a6 bool Monitor::wait(bool,long) (8077dd0, 1, 3e8) + 496
       fea97e65 void VMThread::loop() (8163100) + 101
       fea97cc0 void VMThread::run() (8163100) + 88
       fec97ba3 java_start (8163100) + d3
       fef6d02f _thr_setup (fc4e0000) + 4e
       fef6d320 _lwp_start (fc4e0000, 0, 0, fe64dff8, fef6d320, fc4e0000)
      ----------------- lwp# 4 / thread# 4 --------------------
       fef6e127 lwp_cond_wait (8166e58, 8166e40, 0, 0)
       fec9adb1 void PlatformEvent::park() (8166e10) + a9
       fecdeb86 void ObjectMonitor::wait(long long,bool,Thread*) (817005c, 0, 0, 1, 8166400) + 2e2
       feaa373b void ObjectSynchronizer::wait(Handle,long long,Thread*) (8166a2c, 0, 0, 8166400, 191) + df
       feaa3462 JVM_MonitorWait (81664e4, fc4dd8b0, 0, 0, 111, 0) + 1fa
       fc609e0a ???????? (0, fc608019, 0, 0, f44009f0, fc4dd8b4)
       fc602e9d ???????? (f44009f0, 1, f44009f0, fc4dd8e0, f848703e, fc4dd920)
       fc602e9d ???????? (0, 0, f44009f0, 0, f44009f8, 8166400)
       fc600202 ???????? (fc4dd970, fc4ddbc8, a, f8487098, fc609020, fc4ddad8)
       fea990f3 void JavaCalls::call_helper(JavaValue*,methodHandle*,JavaCallArguments*,Thread*) (fc4ddbc4, fc4dda48, fc4ddad4, 8166400) + 1a3
       fea98f47 void os::os_exception_wrapper(void(*)(JavaValue*,methodHandle*,JavaCallArguments*,Thread*),JavaValue*,methodHandle*,JavaCallArguments*,Thread*) (fea98f50, fc4ddbc4, fc4dda48, fc4ddad4, 8166400) + 27
       fea98f17 void JavaCalls::call(JavaValue*,methodHandle,JavaCallArguments*,Thread*) (fc4ddbc4, 8166a28, fc4ddad4, 8166400) + 2f
       feaa31b1 void JavaCalls::call_virtual(JavaValue*,KlassHandle,symbolHandle,symbolHandle,JavaCallArguments*,Thread*) (fc4ddbc4, 8166a1c, fee017c4, fee018a4, fc4ddad4, 8166400) + c1
       feaa30ea void JavaCalls::call_virtual(JavaValue*,Handle,KlassHandle,symbolHandle,symbolHandle,Thread*) (fc4ddbc4, 8166a18, 8166a1c, fee017c4, fee018a4, 8166400) + 7e
       feaa3056 void thread_entry(JavaThread*,Thread*) (8166400, 8166400) + d2
       feaa2ea4 void JavaThread::thread_main_inner() (8166400) + 4c
       feaa2e4d void JavaThread::run() (8166400) + 189
       fec97ba3 java_start (8166400) + d3
       fef6d02f _thr_setup (fc4e0400) + 4e
       fef6d320 _lwp_start (fc4e0400, 0, 0, fc4ddff8, fef6d320, fc4e0400)
      ----------------- lwp# 5 / thread# 5 --------------------
       fef6e127 lwp_cond_wait (8167bb0, 8167b98, 0, 0)
       fec9adb1 void PlatformEvent::park() (8167b68) + a9
       fecdeb86 void ObjectMonitor::wait(long long,bool,Thread*) (816fff8, 0, 0, 1, 8167100) + 2e2
       feaa373b void ObjectSynchronizer::wait(Handle,long long,Thread*) (8167724, 0, 0, 8167100, 191) + df
       feaa3462 JVM_MonitorWait (81671e4, fc48b8fc, 0, 0, 8167744, fc48b8c4) + 1fa
       fc609e0a ???????? (0, fc608019, 0, 0, f4400af0, 1)
       fc602e9d ???????? (0, 0, f4400af0, 0, 0, f4400ad8)
       fc602d37 ???????? (f4400ad8, fc48b974, f8487973, fc48b9a0, f8487c08, 0)
       fc602d37 ???????? (0, f4400b00, 8167100, 8167720, 1f80, fedde000)
       fc600202 ???????? (fc48b9f0, fc48bc48, a, f8487990, fc609020, fc48bb58)
       fea990f3 void JavaCalls::call_helper(JavaValue*,methodHandle*,JavaCallArguments*,Thread*) (fc48bc44, fc48bac8, fc48bb54, 8167100) + 1a3
       fea98f47 void os::os_exception_wrapper(void(*)(JavaValue*,methodHandle*,JavaCallArguments*,Thread*),JavaValue*,methodHandle*,JavaCallArguments*,Thread*) (fea98f50, fc48bc44, fc48bac8, fc48bb54, 8167100) + 27
       fea98f17 void JavaCalls::call(JavaValue*,methodHandle,JavaCallArguments*,Thread*) (fc48bc44, 8167720, fc48bb54, 8167100) + 2f
       feaa31b1 void JavaCalls::call_virtual(JavaValue*,KlassHandle,symbolHandle,symbolHandle,JavaCallArguments*,Thread*) (fc48bc44, 8167714, fee017c4, fee018a4, fc48bb54, 8167100) + c1
       feaa30ea void JavaCalls::call_virtual(JavaValue*,Handle,KlassHandle,symbolHandle,symbolHandle,Thread*) (fc48bc44, 8167710, 8167714, fee017c4, fee018a4, 8167100) + 7e
       feaa3056 void thread_entry(JavaThread*,Thread*) (8167100, 8167100) + d2
       feaa2ea4 void JavaThread::thread_main_inner() (8167100) + 4c
       feaa2e4d void JavaThread::run() (8167100) + 189
       fec97ba3 java_start (8167100) + d3
       fef6d02f _thr_setup (fc4e0800) + 4e
       fef6d320 _lwp_start (fc4e0800, 0, 0, fc48bff8, fef6d320, fc4e0800)
      ----------------- lwp# 6 / thread# 6 --------------------
       fef6d37b lwp_park (0, 0, 0)
       fef63490 sema_wait (fedfe4b0) + d
       fec98e84 int check_pending_signals(bool) (1) + 15c
       feab72b9 int os::signal_wait() (f4283d08, 8181800, fedde000, 0, 0, 0) + d
       feab6fba void signal_thread_entry(JavaThread*,Thread*) (8181800, 8181800) + 2e
       feaa2ea4 void JavaThread::thread_main_inner() (8181800) + 4c
       feaa2e4d void JavaThread::run() (8181800) + 189
       fec97ba3 java_start (8181800) + d3
       fef6d02f _thr_setup (fc4e0c00) + 4e
       fef6d320 _lwp_start (fc4e0c00, 0, 0, f4283ff8, fef6d320, fc4e0c00)
      ----------------- lwp# 7 / thread# 7 --------------------
       fef6e127 lwp_cond_wait (80786b0, 8078698, 0, 0)
       fec903c9 bool Monitor::wait(bool,long) (8078640, 0, 0) + 2b9
       feab76a6 CompileTask*CompileQueue::get() (817c630) + 3e
       feab74a3 void CompileBroker::compiler_thread_loop() (fedde000, 98, f4231dc8, feaa2ea4, 8182600, 8182600) + 1c7
       feab72d8 void compiler_thread_entry(JavaThread*,Thread*) (8182600, 8182600) + 18
       feaa2ea4 void JavaThread::thread_main_inner() (8182600) + 4c
       feaa2e4d void JavaThread::run() (8182600) + 189
       fec97ba3 java_start (8182600) + d3
       fef6d02f _thr_setup (fc4e1000) + 4e
       fef6d320 _lwp_start (fc4e1000, 0, 0, f4231ff8, fef6d320, fc4e1000)
      ----------------- lwp# 8 / thread# 8 --------------------
       fef6e127 lwp_cond_wait (80774b0, 8077498, 0, 0)
       fec905c8 bool Monitor::wait(bool,long) (8077440, 1, 0) + 4b8
       feaba7a8 void LowMemoryDetector::low_memory_detector_thread_entry(JavaThread*,Thread*) (8183e00, 8183e00) + f0
       feaa2ea4 void JavaThread::thread_main_inner() (8183e00) + 4c
       feaa2e4d void JavaThread::run() (8183e00) + 189
       fec97ba3 java_start (8183e00) + d3
       fef6d02f _thr_setup (fc4e1400) + 4e
       fef6d320 _lwp_start (fc4e1400, 0, 0, f41efff8, fef6d320, fc4e1400)
      ----------------- lwp# 9 / thread# 9 --------------------
       fef6dd57 pollsys (0, 0, f419ddf0, 0)
       fef185ca poll (0, 0, 32) + 52
       fec99917 int os_sleep(long long,bool) (32, 0, 0, 8185200) + 177
       fec99bdf int os::sleep(Thread*,long long,bool) (8185200, 32, 0, 0, feab84ba) + 16f
       feab84cb void WatcherThread::run() (8185200) + bb
       fec97ba3 java_start (8185200) + d3
       fef6d02f _thr_setup (fc4e1800) + 4e
       fef6d320 _lwp_start (fc4e1800, 0, 0, f419dff8, fef6d320, fc4e1800)
      ----------------- lwp# 10 / thread# 10 --------------------
       fece9368 int JavaThread::java_suspend_self() (81a2c00) + 4c
       feaba0a0 void ObjectMonitor::enter(Thread*) (8170188, 81a2c00) + 2d4
       fecded03 void ObjectMonitor::wait(long long,bool,Thread*) (8170188, 1d4c0, 0, 1, 81a2c00) + 45f
       feaa373b void ObjectSynchronizer::wait(Handle,long long,Thread*) (818748c, 1d4c0, 0, 81a2c00, 1a1) + df
       feaa3462 JVM_MonitorWait (81a2ce4, f415bbe8, 1d4c0, 0, f415bb00, 81874d0) + 1fa
       fc609e0a ???????? (0, fc608019, 1d4c0, 0, f44510f8, 1)
       fc602e9d ???????? (0, f44510f8, 81a2c00, 8187488, 1f80, fedde000)
       fc600202 ???????? (f415bc70, f415bec8, a, f858c780, fc609200, f415bdd8)
       fea990f3 void JavaCalls::call_helper(JavaValue*,methodHandle*,JavaCallArguments*,Thread*) (f415bec4, f415bd48, f415bdd4, 81a2c00) + 1a3
       fea98f47 void os::os_exception_wrapper(void(*)(JavaValue*,methodHandle*,JavaCallArguments*,Thread*),JavaValue*,methodHandle*,JavaCallArguments*,Thread*) (fea98f50, f415bec4, f415bd48, f415bdd4, 81a2c00) + 27
       fea98f17 void JavaCalls::call(JavaValue*,methodHandle,JavaCallArguments*,Thread*) (f415bec4, 8187488, f415bdd4, 81a2c00) + 2f
       feaa31b1 void JavaCalls::call_virtual(JavaValue*,KlassHandle,symbolHandle,symbolHandle,JavaCallArguments*,Thread*) (f415bec4, 818747c, fee017c4, fee018a4, f415bdd4, 81a2c00) + c1
       feaa30ea void JavaCalls::call_virtual(JavaValue*,Handle,KlassHandle,symbolHandle,symbolHandle,Thread*) (f415bec4, 8187478, 818747c, fee017c4, fee018a4, 81a2c00) + 7e
       feaa3056 void thread_entry(JavaThread*,Thread*) (81a2c00, 81a2c00) + d2
       feaa2ea4 void JavaThread::thread_main_inner() (81a2c00) + 4c
       feaa2e4d void JavaThread::run() (81a2c00) + 189
       fec97ba3 java_start (81a2c00) + d3
       fef6d02f _thr_setup (fc4e1c00) + 4e
       fef6d320 _lwp_start (fc4e1c00, 0, 0, f415bff8, fef6d320, fc4e1c00)
      ----------------- lwp# 12 / thread# 12 --------------------
       fef6d637 nanosleep (f40b7ae0, f40b7ae8)
       fe724a78 THREAD_sleep (1) + 30
       fe72a812 nsk_jvmti_sleep (3e8, 0) + 5a
       fe72aaf9 nsk_jvmti_waitForSync (1d4c0, 0) + b1
       fe723fa6 agentProc (8075d10, 81c11e4, 0) + 9e
       fe72a17e agentThreadWrapper (8075d10, 81c11e4, 0) + 86
       fec6729b void JvmtiAgentThread::call_start_function() (81c1100) + af
       fec671e3 void JvmtiAgentThread::start_function_wrapper(JavaThread*,Thread*) (81c1100, 81c1100) + 1b
       feaa2ea4 void JavaThread::thread_main_inner() (81c1100) + 4c
       feaa2e4d void JavaThread::run() (81c1100) + 189
       fec97ba3 java_start (81c1100) + d3
       fef6d02f _thr_setup (fc4e2400) + 4e
       fef6d320 _lwp_start (fc4e2400, 0, 0, f40b7ff8, fef6d320, fc4e2400)
      ----------------- lwp# 13 / thread# 13 --------------------
       fef6d637 nanosleep (f4065b58, f4065b60)
       fe7545e8 THREAD_sleep (1) + 30
       fe75a382 nsk_jvmti_sleep (3e8, 0) + 5a
       fe75a669 nsk_jvmti_waitForSync (1d4c0, 0) + b1
       fe753db2 agentProc (8075c20, 81c2ce4, 0) + 2e2
       fe759cee agentThreadWrapper (8075c20, 81c2ce4, 0) + 86
       fec6729b void JvmtiAgentThread::call_start_function() (81c2c00) + af
       fec671e3 void JvmtiAgentThread::start_function_wrapper(JavaThread*,Thread*) (81c2c00, 81c2c00) + 1b
       feaa2ea4 void JavaThread::thread_main_inner() (81c2c00) + 4c
       feaa2e4d void JavaThread::run() (81c2c00) + 189
       fec97ba3 java_start (81c2c00) + d3
       fef6d02f _thr_setup (fc4e2800) + 4e
       fef6d320 _lwp_start (fc4e2800, 0, 0, f4065ff8, fef6d320, fc4e2800)
      ss45998@mho

            Unassigned Unassigned
            sspitsyn Serguei Spitsyn
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved:
              Imported:
              Indexed: