Uploaded image for project: 'JDK'
  1. JDK
  2. JDK-8202883

crash in the JvmtiExport::post_compiled_method_load

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Duplicate
    • Icon: P3 P3
    • 15
    • 9, 9.0.1, 13
    • hotspot

      A customer reported a crash in the JvmtiExport::post_compiled_method_load():
           https://gist.github.com/nezihyigitbasi/52a58698cc9acfcab21c69d00bd0cef2

      Hi,

      First of all, sorry for bringing up a crash issue in this dev mailing list, but the crash report submission page (https://bugreport.java.com/bugreport/crash.jsp) doesn't list Java 9 in the release drop down, so I couldn't report it there.

      We recently got a crash with Java 9.0.1+11 with an interesting stack ending at "JvmtiExport::post_compiled_method_load()" (entire error file is https://gist.github.com/nezihyigitbasi/52a58698cc9acfcab21c69d00bd0cef2 ). A google search didn't end up with much info, so I just wanted to check with this mailing list to see whether anyone has any ideas to investigate this further.

      Thanks,
      Nezih

      Full list of jvm args that were used in the crash scenario:
      -server
      -Xss2048k
      -XX:MaxMetaspaceSize=4G
      -XX:+PreserveFramePointer
      -XX:-UseBiasedLocking
      -XX:+UnlockExperimentalVMOptions
      -XX:+UseG1GC
      -XX:+ExplicitGCInvokesConcurrent
      -XX:+HeapDumpOnOutOfMemoryError
      -XX:+UseGCOverheadLimit
      -XX:+ExitOnOutOfMemoryError
      -agentpath:/packages/presto.presto/bin/libjvmkill.so
      -agentpath:/packages/presto.presto/bin/libperfagent.so
      -XX:+PrintSafepointStatistics
      -XX:PrintSafepointStatisticsCount=1
      -XX:+UnlockDiagnosticVMOptions
      -XX:+AlwaysPreTouch
      -XX:-OmitStackTraceInFastThrow
      -XX:ReservedCodeCacheSize=512m
      -Djdk.nio.maxCachedBufferSize=30000000
      -Djavax.net.ssl.sessionCacheSize=1024
      -Djdk.attach.allowAttachSelf
      -Xlog:gc*=info,gc+jni=debug,gc+remset=trace,gc+classhisto=trace,safepoint=info:stdout:time,tid,level,tags
      -agentpath:/packages/presto.presto/bin/libastack.so=port=7781
      -XX:MarkStackSize=16M
      -Xms160G
      -Xmx160G
      -XX:G1RSetRegionEntries=5120


      The beginning of the hs_err dump:
      #
      # A fatal error has been detected by the Java Runtime Environment:
      #
      # SIGSEGV (0xb) at pc=0x00007fbdf8700365, pid=349, tid=610
      #
      # JRE version: Java(TM) SE Runtime Environment (9.0+11) (build 9.0.1+11)
      # Java VM: Java HotSpot(TM) 64-Bit Server VM (9.0.1+11, mixed mode, tiered, g1 gc, linux-amd64)
      # Problematic frame:
      # V [libjvm.so+0x99e365] JvmtiExport::post_compiled_method_load(nmethod*)+0x275
      #
      # Core dump will be written. Default location: Core dumps may be processed with "/usr/local/bin/coredumper %p|%P|%s|%t|%c|%i|%I|%u|%g|%h|%E|%e||%d" (or dumping to /data/core.349)
      #
      # If you would like to submit a bug report, please visit:
      # http://bugreport.java.com/bugreport/crash.jsp
      #

      --------------- S U M M A R Y ------------

      Command Line: -Xss2048k -XX:MaxMetaspaceSize=4G -XX:+PreserveFramePointer -XX:-UseBiasedLocking -XX:+UnlockExperimentalVMOptions -XX:+UseG1GC -XX:+ExplicitGCInvokesConcurrent -XX:+HeapDumpOnOutOfMemoryError -XX:+UseGCOverheadLimit -XX:+ExitOnOutOfMemoryError -agentpath:/packages/presto.presto/bin/libjvmkill.so -agentpath:/packages/presto.presto/bin/libperfagent.so -XX:+PrintSafepointStatistics -XX:PrintSafepointStatisticsCount=1 -XX:+UnlockDiagnosticVMOptions -XX:+AlwaysPreTouch -XX:-OmitStackTraceInFastThrow -XX:ReservedCodeCacheSize=1G -Djdk.nio.maxCachedBufferSize=30000000 -Djavax.net.ssl.sessionCacheSize=1024 -Djdk.attach.allowAttachSelf -Xlog:gc*=info,gc+jni=debug,gc+remset=trace,gc+classhisto=trace,safepoint=info:stdout:time,tid,level,tags -agentpath:/packages/presto.presto/bin/libastack.so=port=7781 -XX:G1MaxNewSizePercent=20 -XX:G1HeapRegionSize=32M -Xms180G -Xmx180G -XX:MarkStackSize=256M -XX:MaxGCPauseMillis=500 -XX:GCLockerRetryAllocationCount=5 -XX:G1SummarizeRSetStatsPeriod=100 -XX:MarkStackSizeMax=1G -XX:G1OldCSetRegionThresholdPercent=20 -XX:InitiatingHeapOccupancyPercent=40 -Dnode.data-dir=/data -Dnode.id=presto0559_09_ftw2 -Dnode.environment=ftw2_batch5 -Dnode.location=/ftw2/09/ll/presto0559 -Dlog.levels-file=/data/etc/log.properties -Djava.net.preferIPv6Addresses=true -Dsmc-service-inventory.tier=presto.ftw2_batch5.coordinator.http -Dnode.ip=2401:db00:1120:912a:face:0:1f:0 -Dservice-inventory.uri=http://localhost:7777/v1/smcServiceInventory -Dconfig=/data/etc/config.properties com.facebook.presto.facebook.PrestoFacebook

      Host: Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz, 56 cores, 251G, CentOS Linux release 7.4.1708 (Core)
      Time: Tue May 1 21:34:44 2018 PDT elapsed time: 381347 seconds (4d 9h 55m 47s)

      --------------- T H R E A D ---------------

      Current thread (0x00007fbdf3ba55b0): JavaThread "Service Thread" daemon [_thread_in_vm, id=610, stack(0x00007f8ca3bfe000,0x00007f8ca3dff000)]

      Stack: [0x00007f8ca3bfe000,0x00007f8ca3dff000], sp=0x00007f8ca3dfdbb0, free space=2046k
      Native frames: (J=compiled Java code, A=aot compiled Java code, j=interpreted, Vv=VM code, C=native code)
      V [libjvm.so+0x99e365] JvmtiExport::post_compiled_method_load(nmethod*)+0x275
      V [libjvm.so+0x9a6614] JvmtiDeferredEvent::post()+0x44
      V [libjvm.so+0xc2c507] ServiceThread::service_thread_entry(JavaThread*, Thread*)+0x337
      V [libjvm.so+0xceee58] JavaThread::thread_main_inner()+0xd8
      V [libjvm.so+0xb6de12] thread_native_entry(Thread*)+0xf2
      C [libpthread.so.0+0x7e25] start_thread+0xc5


      siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 0x0000000000000008

      Register to memory mapping:

      RAX=0x00007f8ca3dfdc10 is pointing into the stack for thread: 0x00007fbdf3ba55b0
      RBX=0x00007fbdf3ba55b0 is a thread
      RCX=0x0000000000000001 is an unknown value
      RDX=0x00007f8c90000bd0 is an unknown value
      RSP=0x00007f8ca3dfdbb0 is pointing into the stack for thread: 0x00007fbdf3ba55b0
      RBP=0x00007f8ca3dfdd80 is pointing into the stack for thread: 0x00007fbdf3ba55b0
      RSI=0x00007f8ca3dfdc00 is pointing into the stack for thread: 0x00007fbdf3ba55b0
      RDI=0x00007f8ca3dfdc10 is pointing into the stack for thread: 0x00007fbdf3ba55b0
      R8 =0x00007f83a92596b0 is pointing into metadata
      R9 =0x0000000000000000 is an unknown value
      R10=0x00000000000001fe is an unknown value
      R11=0x0000000000000001 is an unknown value
      R12=0x00007fbdaf2c0190 is at entry_point+-624 in (nmethod*)0x00007fbdaf2c0190
      R13=0x00007f8ca3dfdce0 is pointing into the stack for thread: 0x00007fbdf3ba55b0
      R14=0x0000000000000000 is an unknown value
      R15=0x00007fbdf0010c50 is an unknown value


      Registers:
      RAX=0x00007f8ca3dfdc10, RBX=0x00007fbdf3ba55b0, RCX=0x0000000000000001, RDX=0x00007f8c90000bd0
      RSP=0x00007f8ca3dfdbb0, RBP=0x00007f8ca3dfdd80, RSI=0x00007f8ca3dfdc00, RDI=0x00007f8ca3dfdc10
      R8 =0x00007f83a92596b0, R9 =0x0000000000000000, R10=0x00000000000001fe, R11=0x0000000000000001
      R12=0x00007fbdaf2c0190, R13=0x00007f8ca3dfdce0, R14=0x0000000000000000, R15=0x00007fbdf0010c50
      RIP=0x00007fbdf8700365, EFLAGS=0x0000000000010246, CSGSFS=0x002b000000000033, ERR=0x0000000000000004
        TRAPNO=0x000000000000000e

      Top of Stack: (sp=0x00007f8ca3dfdbb0)
      0x00007f8ca3dfdbb0: 010000000000000e 00007f8ca3dfdcc8
      0x00007f8ca3dfdbc0: 00007f8ca3dfdc90 00007f887849d4b0
      0x00007f8ca3dfdbd0: 00007f8ca3dfdc10 00007f8cb0000a60
      0x00007f8ca3dfdbe0: 00007f8ca3dfdc00 00007f8ca3dfdc50

      Instructions: (pc=0x00007fbdf8700365)
      0x00007fbdf8700345: fe ff ff 4c 89 b5 78 fe ff ff 48 8b 00 48 89 85
      0x00007fbdf8700355: 68 ff ff ff 48 8b b8 60 01 00 00 e8 8b 02 f4 ff
      0x00007fbdf8700365: 49 8b 46 08 4c 89 ee 48 8b 40 08 48 8b 78 18 e8
      0x00007fbdf8700375: 77 86 e7 ff 4c 89 ef 48 89 85 48 fe ff ff e8 b8


      --------------- P R O C E S S ---------------

      Java Threads: ( => current thread )
        0x00007f8b1824ee20 JavaThread "async-http-response-241738" daemon [_thread_in_Java, id=377272, stack(0x00007f8bc33fa000,0x00007f8bc35fb000)]
        0x00007f8b182760b0 JavaThread "async-http-response-241737" daemon [_thread_blocked, id=377271, stack(0x00007f8445379000,0x00007f844557a000)]
        0x00007f8b181e7ee0 JavaThread "async-http-response-241736" daemon [_thread_blocked, id=377270, stack(0x00007f836a9f5000,0x00007f836abf6000)]
        0x00007f8b1809eef0 JavaThread "async-http-response-241735" daemon [_thread_blocked, id=377269, stack(0x00007f86afffa000,0x00007f86b01fb000)]
        0x00007f8b183e1a70 JavaThread "async-http-response-241734" daemon [_thread_in_Java, id=377268, stack(0x00007f834a9f5000,0x00007f834abf6000)]
        0x00007f89501a6100 JavaThread "async-http-response-241733" daemon [_thread_in_Java, id=377267, stack(0x00007f86b1e08000,0x00007f86b2009000)]
        0x00007f8b180737e0 JavaThread "async-http-response-241732" daemon [_thread_in_Java, id=377266, stack(0x00007f83811e9000,0x00007f83813ea000)]
        0x00007fbc640d35f0 JavaThread "async-http-response-241729" daemon [_thread_in_Java, id=377265, stack(0x00007f86431f9000,0x00007f86433fa000)]
        0x00007f8ae04e9520 JavaThread "async-http-response-241728" daemon [_thread_in_Java, id=377264, stack(0x00007f836b9fd000,0x00007f836bbfe000)]
        0x00007fbcbc16e030 JavaThread "async-http-response-241726" daemon [_thread_blocked, id=377263, stack(0x00007f8348de7000,0x00007f8348fe8000)]
        0x00007f8a640f3dc0 JavaThread "async-http-response-241725" daemon [_thread_in_Java, id=377262, stack(0x00007f834a5f3000,0x00007f834a7f4000)]
        0x00007fbd20748350 JavaThread "async-http-response-241724" daemon [_thread_blocked, id=377261, stack(0x00007f83bfdcd000,0x00007f83bffce000)]
        0x00007f8ad83c0850 JavaThread "async-http-response-241723" daemon [_thread_in_Java, id=377260, stack(0x00007f83423f2000,0x00007f83425f3000)]
        0x00007f89641e6210 JavaThread "async-http-response-241722" daemon [_thread_in_Java, id=377259, stack(0x00007f864f5ca000,0x00007f864f7cb000)]
        0x00007fbcd012cdb0 JavaThread "async-http-response-241721" daemon [_thread_blocked, id=377258, stack(0x00007f83737fc000,0x00007f83739fd000)]
        0x00007f8874508bf0 JavaThread "async-http-response-241719" daemon [_thread_in_Java, id=377257, stack(0x00007f834aff8000,0x00007f834b1f9000)]
        0x00007fbcd80912d0 JavaThread "async-http-response-241718" daemon [_thread_in_Java, id=377256, stack(0x00007f83427f4000,0x00007f83429f5000)]
      0x00007f8b24588f90 JavaThread "async-http-response-241716" daemon [_thread_in_Java, id=377255, stack(0x00007f83880e8000,0x00007f83882e9000)]
      . . . .
      Many many more threads in the hs_err dump file.

            sspitsyn Serguei Spitsyn
            sspitsyn Serguei Spitsyn
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

              Created:
              Updated:
              Resolved: