Running latest java from jdk10/hs:

specjvm2008$ $JAVA_HOME/bin/java -XX:+UnlockExperimentalVMOptions -XX:+EnableJVMCI -XX:+UseJVMCICompiler -XX:+UseParallelGC -jar SPECjvm2008.jar -ikv -bt 4 -wt 10 -it 5 -i 1 crypto.rsa


  Benchmark: crypto.rsa
  Run mode: timed run
  Test type: multi
  Threads: 4
  Warmup: 10s
  Iterations: 1
  Run length: 5s

Warmup (10s) begins: Tue Jul 25 03:41:22 PDT 2017
Dumping debug output in specjvm2008/dumps/1500979282501
Thread[JVMCI CompilerThread11,9,system]: Compilation of java.math.BigInteger.oddModPow(BigInteger, BigInteger) failed: org.graalvm.compiler.graph.GraalGraphError: Invalid frame state 261|FrameState@-6[INVALID_FRAMESTATE_BCI] associated with a side effect in org.graalvm.compiler.hotspot.replacements.BigIntegerSubstitutions.implMontgomerySquare(int[], int[], int, long, int[]) at a position that cannot be deoptimized to
at parsing platform/jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.hotspot.HotSpotBackend.implMontgomerySquare(HotSpotBackend.java:207) [bci: 12]
at parsing platform/jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.hotspot.replacements.BigIntegerSubstitutions.implMontgomerySquare(BigIntegerSubstitutions.java:77) [bci: 15]
at parsing java.base@10-internal/java.math.BigInteger.montgomerySquare(BigInteger.java:2712) [bci: 45]
at node: 629|Safepoint
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.hotspot.HotSpotDebugInfoBuilder.raiseInvalidFrameStateError(HotSpotDebugInfoBuilder.java:120)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.hotspot.HotSpotDebugInfoBuilder.computeFrameForState(HotSpotDebugInfoBuilder.java:90)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.gen.DebugInfoBuilder.build(DebugInfoBuilder.java:99)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.gen.NodeLIRBuilder.stateForWithExceptionEdge(NodeLIRBuilder.java:727)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.gen.NodeLIRBuilder.stateFor(NodeLIRBuilder.java:719)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.gen.NodeLIRBuilder.state(NodeLIRBuilder.java:708)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.hotspot.amd64.AMD64HotSpotNodeLIRBuilder.visitSafepointNode(AMD64HotSpotNodeLIRBuilder.java:123)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.nodes.SafepointNode.generate(SafepointNode.java:59)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.gen.NodeLIRBuilder.emitNode(NodeLIRBuilder.java:455)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.gen.NodeLIRBuilder.doRoot(NodeLIRBuilder.java:445)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.gen.NodeLIRBuilder.doBlock(NodeLIRBuilder.java:362)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.LIRGenerationPhase.emitBlock(LIRGenerationPhase.java:79)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.LIRGenerationPhase.run(LIRGenerationPhase.java:69)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.LIRGenerationPhase.run(LIRGenerationPhase.java:44)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.lir.phases.LIRPhase.apply(LIRPhase.java:115)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.lir.phases.LIRPhase.apply(LIRPhase.java:107)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.GraalCompiler.emitLIR0(GraalCompiler.java:312)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.GraalCompiler.emitLIR(GraalCompiler.java:276)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.GraalCompiler.emitBackEnd(GraalCompiler.java:256)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.GraalCompiler.compile(GraalCompiler.java:173)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.GraalCompiler.compileGraph(GraalCompiler.java:158)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.hotspot.HotSpotGraalCompiler.compile(HotSpotGraalCompiler.java:180)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.hotspot.CompilationTask$HotSpotCompilationWrapper.performCompilation(CompilationTask.java:168)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.hotspot.CompilationTask$HotSpotCompilationWrapper.performCompilation(CompilationTask.java:93)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.core.CompilationWrapper.run(CompilationWrapper.java:165)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.hotspot.CompilationTask.runCompilation(CompilationTask.java:312)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.hotspot.HotSpotGraalCompiler.compileMethod(HotSpotGraalCompiler.java:142)
at jdk.internal.vm.compiler@10-internal/org.graalvm.compiler.hotspot.HotSpotGraalCompiler.compileMethod(HotSpotGraalCompiler.java:108)
at jdk.internal.vm.ci/jdk.vm.ci.hotspot.HotSpotJVMCIRuntime.compileMethod(HotSpotJVMCIRuntime.java:433)
To disable compilation failure notifications, set CompilationFailureAction to Silent (e.g., -Dgraal.CompilationFailureAction=Silent).
To print a message for a compilation failure without retrying the compilation, set CompilationFailureAction to Print (e.g., -Dgraal.CompilationFailureAction=Print).
Retrying compilation of java.math.BigInteger.oddModPow(BigInteger, BigInteger)