Command :
./jdk1.8.0_152/bin/java -jar ./jtreg.jar -a -verbose:summary -conc:auto -ignore:quiet -timeoutFactor:5 -agentvm -dir:./jdk8u152-b04/hotspot/test -w:./hotspot -r:./hotspot gc/class_unloading/TestCMSClassUnloadingEnabledHWM.java

or [For group run]
./jdk1.8.0_152/bin/java -jar ./jtreg.jar -a -verbose:summary -conc:auto -ignore:quiet -timeoutFactor:5 -agentvm -dir:./jdk8u152-b04/hotspot/test -w:./hotspot -r:./hotspot .

Failing test cases:
compiler/jsr292/PollutedTrapCounts.java
compiler/jsr292/RedefineMethodUsedByMultipleMethodHandles.java
compiler/loopopts/UseCountedLoopSafepoints.java
compiler/types/correctness/OffTest.java
gc/TestVerifySilently.java
gc/TestVerifySubSet.java
gc/class_unloading/TestCMSClassUnloadingEnabledHWM.java
gc/class_unloading/TestG1ClassUnloadingHWM.java
gc/ergonomics/TestDynamicNumberOfGCThreads.java
gc/g1/TestEagerReclaimHumongousRegions.java
gc/g1/TestEagerReclaimHumongousRegionsClearMarkBits.java
gc/g1/TestEagerReclaimHumongousRegionsWithRefs.java
gc/g1/TestG1TraceEagerReclaimHumongousObjects.java
gc/g1/TestGCLogMessages.java
gc/g1/TestHumongousAllocInitialMark.java
gc/g1/TestPrintGCDetails.java
gc/g1/TestPrintRegionRememberedSetInfo.java
gc/g1/TestShrinkAuxiliaryData00.java
gc/g1/TestShrinkAuxiliaryData05.java
gc/g1/TestShrinkAuxiliaryData10.java
gc/g1/TestShrinkAuxiliaryData15.java
gc/g1/TestShrinkAuxiliaryData20.java
gc/g1/TestShrinkDefragmentedHeap.java
gc/g1/TestStringDeduplicationAgeThreshold.java
gc/g1/TestStringDeduplicationFullGC.java
gc/g1/TestStringDeduplicationInterned.java
gc/g1/TestStringDeduplicationPrintOptions.java
gc/g1/TestStringDeduplicationTableRehash.java
gc/g1/TestStringDeduplicationTableResize.java
gc/g1/TestStringDeduplicationYoungGC.java
gc/g1/TestStringSymbolTableStats.java
gc/logging/TestGCId.java
gc/whitebox/TestWBGC.java
runtime/ErrorHandling/TestOnOutOfMemoryError.java
runtime/NMT/JcmdWithNMTDisabled.java
runtime/memory/ReserveMemory.java
runtime/os/AvailableProcessors.java
serviceability/attach/AttachWithStalePidFile.java
serviceability/jvmti/TestRedefineWithUnresolvedClass.java

All are passing whenever run with -othervm

Failure reason: not able to load main class or inner class in the corresponding test case.
Sample error message :stderr: [Error: Could not find or load main class TestShrinkAuxiliaryData$ShrinkAuxiliaryDataTest
Issue is not there in JDK9