I noticed that some tests are run in our Graal nightlies although the @requires explicitly states:

!vm.graal.enabled

for example:

test/hotspot/jtreg/compiler/intrinsics/bmi/verifycode/AndnTestI.java

Turns out the code in Compiler.isGraalEnabled still checks for:

        // This check might be redundant but let's keep it for now.
        String jvmciCompiler = System.getProperty("jvmci.Compiler");
        if (jvmciCompiler == null || !jvmciCompiler.equals("graal")) {
            return false;
        }

but this property is not set and is null by default.