The current behavior is to fail the test due to an IOException:

java.io.IOException: Cannot find the artifact ACVP-Server
at jdk.test.lib.artifacts.ArtifactResolver.fetchOne(ArtifactResolver.java:100)
at Launcher.main(Launcher.java:117)
at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
at java.base/java.lang.reflect.Method.invoke(Method.java:565)
at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:335)
at java.base/java.lang.Thread.run(Thread.java:1474)
Caused by: jdk.test.lib.artifacts.ArtifactResolverException: Couldn't automatically resolve dependency for ACVP-Server
Please specify the location using jdk.test.lib.artifacts.ACVP-Server
at jdk.test.lib.artifacts.DefaultArtifactManager.resolve(DefaultArtifactManager.java:39)
at jdk.test.lib.artifacts.DefaultArtifactManager.resolve(DefaultArtifactManager.java:32)
at jdk.test.lib.artifacts.ArtifactResolver.resolve(ArtifactResolver.java:61)
at jdk.test.lib.artifacts.ArtifactResolver.fetchOne(ArtifactResolver.java:96)
... 5 more

I think the test should be skipped instead.