For example:
src/vm/coops/obj16_zerocoops_max03/obj16_zerocoops_max03.cfg

TONGA_EXECUTE=${SHELL} ${TESTBASE}/src/vm/coops/coops_test.sh -oopstype zerocoops -XX:ObjectAlignmentInBytes=16 -XX:HeapBaseMinAddress=32762m -Xmx16390m -XX:CompressedClassSpaceSize=16384m

However, the max value for CompressedClassSpaceSize is 3g.

Running this tests with:
../../ute.aurora/bin/ute -jdk /localhome/java/jdk-9-ea-bin-b26 -testbase /localhome/tests/testbase-JDK9/ -vmopts '-XX:+UseG1GC' -test vm/coops/obj16_zerocoops_max03 -dkfl empty -component vm

gives:
CMD=/localhome/java/jdk-9-ea-bin-b26/bin/java -d64 -server -XX:+UseG1GC -XX:ObjectAlignmentInBytes=16 -XX:HeapBaseMinAddress=32762m -Xmx16390m -XX:CompressedClassSpaceSize=16384m -XX:+UnlockDiagnosticVMOptions -XX:+PrintCompressedOopsMode -version
---------- CMD output ----------
CompressedClassSpaceSize of 17179869184 is invalid; must be between 1048576 and 3221225472
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.
---------- END of CMD output ----------
ERROR: CMD exited with non-zero exit code 1