This is a known problem, and the JDK11+ version of this test changes the Xms and Xmx values to double their usual size when -XX:-UseCompressedOops is detected.

Rather than attempt to port the "-XX:-UseCompressedOops"-detection code functionality and change the test significantly, I propose we change this single line at the top of the test:

 * @run main/othervm -Xms385m TimSortStackSize2 67108864

to this:

 * @run main/othervm -Xms770m -Xmx1540m TimSortStackSize2 67108864

As the latter uses the larger heap values from a -XX:-UseCompressedOops run of jdk11+'s version of the test.