C2 Compiler native memory leak endless "retry class loading during parsing" | OpenJDK 11.0.5

ADDITIONAL SYSTEM INFORMATION :
reproducable under both linux and windows.
# Java VM: OpenJDK 64-Bit Server VM (11.0.5+10, mixed mode, tiered, compressed oops, g1 gc, windows-amd64)

A DESCRIPTION OF THE PROBLEM :
We have a very complex Java Application where large nightly JUNIT test sometimes fail because the JVM overcommits native memory. Normaly the JVM aquires only ~4GB Memory (-Xmx3200M ). But sometimes the JVM starts to grab infinite native memory while the java heap stays nicely limited.
Flight recording with JMC shows a steady growing list of compiler error "retry class loading during parsing" for C2 level 4 compilation. During that time the complier repeats compiling the same method over and over which can be seen in the output of "jcmd Main Thread.print"
Normally the JVM stops normally before an Out Of Memory Error occurs because the the rest of the JVM continues their progress normally. A single method seems to fail to compile in a single compiler thread while the other complier threads keep working normally.


REGRESSION : Last worked in version 8u271

STEPS TO FOLLOW TO REPRODUCE THE PROBLEM :
long running closed source

EXPECTED VERSUS ACTUAL BEHAVIOR :
EXPECTED -
limited native memory allocation
ACTUAL -
Memory consumption of javaw.exe grows infinite until we limit OS memory which results in "Out of Memory Error" and hs_err_pid.log is generated

---------- BEGIN SOURCE ----------
not available
---------- END SOURCE ----------

CUSTOMER SUBMITTED WORKAROUND :
disable C2 with command line parameter -XX:TieredStopAtLevel=1

FREQUENCY : often