A test compiler/ciReplay/TestVM_no_comp_level.sh demonstrates assertion problem. When launching testing with jtreg option: -javaoption:"-XX:TieredStopAtLevel=1" (or =2 or =3) test will fail with assert:

... hotspot/src/share/vm/compiler/compileBroker.cpp:1069), ...
# assert(!TieredCompilation || comp_level <= TieredStopAtLevel) failed: Invalid compilation level

A test creates replay file using incoming options (including TieredStopAtLevel) and then replays it in 2 runs(with -XX:-TieredCompilation and with -XX:+TieredCompilation). Last run triggers assert above.