JDK-8029779 showed that tiered compilation can result in a large memory overhead (up to 20%) for storing compiled code. Having multiple code heaps allows setting CodeCacheSegmentSize per code heap. As a result, the memory overhead of storing compiled code can be reduced by setting CodeCacheSegementSize according to the sizes of compiled code that go into a particular heap.