Using both heap and native segments can degrade performance

See attached benchmark.

If we run a simple sum loop benchmark using both a heap and a native segment in the same benchmark, performance degrades. But, when one of them is commented out (including the initialization), the performance of the other is fast again. This also affects the buffer_crazy case, but only one-way (when we have a native segment the buffer_crazy case degrades, but not the other way around)

The common factor between these things seems to be ScopedMemoryAccess. Perhaps some profile pollution occurs there.

As a result, various checks are not hoisted from the loop (perhaps due to Unsafe memory barriers, since the base is not known to be null/non-null)