[macosx] setModalExclusionType does not work properly for Frame and Dialog

Please use the example attached to reproduce the bug and comment/uncomment the code to make Frame/Dialog a parent and check APPLICATION_EXCLUDE/TOOLKIT_EXCLUDE exclusion types.

On Linux and Windows the example behaves as expected: please click "open" buttons until a file dialog appears. After that you can click "test" buttons on child dialog / window or "close all" without closing the file dialog.

On Mac OS X you cannot do that while the file dialog is opened as it blocks the other dialogs.

It seems also that print or page setup dialogs can be used instead of the file dialog with the same result.

Mac OS X version: 10.8.5
JDK version: 9-b09