To illustrate the issue, use javax/swing/JSpinner/5012888 regression test. Just add as a line 39 this one:
spinner1.setComponentOrientation(java.awt.ComponentOrientation.RIGHT_TO_LEFT);
and look for yourself. On OS X (Aqua by default) the number in the first spinner is always LTR aligned.

Reproducible on jdk8b132.