Autostart tests function doesn't work when user create new configuration, but don't use template

Run javatest and open quick start wizard.
Select test suite (f ex JCK) and select create new configuration
Go through quick start wizard to last step and check both options (Run configuration editor and Automatically start test run) and click done
Complete interview and click done in configuration editor
Expected result:
Configuration editor should being closed and test run should be started automatically
Actual result:
Test run isn't being started after configuration editor is closed

Note: Test run is being started when user uses existing configuration in quick start wizard