If you run "gradle test" a second time it will not run all of the test. In fact if nothing changed it will run exactly none of the test. This is not desirable. The tests task should never be up to date.