http://mail.openjdk.java.net/pipermail/jmh-dev/2014-August/001317.html

Users reasonably expect benchmark failures to show up in the results. So far we only print the human-readable error during the benchmark execution.