Currently BinaryClassLoader throws ClassNotFoundExceptiin in the case if annotation in is not in static classpath. So when we loading tck classes we catch ClassNotFound exception if jdk id not included in our classpath. It will be better if annotation will be loaded not during parsing, but during setup/test etc.