[test] Apply HexFormat to tests for java.security

With the addition of java.util.HexFormat there are many tests using adhoc Hex formatting and printing functions that can be updated to use HexFormat.
Hex conversion functions in a test utility classes can be removed and updated also.