Uploaded image for project: 'Code Tools'
  1. Code Tools
  2. CODETOOLS-7904038

Skipped test reporting fails when all tests are skipped

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: P4 P4
    • None
    • None
    • tools
    • None

      The stats.txt file should contain a string describing what files weren't run an for what reasons since https://github.com/openjdk/jtreg/pull/217/files. However, when all the tests to be run end up skipped, the behavior changes, the file only contains "no tests selected". This is is confusing.

      To reproduce:

      $ tree test
      test
      ├── Test2.java
      ├── Test.java
      └── TEST.ROOT
       
      "Test" has @requires (os.family == "windows")
      "Test2" has @requires (os.family != "windows")

      $ java -jar jtreg-7.6+1/jtreg/lib/jtreg.jar test/
      Test results: passed: 1; did not meet platform requirements: 1
      Report written to /tank/lujaniuk/views/make-parsing-jtreg-jdk/JTreport/html/report.html
      Results written to /tank/lujaniuk/views/make-parsing-jtreg-jdk/JTwork

      However, if we let "Test2" have the same require as "Test":

      $ java -jar jtreg-7.6+1/jtreg/lib/jtreg.jar test/
      Test results: no tests selected
      Report written to /tank/lujaniuk/views/make-parsing-jtreg-jdk/JTreport/html/report.html
      Results written to /tank/lujaniuk/views/make-parsing-jtreg-jdk/JTwork

      I would have expected it to print
      Test results: did not meet platform requirements: 2

            Unassigned Unassigned
            lujaniuk Ludvig Janiuk
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: