Uploaded image for project: 'Code Tools'
  1. Code Tools
  2. CODETOOLS-6764057

Report Converter Tool should ignore NOT_RUN tests when resolving conflict between multiple sources

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • P3
    • jt4.2.1
    • None
    • tools
    • b09
    • x86
    • windows_xp
    • Verified

    Description

      Javatest Harness 4.1.4 (reproducible in earlier versions as well).

      1. Start the tool. Open WD.
      2. Open Report/Create Report. Select "Custom" filter for report. Select a "Test1" that passed and "Test 2" that failed.
      3. Create Javatest XML Report as report1.xml. It will contain Test1=passed + Test2=failed.
      4. Now clear result for "Test 2". Repeat step 2.
      5. Create Javatest XML Report as report2.xml. It will contain Test1=passed + Test2=not_run.
      6. Open Tools/Report Converter. Select report1.xml and report2.xml as sources. Select "Always resolve conflicts using most recent result" on the next page.
      7. Create joint merged_report.xml

      merged_report.xml will contain Test1=passed + Test2=not_run: all taken from report2.xml. It means that "not_run" result overwrote "failed" result for "Test2".

      This is not correct. "Not_run" (meaningless) results should never override "passed", "failed" and "error" (meaningful) results. By "merging" 2 reports together users wants to get a joint result with as many meaningful results as possible.

      Attachments

        Activity

          People

            ersh Mikhail Ershov (Inactive)
            kromanovorcl Konstantin Romanovskiy (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:
              Imported:
              Indexed: