-
Bug
-
Resolution: Fixed
-
P3
-
1.4.0
-
None
-
beta
-
generic
-
generic
I've been made aware of a small problem that test execution is having with
running regression tests. It seems that there is a possibility for them
to run regression tests against a promoted build which does not contain
the appropriate changes.
I'm going to guess that they grab the current version of
/java/jdk/1.4/ws/MASTER/j2se/test
whenever they want to run tests. They then run those tests against the
latest promoted build. The problem is that unless they copy that directory
the day that the promotion occurs, subsequent integrations may introduce
tests which are guaranteed (and expected) to fail on the promoted build.
What would be really helpful is if a snapshot of the test directory was
taken as part of the promotion. It would then be possible for testing to
run only those regression tests which apply to that promotion.
Such a snapshot may already exist, but I've been unable to locate it. I've
looked in /java/jdk/1.4/promoted/beta/bXXX/ws.
Thanks,
-- iag@eng 2000-07-14
running regression tests. It seems that there is a possibility for them
to run regression tests against a promoted build which does not contain
the appropriate changes.
I'm going to guess that they grab the current version of
/java/jdk/1.4/ws/MASTER/j2se/test
whenever they want to run tests. They then run those tests against the
latest promoted build. The problem is that unless they copy that directory
the day that the promotion occurs, subsequent integrations may introduce
tests which are guaranteed (and expected) to fail on the promoted build.
What would be really helpful is if a snapshot of the test directory was
taken as part of the promotion. It would then be possible for testing to
run only those regression tests which apply to that promotion.
Such a snapshot may already exist, but I've been unable to locate it. I've
looked in /java/jdk/1.4/promoted/beta/bXXX/ws.
Thanks,
-- iag@eng 2000-07-14