If there are one file in the catalog was updated and another file was not updated then JavaTest calls scan() method only for updated file. In the same time it doesn't store info about tests from non-updated file. As result tests from non-updated file disappears from tests tree.