If a test appears two times in a problemlist, only the last list of platforms will take effect. This means a later entry can contradict a previous one. Example:

#ProblemList.txt
Test.java 1234567 generic-all
Test.java 1234567 windows-all

Expectation: Test.java is excluded on all platforms
Becavior: Test.java is runs on e.g. linux.

A simple solution could be to validate problemlist entries and prevent duplicate entries.

Also, it seems this only occurs within one file. If two problemlist files have the same test entry, the order doesn't seem to matter.