Don't Run KnownFailure Tests in CTS
Bug 2814482
Don't run tests marked with the KnownFailure annotation, because
they pass/fail randomly across devices making the CTS reports noisy.
The modification in CollectAllTests will throw out known failure
tests for the android.core.* tests. Entries for these known failures
will no longer appear in the testcase repository of xml files.
The change in DescirptionGenerator throws out the known failures in
the CTS tests like android.net.cts.*. These will no longer show up
as well.
You can still use the runtest utility to run known failures, because
those do not consult the XML files to decide what test cases should
be executed. If you need to exclude KnownFailures for runtest, then
you can add a predicate in InstrumentationCtsTestRunner at the bottom
of the file.
Change-Id: Iab3433b2ab57c04f04b85d5cd95310de805482af
2 files changed