autotest: Add tast.informational and tast.must_pass.
Add control files for new tast.informational and
tast.must_pass server tests and remove the existing tast.bvt
test. Both of the new tests run in bvt-perbuild initially.
BUG=chromium:853545
TEST=none
CQ-DEPEND=Ice0d28ad5c27ca019667f5f2baba43c986ec57d9
Change-Id: I3abb61d2999c22ed110d9e6ec1d405333d2051ea
Reviewed-on: https://chromium-review.googlesource.com/1105132
Commit-Ready: Dan Erat <derat@chromium.org>
Tested-by: Dan Erat <derat@chromium.org>
Reviewed-by: Ilja H. Friedel <ihf@chromium.org>
diff --git a/server/site_tests/tast/control.bvt b/server/site_tests/tast/control.informational
similarity index 71%
rename from server/site_tests/tast/control.bvt
rename to server/site_tests/tast/control.informational
index 3f9e77e..1bd593c 100644
--- a/server/site_tests/tast/control.bvt
+++ b/server/site_tests/tast/control.informational
@@ -3,7 +3,7 @@
# found in the LICENSE file.
AUTHOR = 'Chromium OS team'
-NAME = 'tast.bvt'
+NAME = 'tast.informational'
TIME = 'MEDIUM'
TEST_TYPE = 'Server'
ATTRIBUTES = 'suite:bvt-perbuild'
@@ -12,20 +12,21 @@
REQUIRE_SSP = True
DOC = '''
-Run the Tast BVT suite.
+Run the Tast informational test suite.
Tast is an integration-testing framework analagous to the test-running portion
of Autotest. See https://chromium.googlesource.com/chromiumos/platform/tast/ for
more information.
-This test runs Tast-based BVT tests against a remote DUT and reports failure if
-any tests (that haven't been marked flaky) fail.
+This test runs Tast-based informational tests against a remote DUT. It only
+reports failure if the tast process itself (rather than individual Tast tests)
+fails.
'''
def run(machine):
job.run_test('tast',
host=hosts.create_host(machine),
- test_exprs=['(bvt)'],
+ test_exprs=['(informational && !disabled)'],
ignore_test_failures=True)
parallel_simple(run, machines)
diff --git a/server/site_tests/tast/control.bvt b/server/site_tests/tast/control.must_pass
similarity index 63%
copy from server/site_tests/tast/control.bvt
copy to server/site_tests/tast/control.must_pass
index 3f9e77e..6ec0b87 100644
--- a/server/site_tests/tast/control.bvt
+++ b/server/site_tests/tast/control.must_pass
@@ -3,29 +3,30 @@
# found in the LICENSE file.
AUTHOR = 'Chromium OS team'
-NAME = 'tast.bvt'
+NAME = 'tast.must_pass'
TIME = 'MEDIUM'
TEST_TYPE = 'Server'
+# TODO(derat): Move to a blocking suite when ready: https://crbug.com/853545
ATTRIBUTES = 'suite:bvt-perbuild'
# tast.py uses binaries installed from autotest_server_package.tar.bz2.
REQUIRE_SSP = True
DOC = '''
-Run the Tast BVT suite.
+Run the Tast must-pass test suite.
Tast is an integration-testing framework analagous to the test-running portion
of Autotest. See https://chromium.googlesource.com/chromiumos/platform/tast/ for
more information.
-This test runs Tast-based BVT tests against a remote DUT and reports failure if
-any tests (that haven't been marked flaky) fail.
+This test runs Tast-based tests that are required to pass against a remote DUT.
+It fails if any individual Tast tests fail.
'''
def run(machine):
job.run_test('tast',
host=hosts.create_host(machine),
- test_exprs=['(bvt)'],
- ignore_test_failures=True)
+ test_exprs=['(!informational && !disabled)'],
+ ignore_test_failures=False, max_run_sec=1200)
parallel_simple(run, machines)