Start to fix up existing kernel suites to use new SUITE tag.
Tests in this are expected to be longer running than bvt
and/or buckets of many tests for which the results will
require a longer turnaround to triage and improve.
Test failures in these suites will not close the tree
(at this time) so they have EXPERIMENTAL=True.
Also added first two dynamic suite definition files
for kernel.
BUG=chromium-os:22487
TEST=local test with run_remote_tests.
Change-Id: I3ac0a4e79f4245c2c75bc08a7db33344acd1a280
Reviewed-on: https://gerrit.chromium.org/gerrit/18469
Reviewed-by: Scott Zawalski <scottz@chromium.org>
Tested-by: Mike Truty <truty@chromium.org>
Commit-Ready: Mike Truty <truty@chromium.org>
diff --git a/test_suites/control.kernel.per_build.benchmarks b/test_suites/control.kernel.per_build.benchmarks
new file mode 100755
index 0000000..12b52ac
--- /dev/null
+++ b/test_suites/control.kernel.per_build.benchmarks
@@ -0,0 +1,37 @@
+# Copyright (c) 2012 The Chromium OS Authors. All rights reserved.
+# Use of this source code is governed by a BSD-style license that can be
+# found in the LICENSE file.
+
+AUTHOR = "Chrome OS Team"
+NAME = "kernel.per_build.benchmarks"
+PURPOSE = "Gather benchmark/performance data for kernel evaluation."
+CRITERIA = "All tests with SUITE=kernel.per_build.benchmarks must pass."
+
+TIME = "SHORT"
+TEST_CATEGORY = "General"
+TEST_CLASS = "suite"
+TEST_TYPE = "Server"
+
+DOC = """
+This is the Kernel Per-Build Benchmarks Test suite. Failures in this test
+suite should not close the tree. It should consist of SHORT tests that gather
+data for long-term kernel performance evaluation. It runs on every build so
+it should consist of SHORT tests. Longer running benchmarks should be added
+to kernel.daily.benchmarks or kernel.weekly.benchmarks.
+
+@param build: The name of the image to test.
+ Ex: x86-mario-release/R17-1412.33.0-a1-b29
+@param board: The board to test on. Ex: x86-mario
+@param pool: The pool of machines to utilize for scheduling. If pool=None
+ board is used.
+@param check_hosts: require appropriate live hosts to exist in the lab.
+@param SKIP_IMAGE: (optional) If present and True, don't re-image devices.
+"""
+
+import common
+from autotest_lib.server.cros import dynamic_suite
+
+dynamic_suite.reimage_and_run(
+ build=build, board=board, name='kernel.per_build.benchmarks', job=job,
+ pool=pool, check_hosts=check_hosts, add_experimental=True,
+ skip_reimage=dynamic_suite.skip_reimage(globals()))