blob: f1f56f86e732a0a88f6606d08d9a053f8a56971c [file] [log] [blame]
Alex Miller4a163282013-01-15 18:18:54 -08001# When changing this file, you can (and should) validate your changes by
2# running |./site_utils/suite_scheduler/suite_scheduler.py --sanity|
3#
4# When adding tests to a suite, if one (or more) of the tests contains
5# DEPENDENCIES, then the number of different host specifications required
6# can increase. This means that the number of physical machines the suite
7# must ask for increases, as if a suite needs two different machines, and
8# only asks for one, then there's going to be some set of tests that can't
9# run. The sanity check will describe to you what suites to set at what
10# number of machines to make sure all suites can run.
Alex Millerbf34a3a2012-10-24 15:06:17 -070011
Scott Zawalskica6c65a2012-05-02 13:53:13 -040012#[nightly_params]
13#always_handle: True
14
Scott Zawalskiabb097b2012-05-22 17:36:35 -040015[WeeklyKernelRegressions]
16run_on: weekly
17suite: kernel_weekly_regression
18branch_specs: >=R21
19pool: suites
beepsc2efbdc2013-04-19 12:41:58 -070020num: 2
Scott Zawalskiabb097b2012-05-22 17:36:35 -040021
Scott Zawalski8fb0af92012-07-11 20:24:11 -040022[WeeklyPowerRequirements]
Scott Zawalskiabb097b2012-05-22 17:36:35 -040023run_on: weekly
Scott Zawalski8fb0af92012-07-11 20:24:11 -040024suite: power_requirements
Chris Sosa62c832a2012-07-30 09:28:47 -070025branch_specs: >=R22
Alex Miller6025d482014-04-11 12:27:05 -070026pool: suites
Scott Zawalskiabb097b2012-05-22 17:36:35 -040027
Mike Truty653d96d2013-03-01 14:03:14 -060028[WeeklyVideoRegressions]
29run_on: weekly
30suite: video_weekly_regression
31branch_specs: >=R27
32pool: suites
Owen Lin9dc375b2013-04-15 12:04:10 +080033num: 2
Mike Truty653d96d2013-03-01 14:03:14 -060034
Juan Casse429d2752013-08-05 14:49:43 -070035[WeeklyStoraqequal]
36run_on: weekly
37suite: storagequal
Fang Dengb5680ad2013-10-17 14:41:29 -070038branch_specs: >=R31
Juan Casse429d2752013-08-05 14:49:43 -070039pool: suites
40
Scott Zawalskica6c65a2012-05-02 13:53:13 -040041[NightlyGraphics]
42run_on: nightly
43suite: graphics
Scott Zawalskiabb097b2012-05-22 17:36:35 -040044branch_specs: >=R21
45pool: suites
46
Ilja Friedel21c4eb32013-03-27 11:56:29 -070047[PerBuildGraphics]
Alex Miller41f91b22014-05-14 17:21:58 -070048run_on: nightly
Ilja Friedel21c4eb32013-03-27 11:56:29 -070049suite: graphics_per-build
Alex Miller39516202013-04-04 10:12:49 -070050branch_specs: >=R28
Ilja Friedel21c4eb32013-03-27 11:56:29 -070051pool: suites
52
53[GraphicsGLES]
54run_on: nightly
Ilja H. Friedel54547492012-07-11 12:58:03 -070055suite: graphicsGLES
56branch_specs: >=R22
Chris Sosacfcf5cd2012-07-25 14:11:36 -070057pool: snow
Ilja H. Friedel54547492012-07-11 12:58:03 -070058
Chris Masone7d6af682013-08-06 13:47:44 -070059[GpuHang]
Alex Miller41f91b22014-05-14 17:21:58 -070060run_on: nightly
Chris Masone7d6af682013-08-06 13:47:44 -070061suite: gpu_hang
J. Richard Barnette52b0cb32013-08-15 08:58:44 -070062branch_specs: >=R31
Chris Masone7d6af682013-08-06 13:47:44 -070063pool: suites
64
Tom Wai-Hong Tam84663c42014-04-18 15:49:33 +080065[Chameleon]
Alex Miller41f91b22014-05-14 17:21:58 -070066run_on: nightly
Tom Wai-Hong Tam84663c42014-04-18 15:49:33 +080067suite: chameleon
68branch_specs: >=R36
69pool: suites
70
Scott Zawalskiabb097b2012-05-22 17:36:35 -040071[NightlyHwQual]
72run_on: nightly
73suite: hwqual
74branch_specs: >=R21
75pool: suites
Alex Miller4a163282013-01-15 18:18:54 -080076num: 3
Scott Zawalskiabb097b2012-05-22 17:36:35 -040077
78[KernelDailyRegression]
79run_on: nightly
80suite: kernel_daily_regression
Scott Zawalskib315ac82012-05-29 20:52:43 -040081branch_specs: >=R21
Scott Zawalskiabb097b2012-05-22 17:36:35 -040082pool: suites
Alex Miller11a7bed2013-01-03 18:00:39 -080083num: 2
Scott Zawalskiabb097b2012-05-22 17:36:35 -040084
Scott Zawalski93802262012-12-11 14:37:00 -050085[KernelDailyBenchmarks]
Scott Zawalskiabb097b2012-05-22 17:36:35 -040086run_on: nightly
87suite: kernel_daily_benchmarks
Scott Zawalskib315ac82012-05-29 20:52:43 -040088branch_specs: >=R21
Scott Zawalskica6c65a2012-05-02 13:53:13 -040089pool: suites
Prashanth B6de2bde2014-03-25 18:45:02 -070090file_bugs: True
Scott Zawalskica6c65a2012-05-02 13:53:13 -040091
92[KernelPerBuildRegression]
Alex Miller41f91b22014-05-14 17:21:58 -070093run_on: nightly
Scott Zawalskiabb097b2012-05-22 17:36:35 -040094suite: kernel_per-build_regression
Scott Zawalskib315ac82012-05-29 20:52:43 -040095branch_specs: >=R21
Scott Zawalskica6c65a2012-05-02 13:53:13 -040096pool: suites
beeps79526db2013-01-11 16:28:49 -080097num: 2
Scott Zawalskica6c65a2012-05-02 13:53:13 -040098
99[KernelPerBuildBenchmarks]
Alex Miller41f91b22014-05-14 17:21:58 -0700100run_on: nightly
Scott Zawalskiabb097b2012-05-22 17:36:35 -0400101suite: kernel_per-build_benchmarks
Scott Zawalskib315ac82012-05-29 20:52:43 -0400102branch_specs: >=R21
Scott Zawalskica6c65a2012-05-02 13:53:13 -0400103pool: suites
104
105[NightlyRegression]
106run_on: nightly
107suite: regression
Scott Zawalskib315ac82012-05-29 20:52:43 -0400108branch_specs: >=R21
Scott Zawalskica6c65a2012-05-02 13:53:13 -0400109pool: suites
Alex Miller096baf52013-01-04 13:51:33 -0800110num: 2
Scott Zawalskica6c65a2012-05-02 13:53:13 -0400111
J. Richard Barnettec49fc882014-04-28 16:37:02 -0700112[ExperimentalTests]
113run_on: nightly
114suite: experimental
Dan Shiacdbec82014-05-02 23:37:09 -0700115branch_specs: >=R36
J. Richard Barnettec49fc882014-04-28 16:37:02 -0700116pool: suites
117
Alex Millerb091f4d2013-11-26 15:58:24 -0800118[JailedBuild]
Alex Miller41f91b22014-05-14 17:21:58 -0700119run_on: nightly
Alex Millerb091f4d2013-11-26 15:58:24 -0800120suite: jailed_build
121branch_specs: >=R31
122pool: jail
123
124[JailedNightly]
125run_on: nightly
126suite: jailed_daily
127branch_specs: >=R31
128pool: jail
129
130[JailedWeekly]
131run_on: weekly
132suite: jailed_weekly
133branch_specs: >=R31
134pool: jail
135
Thieu Le3cde1cf2012-10-24 14:04:05 -0700136[Network3g]
Scott Zawalskica6c65a2012-05-02 13:53:13 -0400137run_on: nightly
138suite: network3g
Scott Zawalski44509262012-11-01 16:11:46 +0000139branch_specs: >=R25
Alex Miller02a5def2012-10-31 14:49:38 -0700140pool: cellular
Ben Chanc7cd1452013-08-15 00:33:59 -0700141num: 7
Aviv Keshetcc623f72013-01-14 14:39:09 -0800142
Ben Chand157e932014-04-22 14:57:22 -0700143[Network3g_att]
144run_on: nightly
145suite: network3g_att
146branch_specs: >=R36
147pool: cellular
148
Aviv Keshetcc623f72013-01-14 14:39:09 -0800149[Network3g_tmobile]
150run_on: nightly
151suite: network3g_tmobile
152branch_specs: >=R28
153pool: cellular
Aviv Keshet80e6bb42013-03-28 09:20:08 -0700154num: 4
Aviv Keshetcc623f72013-01-14 14:39:09 -0800155
156[Network3g_verizon]
157run_on: nightly
158suite: network3g_verizon
159branch_specs: >=R28
160pool: cellular
161num: 2
Alex Miller725e4952012-10-25 15:44:34 -0700162
Arman Uguraye5d5a5d2013-05-09 15:15:27 -0700163[Network3g_pseudomodem]
Alex Miller41f91b22014-05-14 17:21:58 -0700164run_on: nightly
Arman Uguraye5d5a5d2013-05-09 15:15:27 -0700165suite: network3g_pseudomodem
J. Richard Barnettec3af7252013-05-16 11:17:04 -0700166branch_specs: >=R29
Arman Uguraye5d5a5d2013-05-09 15:15:27 -0700167pool: suites
168
harpreet8036c0e2014-03-11 18:18:51 -0700169[Cellular_modem_repair]
Alex Miller41f91b22014-05-14 17:21:58 -0700170run_on: nightly
harpreet8036c0e2014-03-11 18:18:51 -0700171suite: cellular_modem_repair
172branch_specs: >=R35
harpreet5e7ef1d2014-03-21 15:58:42 -0700173pool: cellular_repair
harpreet8036c0e2014-03-11 18:18:51 -0700174
Arman Ugurayf02cd532013-07-26 12:36:05 -0700175[NetworkUI]
Alex Miller41f91b22014-05-14 17:21:58 -0700176run_on: nightly
Arman Ugurayf02cd532013-07-26 12:36:05 -0700177suite: network_ui
178branch_specs: >=R30
179pool: suites
180
Scott Zawalskid76f1592012-05-21 13:13:22 -0400181[PowerDaily]
182run_on: nightly
183suite: power_daily
Scott Zawalskib315ac82012-05-29 20:52:43 -0400184branch_specs: >=R21
Alex Miller6025d482014-04-11 12:27:05 -0700185pool: suites
Derek Basehore970c95e2014-05-21 11:00:59 -0700186file_bugs: True
Scott Zawalskid76f1592012-05-21 13:13:22 -0400187
Scott Zawalskica6c65a2012-05-02 13:53:13 -0400188[Perfalerts]
189# Not a part of perf build because it requires 3 machines.
Alex Miller41f91b22014-05-14 17:21:58 -0700190run_on: nightly
Scott Zawalskica6c65a2012-05-02 13:53:13 -0400191suite: perfalerts
Scott Zawalskib315ac82012-05-29 20:52:43 -0400192branch_specs: >=R21
Scott Zawalskica6c65a2012-05-02 13:53:13 -0400193pool: suites
Scott Zawalskibce74092012-11-06 12:52:10 -0500194num: 1
Scott Zawalskica6c65a2012-05-02 13:53:13 -0400195
Scott Zawalski6c045362012-05-16 19:17:10 -0400196[SecuritySuite]
Alex Miller41f91b22014-05-14 17:21:58 -0700197run_on: nightly
Scott Zawalski6c045362012-05-16 19:17:10 -0400198suite: security
Scott Zawalskib315ac82012-05-29 20:52:43 -0400199branch_specs: >=R21
Scott Zawalski6c045362012-05-16 19:17:10 -0400200pool: suites
Scott Zawalskica6c65a2012-05-02 13:53:13 -0400201
Scott Zawalski6c045362012-05-16 19:17:10 -0400202[Power_build]
Alex Miller41f91b22014-05-14 17:21:58 -0700203run_on: nightly
Scott Zawalskid76f1592012-05-21 13:13:22 -0400204suite: power_build
Scott Zawalskib315ac82012-05-29 20:52:43 -0400205branch_specs: >=R21
Alex Miller6025d482014-04-11 12:27:05 -0700206pool: suites
Scott Zawalskica6c65a2012-05-02 13:53:13 -0400207
Scott Zawalskid76f1592012-05-21 13:13:22 -0400208[pagecycler]
Alex Miller41f91b22014-05-14 17:21:58 -0700209run_on: nightly
Scott Zawalskid76f1592012-05-21 13:13:22 -0400210suite: pagecycler
Scott Zawalskib315ac82012-05-29 20:52:43 -0400211branch_specs: >=R21
Scott Zawalskid76f1592012-05-21 13:13:22 -0400212pool: suites
213
214[audio]
Alex Miller41f91b22014-05-14 17:21:58 -0700215run_on: nightly
Scott Zawalskid76f1592012-05-21 13:13:22 -0400216suite: audio
Scott Zawalskib315ac82012-05-29 20:52:43 -0400217branch_specs: >=R21
Scott Zawalskid76f1592012-05-21 13:13:22 -0400218pool: suites
219
Rohit Makasana6ae944d2013-01-17 16:21:14 -0800220[video]
Alex Miller41f91b22014-05-14 17:21:58 -0700221run_on: nightly
Rohit Makasana6ae944d2013-01-17 16:21:14 -0800222suite: video
Scott Zawalskid3df3482013-01-23 09:48:28 -0500223branch_specs: >=R26
Rohit Makasana6ae944d2013-01-17 16:21:14 -0800224pool: suites
Yuli Huang218e8522013-03-27 17:25:57 +0800225num: 4
Rohit Makasana6ae944d2013-01-17 16:21:14 -0800226
Rohit Makasana72467d92013-08-22 01:08:49 +0530227[youtube_mse_eme]
Alex Miller41f91b22014-05-14 17:21:58 -0700228run_on: nightly
Rohit Makasana72467d92013-08-22 01:08:49 +0530229suite: youtube_mse_eme
230branch_specs: >=R30
231pool: suites
232
233[youtube_page]
Alex Miller41f91b22014-05-14 17:21:58 -0700234run_on: nightly
Rohit Makasana72467d92013-08-22 01:08:49 +0530235suite: youtube_page
236branch_specs: >=R30
237pool: suites
238
Scott Zawalskib88e86d2013-01-23 09:58:48 -0500239[WebRTC]
240run_on: nightly
Scott Zawalskia5bed3e2013-01-25 10:00:27 -0500241suite: webrtc
Scott Zawalskib88e86d2013-01-23 09:58:48 -0500242branch_specs: >=R26
243pool: suites
244
John Dung Hong2eb4d992012-08-08 13:05:53 -0700245# run only and post-ALEX platforms (so do not run mario, zgb, and alex)
246[VDA]
Alex Miller41f91b22014-05-14 17:21:58 -0700247run_on: nightly
John Dung Hong6d8c4362012-08-12 13:26:10 -0700248suite: vda
John Dung Hong2eb4d992012-08-08 13:05:53 -0700249branch_specs: >=R23
John Dung Hong6d8c4362012-08-12 13:26:10 -0700250pool: vda
Owen Lin9dc375b2013-04-15 12:04:10 +0800251num: 2
John Dung Hong2eb4d992012-08-08 13:05:53 -0700252
Scott Zawalski0dda4102012-11-14 11:30:53 -0500253[LinkPerf]
Alex Miller41f91b22014-05-14 17:21:58 -0700254run_on: nightly
Scott Zawalski0dda4102012-11-14 11:30:53 -0500255suite: link_perf
256branch_specs: >=R23
257pool: link_perf
258
Vadim Bendebury75259502013-01-22 22:43:47 -0800259[FirmwarePerBuildRegression_ec]
Alex Miller41f91b22014-05-14 17:21:58 -0700260run_on: nightly
Vadim Bendebury75259502013-01-22 22:43:47 -0800261suite: faft_ec
Vadim Bendebury49462622013-02-04 14:18:22 -0800262pool: faft-ec
Vadim Bendeburya1a23122013-01-08 18:58:19 -0800263branch_specs: >=R26
264
Simran Basi77917712013-10-03 18:56:13 +0000265[perf_v2]
Alex Miller41f91b22014-05-14 17:21:58 -0700266run_on: nightly
Simran Basi77917712013-10-03 18:56:13 +0000267suite: perf_v2
268branch_specs: >=R27
269pool: suites
mukesh agrawal73850c92013-05-10 16:41:35 -0700270
271[NetworkNightly]
272run_on: nightly
273suite: network_nightly
274branch_specs: >=R29
275pool: suites
bmahadev328472a2014-04-08 16:56:20 -0700276file_bugs: True
Christopher Wileyc7d4e042013-05-13 17:24:47 -0700277
278[WiFi_MatFuncDaily]
279run_on: nightly
280suite: wifi_matfunc
281branch_specs: >=R29
282pool: wificell
Christopher Wileyd56a1052013-05-31 10:30:05 -0700283
Kris Rambisha506fd52014-04-08 15:18:16 -0700284[WiFi_MatFuncDaily_Preflight]
285run_on: nightly
286suite: wifi_matfunc
287branch_specs: >=R36
288pool: wificell_preflight
289
Christopher Wileyc1e9b662014-01-16 16:13:43 -0800290[WiFi_Perf]
291run_on: nightly
292suite: wifi_perf
Christopher Wiley5b7c5762014-01-21 10:01:51 -0800293branch_specs: >=R34
Christopher Wileyc1e9b662014-01-16 16:13:43 -0800294pool: wificell
295
Christopher Wileyc53fc832014-02-07 16:09:25 -0800296[WiFi_Attenuated_Performance]
297run_on: nightly
298suite: wifi_atten_perf
299branch_specs: >=R34
Christopher Wileyf804f782014-03-11 15:27:32 -0700300pool: groamer
Christopher Wileyc53fc832014-02-07 16:09:25 -0800301
Jason Abeleef3520e2013-11-20 12:27:27 -0800302[WiFi_InteropWeekly]
303run_on: weekly
304suite: wifi_interop
305branch_specs: >=R34
306pool: wifiinterop
307
Ben Chana1206f72013-12-17 23:56:04 -0800308[WiMAX]
309run_on: nightly
310suite: wimax
311branch_specs: >=R33
312pool: wimax
313
Kees Cook61817be2013-07-30 13:27:04 -0700314[SecurityWeekly]
315run_on: weekly
316suite: security_weekly
317branch_specs: >=R30
318pool: suites
Scott James Remnant85593072014-02-25 17:43:16 -0800319
320[Bluetooth_Qualification]
321run_on: nightly
322suite: bluetooth_qualification
323branch_specs: >=R34
324pool: wificell
325
326[Bluetooth_Sanity]
327run_on: nightly
328suite: bluetooth_sanity
329branch_specs: >=R34
330pool: wificell
331
Yusuf Mohsinally185cc412014-05-08 15:01:39 -0700332[NightlyStress]
333run_on: nightly
334suite: stress
335branch_specs: >=R36
336pool: stress
Alex Miller5d290cc2014-06-16 13:33:31 -0700337
338[Gizmo]
339run_on: nightly
340suite: bvt
341branch_specs: >=R37
342pool: gizmo
343
344[Duck]
345run_on: nightly
346suite: bvt
347branch_specs: >=R37
348pool: duck
mussa7a1d45a2014-06-17 10:42:17 -0700349
350[ui]
351run_on: nightly
352suite: ui
353branch_specs: >=R37
354pool: suites