blob: 7e8d5b9584f377d9910d43b837e3c8740a687370 [file] [log] [blame]
yangguo@chromium.orgab30bb82012-02-24 14:41:46 +00001# Copyright 2012 the V8 project authors. All rights reserved.
mads.s.ager@gmail.com9a4089a2008-09-01 08:55:01 +00002# Redistribution and use in source and binary forms, with or without
3# modification, are permitted provided that the following conditions are
4# met:
5#
6# * Redistributions of source code must retain the above copyright
7# notice, this list of conditions and the following disclaimer.
8# * Redistributions in binary form must reproduce the above
9# copyright notice, this list of conditions and the following
10# disclaimer in the documentation and/or other materials provided
11# with the distribution.
12# * Neither the name of Google Inc. nor the names of its
13# contributors may be used to endorse or promote products derived
14# from this software without specific prior written permission.
15#
16# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
17# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
18# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
19# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
20# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
21# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
22# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
23# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
24# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
26# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
27
28prefix mjsunit
29
30# All tests in the bug directory are expected to fail.
mmassi@chromium.org7028c052012-06-13 11:51:58 +000031bugs/*: FAIL
mads.s.ager@gmail.com9a4089a2008-09-01 08:55:01 +000032
kasperl@chromium.orga5551262010-12-07 12:49:48 +000033##############################################################################
ricow@chromium.org4f693d62011-07-04 14:01:31 +000034# Fails.
35regress/regress-1119: FAIL
36
mmassi@chromium.org7028c052012-06-13 11:51:58 +000037# Issue 1719: Slow to collect arrays over several contexts.
erik.corry@gmail.comc3b670f2011-10-05 21:44:48 +000038regress/regress-524: SKIP
mmassi@chromium.org7028c052012-06-13 11:51:58 +000039# When that bug is fixed, revert the expectation to:
40# Skip long running test in debug and allow it to timeout in release mode.
41# regress/regress-524: (PASS || TIMEOUT), SKIP if $mode == debug
erik.corry@gmail.comc3b670f2011-10-05 21:44:48 +000042
ulan@chromium.org906e2fb2013-05-14 08:14:38 +000043# This test non-deterministically runs out of memory on Windows ia32.
44regress/regress-crbug-160010: SKIP
45
yangguo@chromium.org46a2a512013-01-18 16:29:40 +000046# Deferred stack trace formatting is temporarily disabled.
47stack-traces-gc: PASS || FAIL
48
erik.corry@gmail.comc3b670f2011-10-05 21:44:48 +000049##############################################################################
mstarzinger@chromium.orge27d6172013-04-17 11:51:44 +000050# Too slow in debug mode with --stress-opt mode.
kasperl@chromium.orga5551262010-12-07 12:49:48 +000051compiler/regress-stacktrace-methods: PASS, SKIP if $mode == debug
ager@chromium.org5f0c45f2010-12-17 08:51:21 +000052compiler/regress-funcaller: PASS, SKIP if $mode == debug
danno@chromium.org72204d52012-10-31 10:02:10 +000053regress/regress-2318: PASS, SKIP if $mode == debug
ager@chromium.org5f0c45f2010-12-17 08:51:21 +000054regress/regress-create-exception: PASS, SKIP if $mode == debug
mstarzinger@chromium.orge27d6172013-04-17 11:51:44 +000055regress/regress-2612: PASS, SKIP if $mode == debug
56
57##############################################################################
58# Too slow in debug mode for GC stress mode.
59regress/regress-crbug-217858: PASS, SKIP if $mode == debug
kasperl@chromium.orga5551262010-12-07 12:49:48 +000060
61##############################################################################
verwaest@chromium.org33e09c82012-10-10 17:07:22 +000062# These use a built-in that's only present in debug mode. They take
ricow@chromium.org64e3a4b2011-12-13 08:07:27 +000063# too long to run in debug mode on ARM and MIPS.
verwaest@chromium.org33e09c82012-10-10 17:07:22 +000064fuzz-natives-part*: PASS, SKIP if ($mode == release || $arch == arm || $arch == android_arm || $arch == mipsel)
ager@chromium.orgc27e4e72008-09-04 13:52:27 +000065
yangguo@chromium.org304cc332012-07-24 07:59:48 +000066big-object-literal: PASS, SKIP if ($arch == arm || $arch == android_arm)
ager@chromium.orgbb29dc92009-03-24 13:25:23 +000067
ager@chromium.org3811b432009-10-28 14:53:37 +000068# Issue 488: this test sometimes times out.
69array-constructor: PASS || TIMEOUT
70
ricow@chromium.org64e3a4b2011-12-13 08:07:27 +000071# Very slow on ARM and MIPS, contains no architecture dependent code.
yangguo@chromium.org304cc332012-07-24 07:59:48 +000072unicode-case-overoptimization: PASS, TIMEOUT if ($arch == arm || $arch == android_arm || $arch == mipsel)
ager@chromium.orgc4c92722009-11-18 14:12:51 +000073
kasperl@chromium.orga5551262010-12-07 12:49:48 +000074##############################################################################
danno@chromium.org72204d52012-10-31 10:02:10 +000075# This test expects to reach a certain recursion depth, which may not work
76# for debug mode.
77json-recursive: PASS, (PASS || FAIL) if $mode == debug
78
79##############################################################################
ulan@chromium.org906e2fb2013-05-14 08:14:38 +000080# Skip long running tests that time out in debug mode.
danno@chromium.org94b0d6f2013-02-04 13:33:20 +000081generated-transition-stub: PASS, SKIP if $mode == debug
mvstanton@chromium.orge4ac3ef2012-11-12 14:53:34 +000082
83##############################################################################
yangguo@chromium.org78d1ad42012-02-09 13:53:47 +000084# This test sets the umask on a per-process basis and hence cannot be
85# used in multi-threaded runs.
mstarzinger@chromium.orgc6d9cee2012-07-03 10:03:19 +000086# On android there is no /tmp directory.
yangguo@chromium.org304cc332012-07-24 07:59:48 +000087d8-os: PASS, SKIP if ($isolates || $arch == android_arm || $arch == android_ia32)
88tools/tickprocessor: PASS, SKIP if ($arch == android_arm || $arch == android_ia32)
yangguo@chromium.org78d1ad42012-02-09 13:53:47 +000089
90##############################################################################
yangguo@chromium.org003650e2013-01-24 16:31:08 +000091# Long running test that reproduces memory leak and should be run manually.
92regress/regress-2073: SKIP
93
94##############################################################################
yangguo@chromium.org304cc332012-07-24 07:59:48 +000095[ $arch == arm || $arch == android_arm ]
ager@chromium.orgc27e4e72008-09-04 13:52:27 +000096
ager@chromium.org7c537e22008-10-16 08:43:32 +000097# Slow tests which times out in debug mode.
kasperl@chromium.org41044eb2008-10-06 08:24:46 +000098try: PASS, SKIP if $mode == debug
ager@chromium.org7c537e22008-10-16 08:43:32 +000099debug-scripts-request: PASS, SKIP if $mode == debug
christian.plesner.hansen@gmail.com2bc58ef2009-09-22 10:00:30 +0000100array-constructor: PASS, SKIP if $mode == debug
rossberg@chromium.org89e18f52012-10-22 13:09:53 +0000101regress/regress-1122: PASS, SKIP if ($mode == debug && $arch == android_arm)
kasperl@chromium.org41044eb2008-10-06 08:24:46 +0000102
kasperl@chromium.org7be3c992009-03-12 07:19:55 +0000103# Flaky test that can hit compilation-time stack overflow in debug mode.
104unicode-test: PASS, (PASS || FAIL) if $mode == debug
105
kasperl@chromium.orge959c182009-07-27 08:59:04 +0000106# Times out often in release mode on ARM.
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000107compiler/regress-stacktrace-methods: PASS, PASS || TIMEOUT if $mode == release
kasperl@chromium.orge959c182009-07-27 08:59:04 +0000108array-splice: PASS || TIMEOUT
ager@chromium.orgc4c92722009-11-18 14:12:51 +0000109
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000110# Long running test.
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000111string-indexof-2: PASS || TIMEOUT
mstarzinger@chromium.orgde886792012-09-11 13:22:37 +0000112mirror-object: PASS || TIMEOUT
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000113
114# BUG(3251035): Timeouts in long looping crankshaft optimization
115# tests. Skipping because having them timeout takes too long on the
116# buildbot.
117compiler/alloc-number: SKIP
118compiler/array-length: SKIP
119compiler/assignment-deopt: SKIP
120compiler/deopt-args: SKIP
121compiler/inline-compare: SKIP
122compiler/inline-global-access: SKIP
123compiler/optimized-function-calls: SKIP
124compiler/pic: SKIP
125compiler/property-calls: SKIP
126compiler/recursive-deopt: SKIP
127compiler/regress-4: SKIP
128compiler/regress-funcaller: SKIP
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000129compiler/regress-rep-change: SKIP
130compiler/regress-arguments: SKIP
131compiler/regress-funarguments: SKIP
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000132compiler/regress-3249650: SKIP
133compiler/simple-deopt: SKIP
134regress/regress-490: SKIP
135regress/regress-634: SKIP
136regress/regress-create-exception: SKIP
137regress/regress-3218915: SKIP
138regress/regress-3247124: SKIP
ager@chromium.orgc4c92722009-11-18 14:12:51 +0000139
sgjesse@chromium.org496c03a2011-02-14 12:05:43 +0000140# Requires bigger stack size in the Genesis and if stack size is increased,
141# the test requires too much time to run. However, the problem test covers
142# should be platform-independent.
143regress/regress-1132: SKIP
vegorov@chromium.orgdff694e2010-05-17 09:10:26 +0000144
yangguo@chromium.org5a11aaf2012-06-20 11:29:00 +0000145# Stack manipulations in LiveEdit is not implemented for this arch.
146debug-liveedit-check-stack: SKIP
147debug-liveedit-stack-padding: SKIP
148debug-liveedit-restart-frame: SKIP
ulan@chromium.orgd9e468a2012-06-25 09:47:40 +0000149debug-liveedit-double-call: SKIP
yangguo@chromium.org5a11aaf2012-06-20 11:29:00 +0000150
yangguo@chromium.orgd2899aa2012-06-21 11:16:20 +0000151# Currently always deopt on minus zero
152math-floor-of-div-minus-zero: SKIP
153
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000154##############################################################################
rossberg@chromium.org657d53b2012-07-12 11:06:03 +0000155[ $arch == mipsel ]
ager@chromium.org5c838252010-02-19 08:53:10 +0000156
ricow@chromium.org64e3a4b2011-12-13 08:07:27 +0000157# Slow tests which times out in debug mode.
158try: PASS, SKIP if $mode == debug
159debug-scripts-request: PASS, SKIP if $mode == debug
160array-constructor: PASS, SKIP if $mode == debug
161
162# Times out often in release mode on MIPS.
163compiler/regress-stacktrace-methods: PASS, PASS || TIMEOUT if $mode == release
164array-splice: PASS || TIMEOUT
165
166# Long running test.
167mirror-object: PASS || TIMEOUT
168string-indexof-2: PASS || TIMEOUT
169
170# BUG(3251035): Timeouts in long looping crankshaft optimization
171# tests. Skipping because having them timeout takes too long on the
172# buildbot.
danno@chromium.org40cb8782011-05-25 07:58:50 +0000173compiler/alloc-number: SKIP
174compiler/array-length: SKIP
175compiler/assignment-deopt: SKIP
176compiler/deopt-args: SKIP
177compiler/inline-compare: SKIP
178compiler/inline-global-access: SKIP
179compiler/optimized-function-calls: SKIP
180compiler/pic: SKIP
181compiler/property-calls: SKIP
182compiler/recursive-deopt: SKIP
183compiler/regress-4: SKIP
184compiler/regress-funcaller: SKIP
danno@chromium.org40cb8782011-05-25 07:58:50 +0000185compiler/regress-rep-change: SKIP
186compiler/regress-arguments: SKIP
187compiler/regress-funarguments: SKIP
danno@chromium.org40cb8782011-05-25 07:58:50 +0000188compiler/regress-3249650: SKIP
189compiler/simple-deopt: SKIP
190regress/regress-490: SKIP
191regress/regress-634: SKIP
192regress/regress-create-exception: SKIP
193regress/regress-3218915: SKIP
194regress/regress-3247124: SKIP
195
ricow@chromium.org64e3a4b2011-12-13 08:07:27 +0000196# Requires bigger stack size in the Genesis and if stack size is increased,
197# the test requires too much time to run. However, the problem test covers
198# should be platform-independent.
199regress/regress-1132: SKIP
yangguo@chromium.org5a11aaf2012-06-20 11:29:00 +0000200
201# Stack manipulations in LiveEdit is not implemented for this arch.
202debug-liveedit-check-stack: SKIP
203debug-liveedit-stack-padding: SKIP
204debug-liveedit-restart-frame: SKIP
jkummerow@chromium.org7a6fc812012-06-27 11:12:38 +0000205debug-liveedit-double-call: SKIP
yangguo@chromium.org5a11aaf2012-06-20 11:29:00 +0000206
dslomov@chromium.orgb752d402013-06-18 11:54:54 +0000207# Currently always deopt on minus zero
208math-floor-of-div-minus-zero: SKIP
209
mstarzinger@chromium.orge27d6172013-04-17 11:51:44 +0000210##############################################################################
211# Native Client uses the ARM simulator so will behave similarly to arm
212# on mjsunit tests.
213# TODO(bradchen): enable more tests for NaCl V8 when it stops using
214# the ARM simulator.
215##############################################################################
216[ $arch == nacl_ia32 || $arch == nacl_x64 ]
217# There is no /tmp directory for NaCl runs
218d8-os: SKIP
219
220# Stack manipulations in LiveEdit is not implemented for this arch.
221debug-liveedit-check-stack: SKIP
222debug-liveedit-stack-padding: SKIP
223debug-liveedit-restart-frame: SKIP
224debug-liveedit-double-call: SKIP
225
226# This test dumps core for arm.debug, so no reason to expect it to work
227# for NaCl. The other three fuzz-natives tests seem to run fine.
228# As noted above none of them are run in the arm.debug case.
229fuzz-natives-part4: SKIP
230
231# Requires bigger stack size in the Genesis and if stack size is increased,
232# the test requires too much time to run. However, the problem test covers
233# should be platform-independent.
234regress/regress-1132: SKIP
235
236# Poor performance for NaCl V8 causes an assertion failure for this test.
237regress/regress-165637: SKIP
238
239# Skip long running test that times out in debug mode and goes OOM on NaCl.
240regress/regress-crbug-160010: SKIP