blob: 09097db9f52b5728d2abff7dc221fb1bd8afecb7 [file] [log] [blame]
yangguo@chromium.orgab30bb82012-02-24 14:41:46 +00001# Copyright 2012 the V8 project authors. All rights reserved.
mads.s.ager@gmail.com9a4089a2008-09-01 08:55:01 +00002# Redistribution and use in source and binary forms, with or without
3# modification, are permitted provided that the following conditions are
4# met:
5#
6# * Redistributions of source code must retain the above copyright
7# notice, this list of conditions and the following disclaimer.
8# * Redistributions in binary form must reproduce the above
9# copyright notice, this list of conditions and the following
10# disclaimer in the documentation and/or other materials provided
11# with the distribution.
12# * Neither the name of Google Inc. nor the names of its
13# contributors may be used to endorse or promote products derived
14# from this software without specific prior written permission.
15#
16# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
17# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
18# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
19# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
20# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
21# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
22# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
23# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
24# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
26# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
27
28prefix mjsunit
29
30# All tests in the bug directory are expected to fail.
mmassi@chromium.org7028c052012-06-13 11:51:58 +000031bugs/*: FAIL
mads.s.ager@gmail.com9a4089a2008-09-01 08:55:01 +000032
kasperl@chromium.orga5551262010-12-07 12:49:48 +000033##############################################################################
ricow@chromium.org4f693d62011-07-04 14:01:31 +000034# Fails.
35regress/regress-1119: FAIL
36
mmassi@chromium.org7028c052012-06-13 11:51:58 +000037# Issue 1719: Slow to collect arrays over several contexts.
erik.corry@gmail.comc3b670f2011-10-05 21:44:48 +000038regress/regress-524: SKIP
mmassi@chromium.org7028c052012-06-13 11:51:58 +000039# When that bug is fixed, revert the expectation to:
40# Skip long running test in debug and allow it to timeout in release mode.
41# regress/regress-524: (PASS || TIMEOUT), SKIP if $mode == debug
erik.corry@gmail.comc3b670f2011-10-05 21:44:48 +000042
yangguo@chromium.org46a2a512013-01-18 16:29:40 +000043# Deferred stack trace formatting is temporarily disabled.
44stack-traces-gc: PASS || FAIL
45
erik.corry@gmail.comc3b670f2011-10-05 21:44:48 +000046##############################################################################
mstarzinger@chromium.orge27d6172013-04-17 11:51:44 +000047# Too slow in debug mode with --stress-opt mode.
kasperl@chromium.orga5551262010-12-07 12:49:48 +000048compiler/regress-stacktrace-methods: PASS, SKIP if $mode == debug
ager@chromium.org5f0c45f2010-12-17 08:51:21 +000049compiler/regress-funcaller: PASS, SKIP if $mode == debug
danno@chromium.org72204d52012-10-31 10:02:10 +000050regress/regress-2318: PASS, SKIP if $mode == debug
ager@chromium.org5f0c45f2010-12-17 08:51:21 +000051regress/regress-create-exception: PASS, SKIP if $mode == debug
mstarzinger@chromium.orge27d6172013-04-17 11:51:44 +000052regress/regress-2612: PASS, SKIP if $mode == debug
53
54##############################################################################
55# Too slow in debug mode for GC stress mode.
56regress/regress-crbug-217858: PASS, SKIP if $mode == debug
kasperl@chromium.orga5551262010-12-07 12:49:48 +000057
58##############################################################################
verwaest@chromium.org33e09c82012-10-10 17:07:22 +000059# These use a built-in that's only present in debug mode. They take
ricow@chromium.org64e3a4b2011-12-13 08:07:27 +000060# too long to run in debug mode on ARM and MIPS.
verwaest@chromium.org33e09c82012-10-10 17:07:22 +000061fuzz-natives-part*: PASS, SKIP if ($mode == release || $arch == arm || $arch == android_arm || $arch == mipsel)
ager@chromium.orgc27e4e72008-09-04 13:52:27 +000062
yangguo@chromium.org304cc332012-07-24 07:59:48 +000063big-object-literal: PASS, SKIP if ($arch == arm || $arch == android_arm)
ager@chromium.orgbb29dc92009-03-24 13:25:23 +000064
ager@chromium.org3811b432009-10-28 14:53:37 +000065# Issue 488: this test sometimes times out.
66array-constructor: PASS || TIMEOUT
67
ricow@chromium.org64e3a4b2011-12-13 08:07:27 +000068# Very slow on ARM and MIPS, contains no architecture dependent code.
yangguo@chromium.org304cc332012-07-24 07:59:48 +000069unicode-case-overoptimization: PASS, TIMEOUT if ($arch == arm || $arch == android_arm || $arch == mipsel)
ager@chromium.orgc4c92722009-11-18 14:12:51 +000070
kasperl@chromium.orga5551262010-12-07 12:49:48 +000071##############################################################################
danno@chromium.org72204d52012-10-31 10:02:10 +000072# This test expects to reach a certain recursion depth, which may not work
73# for debug mode.
74json-recursive: PASS, (PASS || FAIL) if $mode == debug
75
76##############################################################################
hpayer@chromium.org8432c912013-02-28 15:55:26 +000077# Skip long running test that times out in debug mode or goes OOM on android.
78regress/regress-crbug-160010: PASS, SKIP if ($mode == debug || $arch == android_arm)
danno@chromium.org94b0d6f2013-02-04 13:33:20 +000079generated-transition-stub: PASS, SKIP if $mode == debug
mvstanton@chromium.orge4ac3ef2012-11-12 14:53:34 +000080
81##############################################################################
yangguo@chromium.org78d1ad42012-02-09 13:53:47 +000082# This test sets the umask on a per-process basis and hence cannot be
83# used in multi-threaded runs.
mstarzinger@chromium.orgc6d9cee2012-07-03 10:03:19 +000084# On android there is no /tmp directory.
yangguo@chromium.org304cc332012-07-24 07:59:48 +000085d8-os: PASS, SKIP if ($isolates || $arch == android_arm || $arch == android_ia32)
86tools/tickprocessor: PASS, SKIP if ($arch == android_arm || $arch == android_ia32)
yangguo@chromium.org78d1ad42012-02-09 13:53:47 +000087
88##############################################################################
yangguo@chromium.org003650e2013-01-24 16:31:08 +000089# Long running test that reproduces memory leak and should be run manually.
90regress/regress-2073: SKIP
91
92##############################################################################
yangguo@chromium.org304cc332012-07-24 07:59:48 +000093[ $arch == arm || $arch == android_arm ]
ager@chromium.orgc27e4e72008-09-04 13:52:27 +000094
ager@chromium.org7c537e22008-10-16 08:43:32 +000095# Slow tests which times out in debug mode.
kasperl@chromium.org41044eb2008-10-06 08:24:46 +000096try: PASS, SKIP if $mode == debug
ager@chromium.org7c537e22008-10-16 08:43:32 +000097debug-scripts-request: PASS, SKIP if $mode == debug
christian.plesner.hansen@gmail.com2bc58ef2009-09-22 10:00:30 +000098array-constructor: PASS, SKIP if $mode == debug
rossberg@chromium.org89e18f52012-10-22 13:09:53 +000099regress/regress-1122: PASS, SKIP if ($mode == debug && $arch == android_arm)
kasperl@chromium.org41044eb2008-10-06 08:24:46 +0000100
kasperl@chromium.org7be3c992009-03-12 07:19:55 +0000101# Flaky test that can hit compilation-time stack overflow in debug mode.
102unicode-test: PASS, (PASS || FAIL) if $mode == debug
103
kasperl@chromium.orge959c182009-07-27 08:59:04 +0000104# Times out often in release mode on ARM.
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000105compiler/regress-stacktrace-methods: PASS, PASS || TIMEOUT if $mode == release
kasperl@chromium.orge959c182009-07-27 08:59:04 +0000106array-splice: PASS || TIMEOUT
ager@chromium.orgc4c92722009-11-18 14:12:51 +0000107
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000108# Long running test.
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000109string-indexof-2: PASS || TIMEOUT
mstarzinger@chromium.orgde886792012-09-11 13:22:37 +0000110mirror-object: PASS || TIMEOUT
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000111
112# BUG(3251035): Timeouts in long looping crankshaft optimization
113# tests. Skipping because having them timeout takes too long on the
114# buildbot.
115compiler/alloc-number: SKIP
116compiler/array-length: SKIP
117compiler/assignment-deopt: SKIP
118compiler/deopt-args: SKIP
119compiler/inline-compare: SKIP
120compiler/inline-global-access: SKIP
121compiler/optimized-function-calls: SKIP
122compiler/pic: SKIP
123compiler/property-calls: SKIP
124compiler/recursive-deopt: SKIP
125compiler/regress-4: SKIP
126compiler/regress-funcaller: SKIP
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000127compiler/regress-rep-change: SKIP
128compiler/regress-arguments: SKIP
129compiler/regress-funarguments: SKIP
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000130compiler/regress-3249650: SKIP
131compiler/simple-deopt: SKIP
132regress/regress-490: SKIP
133regress/regress-634: SKIP
134regress/regress-create-exception: SKIP
135regress/regress-3218915: SKIP
136regress/regress-3247124: SKIP
ager@chromium.orgc4c92722009-11-18 14:12:51 +0000137
sgjesse@chromium.org496c03a2011-02-14 12:05:43 +0000138# Requires bigger stack size in the Genesis and if stack size is increased,
139# the test requires too much time to run. However, the problem test covers
140# should be platform-independent.
141regress/regress-1132: SKIP
vegorov@chromium.orgdff694e2010-05-17 09:10:26 +0000142
yangguo@chromium.org5a11aaf2012-06-20 11:29:00 +0000143# Stack manipulations in LiveEdit is not implemented for this arch.
144debug-liveedit-check-stack: SKIP
145debug-liveedit-stack-padding: SKIP
146debug-liveedit-restart-frame: SKIP
ulan@chromium.orgd9e468a2012-06-25 09:47:40 +0000147debug-liveedit-double-call: SKIP
yangguo@chromium.org5a11aaf2012-06-20 11:29:00 +0000148
yangguo@chromium.orgd2899aa2012-06-21 11:16:20 +0000149# Currently always deopt on minus zero
150math-floor-of-div-minus-zero: SKIP
151
kasperl@chromium.orga5551262010-12-07 12:49:48 +0000152##############################################################################
rossberg@chromium.org657d53b2012-07-12 11:06:03 +0000153[ $arch == mipsel ]
ager@chromium.org5c838252010-02-19 08:53:10 +0000154
ricow@chromium.org64e3a4b2011-12-13 08:07:27 +0000155# Slow tests which times out in debug mode.
156try: PASS, SKIP if $mode == debug
157debug-scripts-request: PASS, SKIP if $mode == debug
158array-constructor: PASS, SKIP if $mode == debug
159
160# Times out often in release mode on MIPS.
161compiler/regress-stacktrace-methods: PASS, PASS || TIMEOUT if $mode == release
162array-splice: PASS || TIMEOUT
163
164# Long running test.
165mirror-object: PASS || TIMEOUT
166string-indexof-2: PASS || TIMEOUT
167
168# BUG(3251035): Timeouts in long looping crankshaft optimization
169# tests. Skipping because having them timeout takes too long on the
170# buildbot.
danno@chromium.org40cb8782011-05-25 07:58:50 +0000171compiler/alloc-number: SKIP
172compiler/array-length: SKIP
173compiler/assignment-deopt: SKIP
174compiler/deopt-args: SKIP
175compiler/inline-compare: SKIP
176compiler/inline-global-access: SKIP
177compiler/optimized-function-calls: SKIP
178compiler/pic: SKIP
179compiler/property-calls: SKIP
180compiler/recursive-deopt: SKIP
181compiler/regress-4: SKIP
182compiler/regress-funcaller: SKIP
danno@chromium.org40cb8782011-05-25 07:58:50 +0000183compiler/regress-rep-change: SKIP
184compiler/regress-arguments: SKIP
185compiler/regress-funarguments: SKIP
danno@chromium.org40cb8782011-05-25 07:58:50 +0000186compiler/regress-3249650: SKIP
187compiler/simple-deopt: SKIP
188regress/regress-490: SKIP
189regress/regress-634: SKIP
190regress/regress-create-exception: SKIP
191regress/regress-3218915: SKIP
192regress/regress-3247124: SKIP
193
ricow@chromium.org64e3a4b2011-12-13 08:07:27 +0000194# Requires bigger stack size in the Genesis and if stack size is increased,
195# the test requires too much time to run. However, the problem test covers
196# should be platform-independent.
197regress/regress-1132: SKIP
yangguo@chromium.org5a11aaf2012-06-20 11:29:00 +0000198
199# Stack manipulations in LiveEdit is not implemented for this arch.
200debug-liveedit-check-stack: SKIP
201debug-liveedit-stack-padding: SKIP
202debug-liveedit-restart-frame: SKIP
jkummerow@chromium.org7a6fc812012-06-27 11:12:38 +0000203debug-liveedit-double-call: SKIP
yangguo@chromium.org5a11aaf2012-06-20 11:29:00 +0000204
mstarzinger@chromium.orge27d6172013-04-17 11:51:44 +0000205##############################################################################
206# Native Client uses the ARM simulator so will behave similarly to arm
207# on mjsunit tests.
208# TODO(bradchen): enable more tests for NaCl V8 when it stops using
209# the ARM simulator.
210##############################################################################
211[ $arch == nacl_ia32 || $arch == nacl_x64 ]
212# There is no /tmp directory for NaCl runs
213d8-os: SKIP
214
215# Stack manipulations in LiveEdit is not implemented for this arch.
216debug-liveedit-check-stack: SKIP
217debug-liveedit-stack-padding: SKIP
218debug-liveedit-restart-frame: SKIP
219debug-liveedit-double-call: SKIP
220
221# This test dumps core for arm.debug, so no reason to expect it to work
222# for NaCl. The other three fuzz-natives tests seem to run fine.
223# As noted above none of them are run in the arm.debug case.
224fuzz-natives-part4: SKIP
225
226# Requires bigger stack size in the Genesis and if stack size is increased,
227# the test requires too much time to run. However, the problem test covers
228# should be platform-independent.
229regress/regress-1132: SKIP
230
231# Poor performance for NaCl V8 causes an assertion failure for this test.
232regress/regress-165637: SKIP
233
234# Skip long running test that times out in debug mode and goes OOM on NaCl.
235regress/regress-crbug-160010: SKIP