blob: 7c70aa8ad704297db5a763f9c7c723830b7935ef [file] [log] [blame]
ohair7aae9af2009-11-08 15:11:10 -08001###########################################################################
2#
smarksf351c0a2013-01-07 18:09:07 -08003# Copyright (c) 2009, 2013, Oracle and/or its affiliates. All rights reserved.
ohair7aae9af2009-11-08 15:11:10 -08004# DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
5#
6# This code is free software; you can redistribute it and/or modify it
7# under the terms of the GNU General Public License version 2 only, as
ohair2283b9d2010-05-25 15:58:33 -07008# published by the Free Software Foundation. Oracle designates this
ohair7aae9af2009-11-08 15:11:10 -08009# particular file as subject to the "Classpath" exception as provided
ohair2283b9d2010-05-25 15:58:33 -070010# by Oracle in the LICENSE file that accompanied this code.
ohair7aae9af2009-11-08 15:11:10 -080011#
12# This code is distributed in the hope that it will be useful, but WITHOUT
13# ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
14# FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
15# version 2 for more details (a copy is included in the LICENSE file that
16# accompanied this code).
17#
18# You should have received a copy of the GNU General Public License version
19# 2 along with this work; if not, write to the Free Software Foundation,
20# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
21#
ohair2283b9d2010-05-25 15:58:33 -070022# Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
23# or visit www.oracle.com if you need additional information or have any
24# questions.
ohair7aae9af2009-11-08 15:11:10 -080025#
26###########################################################################
27#
28# List of tests that should not be run by test/Makefile, for various reasons:
29# 1. Does not run with jtreg -samevm mode
30# 2. Causes problems in jtreg -samevm mode for jtreg or tests that follow it
31# 3. The test is too slow or consumes too many system resources
32# 4. The test fails when run on any official build systems
33#
34# It is possible that a test being on this list is a mistake, and that some
35# other test in samevm mode caused tests to fail, mistakes happen.
36#
37# Tests marked @ignore are not run by test/Makefile, but harmless to be listed.
38#
39# Tests that explicitly state "@run main/othervm ...", and are not listed here,
40# will be run in the same batch as the samevm tests.
41#
42# Shell tests are othervm by default.
43#
mduigou76a5cac2011-02-21 13:37:22 -080044# List items are testnames followed by labels, all MUST BE commented
ohair7aae9af2009-11-08 15:11:10 -080045# as to why they are here and use a label:
michaelm046f7f12011-09-21 14:51:01 +010046# generic-all Problems on all platforms
47# generic-ARCH Where ARCH is one of: sparc, sparcv9, x64, i586, etc.
mduigouba95ae82013-02-06 11:28:25 -080048# OSNAME-all Where OSNAME is one of: solaris, linux, windows, macosx
49# OSNAME-ARCH Specific on to one OSNAME and ARCH, e.g. solaris-amd64
michaelm046f7f12011-09-21 14:51:01 +010050# OSNAME-REV Specific on to one OSNAME and REV, e.g. solaris-5.8
mduigou76a5cac2011-02-21 13:37:22 -080051#
ohair7aae9af2009-11-08 15:11:10 -080052# More than one label is allowed but must be on the same line.
53#
54#############################################################################
55#
56# Running the tests:
57# cd test && make JT_HOME=jtreg_home PRODUCT_HOME=jdk_home jdk_all
58# Or instead of jdk_all, use any of the jdk_* targets.
59#
60# Samevm Notes:
61# * Although some tests may have only been seen to fail on some platforms,
62# they might be flagged as 'generic-all' because the problem they have
63# could cause hidden slowdowns on other platforms.
64# Most samevm problems will be generic-all, but windows usually dislikes
65# them the most.
66# Address already in use or connection errors indicate a generic port issue.
67# (this is not necessarily a samevm issue, but an issue for running the tests
68# on shared machines, two people or two test runs will collide).
69# * Samevm problem (windows in particular) is not closing all input/output
70# * Samevm problem when a test calls setSecurityManager()
71# * Samevm problem with setHttps*() is used? (not exactly sure here)
72# * Samevm problem when stuffing system properties with non Strings or anything
73# * Samevm problem when changing vm settings, or registering any vm actions
74# * Samevm problems with deleteOnExit(), if it must happen at end of test
75# * Samevm problems with URLClassLoader? (no details here)
76# * Samevm problems with dependence on predictable GC or finalizations
77#
78# Any of the above problems may mean the test needs to be flagged as "othervm".
79#
80#############################################################################
81#
82# Fixing the tests:
83#
84# Some tests just may need to be run with "othervm", and that can easily be
85# done my adding a @run line (or modifying any existing @run):
86# @run main/othervm NameOfMainClass
87# Make sure this @run follows any use of @library.
88# Otherwise, if the test is a samevm possibility, make sure the test is
89# cleaning up after itself, closing all streams, deleting temp files, etc.
90#
91# Keep in mind that the bug could be in many places, and even different per
92# platform, it could be a bug in any one of:
93# - the testcase
94# - the jdk (jdk classes, native code, or hotspot)
95# - the native compiler
96# - the javac compiler
97# - the OS (depends on what the testcase does)
98#
99# If you managed to really fix one of these tests, here is how you can
100# remove tests from this list:
101# 1. Make sure test passes on all platforms with samevm, or mark it othervm
102# 2. Make sure test passes on all platforms when run with it's entire group
103# 3. Make sure both VMs are tested, -server and -client, if possible
104# 4. Make sure you try the -d64 option on Solaris
105# 5. Use a tool like JPRT or something to verify these results
106# 6. Delete lines in this file, include the changes with your test changes
107#
108# You may need to repeat your testing 2 or even 3 times to verify good
109# results, some of these samevm failures are not very predictable.
110#
111#############################################################################
112
113############################################################################
114
115# jdk_awt
116
ohair7aae9af2009-11-08 15:11:10 -0800117############################################################################
118
119# jdk_beans
120
ohair7aae9af2009-11-08 15:11:10 -0800121############################################################################
122
ohair7aae9af2009-11-08 15:11:10 -0800123# jdk_lang
124
alanb937d5f72011-08-22 16:04:04 +0100125# 6944188
michaelm046f7f12011-09-21 14:51:01 +0100126java/lang/management/ThreadMXBean/ThreadStateTest.java generic-all
alanb937d5f72011-08-22 16:04:04 +0100127
smarks83dab672011-08-12 14:51:48 -0700128# 7067973
129java/lang/management/MemoryMXBean/CollectionUsageThreshold.java generic-all
130
alanb1fef1cb2012-01-16 16:30:29 +0000131############################################################################
132
133# jdk_management
134
mchung4617d272013-04-18 11:14:39 -0700135# 8010897
alanbb2f5cb42013-05-21 08:53:51 +0100136sun/management/HotspotRuntimeMBean/GetSafepointSyncTime.java macosx-all
mchung4617d272013-04-18 11:14:39 -0700137
alanb1b66ea92012-10-09 13:28:32 +0100138############################################################################
139
140# jdk_jmx
141
ohair7aae9af2009-11-08 15:11:10 -0800142############################################################################
143
144# jdk_math
145
ohair7aae9af2009-11-08 15:11:10 -0800146############################################################################
147
alanb1b66ea92012-10-09 13:28:32 +0100148# jdk_other
ohair7aae9af2009-11-08 15:11:10 -0800149
alanb1fef1cb2012-01-16 16:30:29 +0000150# 6988950
151demo/jvmti/compiledMethodLoad/CompiledMethodLoadTest.java generic-all
152
smarks87f39cc2012-11-29 14:43:46 -0800153# 7027502
154demo/jvmti/hprof/MonitorTest.java generic-all
155
chegarfb848072013-11-07 08:04:36 +0000156# 8024423 - JVMTI: GetLoadedClasses doesn't enumerate anonymous classes
amurillo786388f2013-09-10 05:46:37 -0700157demo/jvmti/hprof/HeapAllTest.java generic-all
158demo/jvmti/hprof/HeapBinaryFormatTest.java generic-all
159demo/jvmti/hprof/HeapDumpTest.java generic-all
160demo/jvmti/hprof/OptionsTest.java generic-all
161demo/jvmti/hprof/StackMapTableTest.java generic-all
162
chegarfb848072013-11-07 08:04:36 +0000163# 8027622
164java/sql/JavatimeTest.java generic-all
165
ohair7aae9af2009-11-08 15:11:10 -0800166############################################################################
167
168# jdk_net
169
alanb22956fe2011-07-18 13:10:02 +0100170# Filed 7052625
michaelm046f7f12011-09-21 14:51:01 +0100171com/sun/net/httpserver/bugs/6725892/Test.java generic-all
alanb22956fe2011-07-18 13:10:02 +0100172
173# Filed 7036666
michaelm046f7f12011-09-21 14:51:01 +0100174com/sun/net/httpserver/Test9a.java generic-all
alanb22956fe2011-07-18 13:10:02 +0100175
michaelmfb59afb2011-10-20 09:21:03 +0100176# 7102670
177java/net/InetAddress/CheckJNI.java linux-all
178
179# failing on vista 32/64 on nightly
180# 7102702
181java/net/PortUnreachableException/OneExceptionOnly.java windows-all
alanbeb8dc4a2012-02-20 19:33:32 +0000182
alanb3290f522012-02-26 17:25:42 +0000183# 7148829
184sun/net/InetAddress/nameservice/simple/CacheTest.java generic-all
185sun/net/InetAddress/nameservice/simple/DefaultCaching.java generic-all
186
michaelm5ac8c152012-03-06 20:34:38 +0000187# 7122846
188java/net/MulticastSocket/NoLoopbackPackets.java macosx-all
189java/net/MulticastSocket/SetLoopbackMode.java macosx-all
190
191# 7145658
192java/net/MulticastSocket/Test.java macosx-all
193
chegar736dbff2013-05-17 15:00:53 +0100194# 7143960
michaelm5ac8c152012-03-06 20:34:38 +0000195java/net/DatagramSocket/SendDatagramToBadAddress.java macosx-all
196
ohair7aae9af2009-11-08 15:11:10 -0800197############################################################################
198
199# jdk_nio
200
alanb902fc682010-06-23 20:19:29 +0100201# 6963118
202java/nio/channels/Selector/Wakeup.java windows-all
ohair45110f42010-03-06 14:59:23 -0800203
michaelm5ac8c152012-03-06 20:34:38 +0000204# 7133499, 7133497
205java/nio/channels/AsyncCloseAndInterrupt.java macosx-all
206java/nio/channels/AsynchronousFileChannel/Lock.java macosx-all
207java/nio/channels/FileChannel/Transfer.java macosx-all
208
209# 7141822
210java/nio/channels/DatagramChannel/ChangingAddress.java macosx-all
211
212# 7132677
213java/nio/channels/Selector/OutOfBand.java macosx-all
214
chegarfb848072013-11-07 08:04:36 +0000215# 8027622
216java/nio/file/attribute/FileTime/Basic.java generic-all
217
ohair7aae9af2009-11-08 15:11:10 -0800218############################################################################
219
220# jdk_rmi
221
alanb3290f522012-02-26 17:25:42 +0000222# 7146541
223java/rmi/transport/rapidExportUnexport/RapidExportUnexport.java linux-all
224
smarks65c8c8f2012-08-30 18:53:02 -0700225# 7190106
226java/rmi/reliability/benchmark/runRmiBench.sh generic-all
227
228# 7191877
229java/rmi/transport/checkLeaseInfoLeak/CheckLeaseLeak.java generic-all
230
231# 7195095
smarks87f39cc2012-11-29 14:43:46 -0800232sun/rmi/transport/proxy/EagerHttpFallback.java generic-all
smarks65c8c8f2012-08-30 18:53:02 -0700233
ohair7aae9af2009-11-08 15:11:10 -0800234############################################################################
235
236# jdk_security
237
ascarpinodbf96662013-07-29 13:43:24 -0700238# 7157786
239sun/security/pkcs11/ec/TestKeyFactory.java generic-all
ascarpinoc943c6f2013-07-19 11:34:33 -0700240
weijund122f1e2012-09-17 17:19:50 +0800241# 7164518: no PortUnreachableException on Mac
242sun/security/krb5/auto/Unreachable.java macosx-all
243
alanbeb8dc4a2012-02-20 19:33:32 +0000244# 7147060
245com/sun/org/apache/xml/internal/security/transforms/ClassLoaderTest.java generic-all
246
weijuneab31672012-09-18 17:38:43 +0800247# 6988842: 4 tests failing on Solaris 5.10
248sun/security/pkcs11/Secmod/AddPrivateKey.java solaris-all
249sun/security/pkcs11/ec/ReadCertificates.java solaris-all
250sun/security/pkcs11/ec/ReadPKCS12.java solaris-all
251sun/security/pkcs11/sslecc/ClientJSSEServerJSSE.java solaris-all
weijun6d8fea82011-08-16 08:53:03 +0800252
weijunf67a9c42013-10-23 08:32:03 +0800253# 7041639, Solaris DSA keypair generation bug
weijunc4ee9be2011-09-05 18:17:55 +0800254java/security/KeyPairGenerator/SolarisShortDSA.java solaris-all
weijunc4ee9be2011-09-05 18:17:55 +0800255sun/security/tools/keytool/standard.sh solaris-all
256
weijund2be8642012-10-22 17:01:35 +0800257# 8000439: NPG: REGRESSION : sun/security/krb5/auto/MaxRetries.java fails with timeout
258sun/security/krb5/auto/MaxRetries.java solaris-sparcv9
259
weijun60d87eb2013-03-22 19:59:14 +0800260# 8006690: sun/security/krb5/auto/BadKdc1.java fails intermittently
261sun/security/krb5/auto/BadKdc1.java solaris-sparcv9
262sun/security/krb5/auto/BadKdc2.java solaris-sparcv9
263sun/security/krb5/auto/BadKdc3.java solaris-sparcv9
264sun/security/krb5/auto/BadKdc4.java solaris-sparcv9
265
ohair7aae9af2009-11-08 15:11:10 -0800266############################################################################
267
alanbeb8dc4a2012-02-20 19:33:32 +0000268# jdk_sound
ohair7aae9af2009-11-08 15:11:10 -0800269
alanbeb8dc4a2012-02-20 19:33:32 +0000270############################################################################
271
272# jdk_swing
ohair7aae9af2009-11-08 15:11:10 -0800273
274############################################################################
275
276# jdk_text
277
ohair7aae9af2009-11-08 15:11:10 -0800278############################################################################
279
chegar9f70b3b2013-06-19 15:58:21 +0100280# jdk_time
281
chegarfb848072013-11-07 08:04:36 +0000282# 8027622
283java/time/tck/java/time/TCKClock_Tick.java generic-all
284java/time/tck/java/time/TCKDuration.java generic-all
285java/time/tck/java/time/TCKInstant.java generic-all
286java/time/tck/java/time/TCKLocalDate.java generic-all
287java/time/tck/java/time/TCKLocalDateTime.java generic-all
288java/time/tck/java/time/TCKLocalTime.java generic-all
289java/time/tck/java/time/TCKMonthDay.java generic-all
290java/time/tck/java/time/TCKOffsetDateTime.java generic-all
291java/time/tck/java/time/TCKOffsetTime.java generic-all
292java/time/tck/java/time/TCKYear.java generic-all
293java/time/tck/java/time/TCKYearMonth.java generic-all
294java/time/tck/java/time/TCKZonedDateTime.java generic-all
295java/time/tck/java/time/temporal/TCKWeekFields.java generic-all
296java/time/test/java/time/TestClock_Fixed.java generic-all
297java/time/test/java/time/TestOffsetDateTime_instants.java generic-all
298java/time/test/java/time/format/TestZoneTextPrinterParser.java generic-all
299java/time/test/java/time/temporal/TestChronoUnit.java generic-all
300java/time/test/java/util/TestFormatter.java generic-all
301
chegar9f70b3b2013-06-19 15:58:21 +0100302############################################################################
303
ohair7aae9af2009-11-08 15:11:10 -0800304# jdk_tools
305
alanb38a5cf62012-02-12 21:09:09 +0000306# 6461635
307com/sun/tools/attach/BasicTests.sh generic-all
308
alanb1b66ea92012-10-09 13:28:32 +0100309# 7132203
310sun/jvmstat/monitor/MonitoredVm/CR6672135.java generic-all
311
ksrinid902b5c2013-02-10 08:07:59 -0800312# Tests take too long, on sparcs see 7143279
alanbb2f5cb42013-05-21 08:53:51 +0100313tools/pack200/CommandLineTests.java solaris-all, macosx-all
ksrinid902b5c2013-02-10 08:07:59 -0800314tools/pack200/Pack200Test.java solaris-all, macosx-all
alanb1b66ea92012-10-09 13:28:32 +0100315
ksrinie4e71992013-02-01 22:18:18 -0800316# 8007410
317tools/launcher/FXLauncherTest.java linux-all
318
alanb1b66ea92012-10-09 13:28:32 +0100319############################################################################
320
321# jdk_jdi
322
ohairaf343022010-09-24 14:22:01 -0700323# Filed 6952105
michaelm046f7f12011-09-21 14:51:01 +0100324com/sun/jdi/SuspendThreadTest.java generic-all
ohairaf343022010-09-24 14:22:01 -0700325
alanb22956fe2011-07-18 13:10:02 +0100326# Filed 6653793
michaelm046f7f12011-09-21 14:51:01 +0100327com/sun/jdi/RedefineCrossEvent.java generic-all
alanb22956fe2011-07-18 13:10:02 +0100328
alanb22956fe2011-07-18 13:10:02 +0100329# Filed 6402201
michaelm046f7f12011-09-21 14:51:01 +0100330com/sun/jdi/ProcessAttachTest.sh generic-all
alanb22956fe2011-07-18 13:10:02 +0100331
ohair7aae9af2009-11-08 15:11:10 -0800332############################################################################
333
334# jdk_util
335
ohairaf343022010-09-24 14:22:01 -0700336# Filed 6933803
michaelm046f7f12011-09-21 14:51:01 +0100337java/util/concurrent/ThreadPoolExecutor/CoreThreadTimeOut.java generic-all
ohairaf343022010-09-24 14:22:01 -0700338
alanb22956fe2011-07-18 13:10:02 +0100339# Filed 6772009
ohair7aae9af2009-11-08 15:11:10 -0800340java/util/concurrent/locks/ReentrantLock/CancelledLockLoops.java generic-all
341
chegarfb848072013-11-07 08:04:36 +0000342# 8027622
343java/util/Calendar/JavatimeTest.java generic-all
aefimov94e8ea62013-10-24 17:23:26 +0400344
ohair7aae9af2009-11-08 15:11:10 -0800345############################################################################