blob: 94f730fb20027a8cb50991cd67492586ccabc133 [file] [log] [blame]
ohair7aae9af2009-11-08 15:11:10 -08001###########################################################################
2#
smarksf351c0a2013-01-07 18:09:07 -08003# Copyright (c) 2009, 2013, Oracle and/or its affiliates. All rights reserved.
ohair7aae9af2009-11-08 15:11:10 -08004# DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
5#
6# This code is free software; you can redistribute it and/or modify it
7# under the terms of the GNU General Public License version 2 only, as
ohair2283b9d2010-05-25 15:58:33 -07008# published by the Free Software Foundation. Oracle designates this
ohair7aae9af2009-11-08 15:11:10 -08009# particular file as subject to the "Classpath" exception as provided
ohair2283b9d2010-05-25 15:58:33 -070010# by Oracle in the LICENSE file that accompanied this code.
ohair7aae9af2009-11-08 15:11:10 -080011#
12# This code is distributed in the hope that it will be useful, but WITHOUT
13# ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
14# FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
15# version 2 for more details (a copy is included in the LICENSE file that
16# accompanied this code).
17#
18# You should have received a copy of the GNU General Public License version
19# 2 along with this work; if not, write to the Free Software Foundation,
20# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
21#
ohair2283b9d2010-05-25 15:58:33 -070022# Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
23# or visit www.oracle.com if you need additional information or have any
24# questions.
ohair7aae9af2009-11-08 15:11:10 -080025#
26###########################################################################
27#
28# List of tests that should not be run by test/Makefile, for various reasons:
29# 1. Does not run with jtreg -samevm mode
30# 2. Causes problems in jtreg -samevm mode for jtreg or tests that follow it
31# 3. The test is too slow or consumes too many system resources
32# 4. The test fails when run on any official build systems
33#
34# It is possible that a test being on this list is a mistake, and that some
35# other test in samevm mode caused tests to fail, mistakes happen.
36#
37# Tests marked @ignore are not run by test/Makefile, but harmless to be listed.
38#
39# Tests that explicitly state "@run main/othervm ...", and are not listed here,
40# will be run in the same batch as the samevm tests.
41#
42# Shell tests are othervm by default.
43#
mduigou76a5cac2011-02-21 13:37:22 -080044# List items are testnames followed by labels, all MUST BE commented
ohair7aae9af2009-11-08 15:11:10 -080045# as to why they are here and use a label:
michaelm046f7f12011-09-21 14:51:01 +010046# generic-all Problems on all platforms
47# generic-ARCH Where ARCH is one of: sparc, sparcv9, x64, i586, etc.
mduigouba95ae82013-02-06 11:28:25 -080048# OSNAME-all Where OSNAME is one of: solaris, linux, windows, macosx
49# OSNAME-ARCH Specific on to one OSNAME and ARCH, e.g. solaris-amd64
michaelm046f7f12011-09-21 14:51:01 +010050# OSNAME-REV Specific on to one OSNAME and REV, e.g. solaris-5.8
mduigou76a5cac2011-02-21 13:37:22 -080051#
ohair7aae9af2009-11-08 15:11:10 -080052# More than one label is allowed but must be on the same line.
53#
54#############################################################################
55#
56# Running the tests:
57# cd test && make JT_HOME=jtreg_home PRODUCT_HOME=jdk_home jdk_all
58# Or instead of jdk_all, use any of the jdk_* targets.
59#
60# Samevm Notes:
61# * Although some tests may have only been seen to fail on some platforms,
62# they might be flagged as 'generic-all' because the problem they have
63# could cause hidden slowdowns on other platforms.
64# Most samevm problems will be generic-all, but windows usually dislikes
65# them the most.
66# Address already in use or connection errors indicate a generic port issue.
67# (this is not necessarily a samevm issue, but an issue for running the tests
68# on shared machines, two people or two test runs will collide).
69# * Samevm problem (windows in particular) is not closing all input/output
70# * Samevm problem when a test calls setSecurityManager()
71# * Samevm problem with setHttps*() is used? (not exactly sure here)
72# * Samevm problem when stuffing system properties with non Strings or anything
73# * Samevm problem when changing vm settings, or registering any vm actions
74# * Samevm problems with deleteOnExit(), if it must happen at end of test
75# * Samevm problems with URLClassLoader? (no details here)
76# * Samevm problems with dependence on predictable GC or finalizations
77#
78# Any of the above problems may mean the test needs to be flagged as "othervm".
79#
80#############################################################################
81#
82# Fixing the tests:
83#
84# Some tests just may need to be run with "othervm", and that can easily be
85# done my adding a @run line (or modifying any existing @run):
86# @run main/othervm NameOfMainClass
87# Make sure this @run follows any use of @library.
88# Otherwise, if the test is a samevm possibility, make sure the test is
89# cleaning up after itself, closing all streams, deleting temp files, etc.
90#
91# Keep in mind that the bug could be in many places, and even different per
92# platform, it could be a bug in any one of:
93# - the testcase
94# - the jdk (jdk classes, native code, or hotspot)
95# - the native compiler
96# - the javac compiler
97# - the OS (depends on what the testcase does)
98#
99# If you managed to really fix one of these tests, here is how you can
100# remove tests from this list:
101# 1. Make sure test passes on all platforms with samevm, or mark it othervm
102# 2. Make sure test passes on all platforms when run with it's entire group
103# 3. Make sure both VMs are tested, -server and -client, if possible
104# 4. Make sure you try the -d64 option on Solaris
105# 5. Use a tool like JPRT or something to verify these results
106# 6. Delete lines in this file, include the changes with your test changes
107#
108# You may need to repeat your testing 2 or even 3 times to verify good
109# results, some of these samevm failures are not very predictable.
110#
111#############################################################################
112
113############################################################################
114
115# jdk_awt
116
ohair7aae9af2009-11-08 15:11:10 -0800117############################################################################
118
119# jdk_beans
120
ohair7aae9af2009-11-08 15:11:10 -0800121############################################################################
122
ohair7aae9af2009-11-08 15:11:10 -0800123# jdk_lang
124
alanb937d5f72011-08-22 16:04:04 +0100125# 6944188
michaelm046f7f12011-09-21 14:51:01 +0100126java/lang/management/ThreadMXBean/ThreadStateTest.java generic-all
alanb937d5f72011-08-22 16:04:04 +0100127
smarks83dab672011-08-12 14:51:48 -0700128# 7067973
129java/lang/management/MemoryMXBean/CollectionUsageThreshold.java generic-all
130
alanb1fef1cb2012-01-16 16:30:29 +0000131############################################################################
132
133# jdk_management
134
mchung4617d272013-04-18 11:14:39 -0700135# 8010897
alanbb2f5cb42013-05-21 08:53:51 +0100136sun/management/HotspotRuntimeMBean/GetSafepointSyncTime.java macosx-all
mchung4617d272013-04-18 11:14:39 -0700137
alanb1b66ea92012-10-09 13:28:32 +0100138############################################################################
139
140# jdk_jmx
141
alanbeb8dc4a2012-02-20 19:33:32 +0000142# 6959636
143javax/management/loading/LibraryLoader/LibraryLoaderTest.java windows-all
144
ohair7aae9af2009-11-08 15:11:10 -0800145############################################################################
146
147# jdk_math
148
ohair7aae9af2009-11-08 15:11:10 -0800149############################################################################
150
alanb1b66ea92012-10-09 13:28:32 +0100151# jdk_other
ohair7aae9af2009-11-08 15:11:10 -0800152
alanb1fef1cb2012-01-16 16:30:29 +0000153# 6988950
154demo/jvmti/compiledMethodLoad/CompiledMethodLoadTest.java generic-all
155
smarks87f39cc2012-11-29 14:43:46 -0800156# 7027502
157demo/jvmti/hprof/MonitorTest.java generic-all
158
chegarfb848072013-11-07 08:04:36 +0000159# 8024423 - JVMTI: GetLoadedClasses doesn't enumerate anonymous classes
amurillo786388f2013-09-10 05:46:37 -0700160demo/jvmti/hprof/HeapAllTest.java generic-all
161demo/jvmti/hprof/HeapBinaryFormatTest.java generic-all
162demo/jvmti/hprof/HeapDumpTest.java generic-all
163demo/jvmti/hprof/OptionsTest.java generic-all
164demo/jvmti/hprof/StackMapTableTest.java generic-all
165
chegarfb848072013-11-07 08:04:36 +0000166# 8027622
167java/sql/JavatimeTest.java generic-all
168
ohair7aae9af2009-11-08 15:11:10 -0800169############################################################################
170
171# jdk_net
172
alanb22956fe2011-07-18 13:10:02 +0100173# Filed 7052625
michaelm046f7f12011-09-21 14:51:01 +0100174com/sun/net/httpserver/bugs/6725892/Test.java generic-all
alanb22956fe2011-07-18 13:10:02 +0100175
176# Filed 7036666
michaelm046f7f12011-09-21 14:51:01 +0100177com/sun/net/httpserver/Test9a.java generic-all
alanb22956fe2011-07-18 13:10:02 +0100178
michaelmfb59afb2011-10-20 09:21:03 +0100179# 7102670
180java/net/InetAddress/CheckJNI.java linux-all
181
182# failing on vista 32/64 on nightly
183# 7102702
184java/net/PortUnreachableException/OneExceptionOnly.java windows-all
alanbeb8dc4a2012-02-20 19:33:32 +0000185
alanb3290f522012-02-26 17:25:42 +0000186# 7148829
187sun/net/InetAddress/nameservice/simple/CacheTest.java generic-all
188sun/net/InetAddress/nameservice/simple/DefaultCaching.java generic-all
189
michaelm5ac8c152012-03-06 20:34:38 +0000190# 7122846
191java/net/MulticastSocket/NoLoopbackPackets.java macosx-all
192java/net/MulticastSocket/SetLoopbackMode.java macosx-all
193
194# 7145658
195java/net/MulticastSocket/Test.java macosx-all
196
chegar736dbff2013-05-17 15:00:53 +0100197# 7143960
michaelm5ac8c152012-03-06 20:34:38 +0000198java/net/DatagramSocket/SendDatagramToBadAddress.java macosx-all
199
ohair7aae9af2009-11-08 15:11:10 -0800200############################################################################
201
202# jdk_nio
203
alanb902fc682010-06-23 20:19:29 +0100204# 6963118
205java/nio/channels/Selector/Wakeup.java windows-all
ohair45110f42010-03-06 14:59:23 -0800206
alanbf9cbc922011-12-05 12:23:46 +0000207# 7052549
208java/nio/channels/FileChannel/ReleaseOnCloseDeadlock.java windows-all
alanb937d5f72011-08-22 16:04:04 +0100209
michaelm5ac8c152012-03-06 20:34:38 +0000210# 7133499, 7133497
211java/nio/channels/AsyncCloseAndInterrupt.java macosx-all
212java/nio/channels/AsynchronousFileChannel/Lock.java macosx-all
213java/nio/channels/FileChannel/Transfer.java macosx-all
214
215# 7141822
216java/nio/channels/DatagramChannel/ChangingAddress.java macosx-all
217
218# 7132677
219java/nio/channels/Selector/OutOfBand.java macosx-all
220
chegarfb848072013-11-07 08:04:36 +0000221# 8027622
222java/nio/file/attribute/FileTime/Basic.java generic-all
223
ohair7aae9af2009-11-08 15:11:10 -0800224############################################################################
225
226# jdk_rmi
227
alanb3290f522012-02-26 17:25:42 +0000228# 7146541
229java/rmi/transport/rapidExportUnexport/RapidExportUnexport.java linux-all
230
smarks65c8c8f2012-08-30 18:53:02 -0700231# 7190106
232java/rmi/reliability/benchmark/runRmiBench.sh generic-all
233
234# 7191877
235java/rmi/transport/checkLeaseInfoLeak/CheckLeaseLeak.java generic-all
236
237# 7195095
smarks87f39cc2012-11-29 14:43:46 -0800238sun/rmi/transport/proxy/EagerHttpFallback.java generic-all
smarks65c8c8f2012-08-30 18:53:02 -0700239
ohair7aae9af2009-11-08 15:11:10 -0800240############################################################################
241
242# jdk_security
243
ascarpinodbf96662013-07-29 13:43:24 -0700244# 7157786
245sun/security/pkcs11/ec/TestKeyFactory.java generic-all
ascarpinoc943c6f2013-07-19 11:34:33 -0700246
weijund122f1e2012-09-17 17:19:50 +0800247# 7164518: no PortUnreachableException on Mac
248sun/security/krb5/auto/Unreachable.java macosx-all
249
alanbeb8dc4a2012-02-20 19:33:32 +0000250# 7147060
251com/sun/org/apache/xml/internal/security/transforms/ClassLoaderTest.java generic-all
252
weijuneab31672012-09-18 17:38:43 +0800253# 6988842: 4 tests failing on Solaris 5.10
254sun/security/pkcs11/Secmod/AddPrivateKey.java solaris-all
255sun/security/pkcs11/ec/ReadCertificates.java solaris-all
256sun/security/pkcs11/ec/ReadPKCS12.java solaris-all
257sun/security/pkcs11/sslecc/ClientJSSEServerJSSE.java solaris-all
weijun6d8fea82011-08-16 08:53:03 +0800258
weijunf67a9c42013-10-23 08:32:03 +0800259# 7041639, Solaris DSA keypair generation bug
weijunc4ee9be2011-09-05 18:17:55 +0800260java/security/KeyPairGenerator/SolarisShortDSA.java solaris-all
weijunc4ee9be2011-09-05 18:17:55 +0800261sun/security/tools/keytool/standard.sh solaris-all
262
weijund2be8642012-10-22 17:01:35 +0800263# 8000439: NPG: REGRESSION : sun/security/krb5/auto/MaxRetries.java fails with timeout
264sun/security/krb5/auto/MaxRetries.java solaris-sparcv9
265
weijun60d87eb2013-03-22 19:59:14 +0800266# 8006690: sun/security/krb5/auto/BadKdc1.java fails intermittently
267sun/security/krb5/auto/BadKdc1.java solaris-sparcv9
268sun/security/krb5/auto/BadKdc2.java solaris-sparcv9
269sun/security/krb5/auto/BadKdc3.java solaris-sparcv9
270sun/security/krb5/auto/BadKdc4.java solaris-sparcv9
271
ohair7aae9af2009-11-08 15:11:10 -0800272############################################################################
273
alanbeb8dc4a2012-02-20 19:33:32 +0000274# jdk_sound
ohair7aae9af2009-11-08 15:11:10 -0800275
alanbeb8dc4a2012-02-20 19:33:32 +0000276############################################################################
277
278# jdk_swing
ohair7aae9af2009-11-08 15:11:10 -0800279
280############################################################################
281
282# jdk_text
283
ohair7aae9af2009-11-08 15:11:10 -0800284############################################################################
285
chegar9f70b3b2013-06-19 15:58:21 +0100286# jdk_time
287
chegarfb848072013-11-07 08:04:36 +0000288# 8027622
289java/time/tck/java/time/TCKClock_Tick.java generic-all
290java/time/tck/java/time/TCKDuration.java generic-all
291java/time/tck/java/time/TCKInstant.java generic-all
292java/time/tck/java/time/TCKLocalDate.java generic-all
293java/time/tck/java/time/TCKLocalDateTime.java generic-all
294java/time/tck/java/time/TCKLocalTime.java generic-all
295java/time/tck/java/time/TCKMonthDay.java generic-all
296java/time/tck/java/time/TCKOffsetDateTime.java generic-all
297java/time/tck/java/time/TCKOffsetTime.java generic-all
298java/time/tck/java/time/TCKYear.java generic-all
299java/time/tck/java/time/TCKYearMonth.java generic-all
300java/time/tck/java/time/TCKZonedDateTime.java generic-all
301java/time/tck/java/time/temporal/TCKWeekFields.java generic-all
302java/time/test/java/time/TestClock_Fixed.java generic-all
303java/time/test/java/time/TestOffsetDateTime_instants.java generic-all
304java/time/test/java/time/format/TestZoneTextPrinterParser.java generic-all
305java/time/test/java/time/temporal/TestChronoUnit.java generic-all
306java/time/test/java/util/TestFormatter.java generic-all
307
chegar9f70b3b2013-06-19 15:58:21 +0100308############################################################################
309
ohair7aae9af2009-11-08 15:11:10 -0800310# jdk_tools
311
alanb38a5cf62012-02-12 21:09:09 +0000312# 6461635
313com/sun/tools/attach/BasicTests.sh generic-all
314
alanb1b66ea92012-10-09 13:28:32 +0100315# 7132203
316sun/jvmstat/monitor/MonitoredVm/CR6672135.java generic-all
317
ksrinid902b5c2013-02-10 08:07:59 -0800318# Tests take too long, on sparcs see 7143279
alanbb2f5cb42013-05-21 08:53:51 +0100319tools/pack200/CommandLineTests.java solaris-all, macosx-all
ksrinid902b5c2013-02-10 08:07:59 -0800320tools/pack200/Pack200Test.java solaris-all, macosx-all
alanb1b66ea92012-10-09 13:28:32 +0100321
ksrinie4e71992013-02-01 22:18:18 -0800322# 8007410
323tools/launcher/FXLauncherTest.java linux-all
324
alanb1b66ea92012-10-09 13:28:32 +0100325############################################################################
326
327# jdk_jdi
328
ohairaf343022010-09-24 14:22:01 -0700329# Filed 6952105
michaelm046f7f12011-09-21 14:51:01 +0100330com/sun/jdi/SuspendThreadTest.java generic-all
ohairaf343022010-09-24 14:22:01 -0700331
alanb22956fe2011-07-18 13:10:02 +0100332# Filed 6653793
michaelm046f7f12011-09-21 14:51:01 +0100333com/sun/jdi/RedefineCrossEvent.java generic-all
alanb22956fe2011-07-18 13:10:02 +0100334
alanb22956fe2011-07-18 13:10:02 +0100335# Filed 6402201
michaelm046f7f12011-09-21 14:51:01 +0100336com/sun/jdi/ProcessAttachTest.sh generic-all
alanb22956fe2011-07-18 13:10:02 +0100337
ohair7aae9af2009-11-08 15:11:10 -0800338############################################################################
339
340# jdk_util
341
ohairaf343022010-09-24 14:22:01 -0700342# Filed 6933803
michaelm046f7f12011-09-21 14:51:01 +0100343java/util/concurrent/ThreadPoolExecutor/CoreThreadTimeOut.java generic-all
ohairaf343022010-09-24 14:22:01 -0700344
alanb22956fe2011-07-18 13:10:02 +0100345# Filed 6772009
ohair7aae9af2009-11-08 15:11:10 -0800346java/util/concurrent/locks/ReentrantLock/CancelledLockLoops.java generic-all
347
chegarfb848072013-11-07 08:04:36 +0000348# 8027622
349java/util/Calendar/JavatimeTest.java generic-all
aefimov94e8ea62013-10-24 17:23:26 +0400350
ohair7aae9af2009-11-08 15:11:10 -0800351############################################################################