blob: 59c348580bdda2e55ed123cd383c8eca88d8a0f4 [file] [log] [blame]
ohair7aae9af2009-11-08 15:11:10 -08001###########################################################################
2#
slac9faa842012-02-24 20:09:49 +01003# Copyright (c) 2009, 2012, Oracle and/or its affiliates. All rights reserved.
ohair7aae9af2009-11-08 15:11:10 -08004# DO NOT ALTER OR REMOVE COPYRIGHT NOTICES OR THIS FILE HEADER.
5#
6# This code is free software; you can redistribute it and/or modify it
7# under the terms of the GNU General Public License version 2 only, as
ohair2283b9d2010-05-25 15:58:33 -07008# published by the Free Software Foundation. Oracle designates this
ohair7aae9af2009-11-08 15:11:10 -08009# particular file as subject to the "Classpath" exception as provided
ohair2283b9d2010-05-25 15:58:33 -070010# by Oracle in the LICENSE file that accompanied this code.
ohair7aae9af2009-11-08 15:11:10 -080011#
12# This code is distributed in the hope that it will be useful, but WITHOUT
13# ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
14# FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License
15# version 2 for more details (a copy is included in the LICENSE file that
16# accompanied this code).
17#
18# You should have received a copy of the GNU General Public License version
19# 2 along with this work; if not, write to the Free Software Foundation,
20# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA.
21#
ohair2283b9d2010-05-25 15:58:33 -070022# Please contact Oracle, 500 Oracle Parkway, Redwood Shores, CA 94065 USA
23# or visit www.oracle.com if you need additional information or have any
24# questions.
ohair7aae9af2009-11-08 15:11:10 -080025#
26###########################################################################
27#
28# List of tests that should not be run by test/Makefile, for various reasons:
29# 1. Does not run with jtreg -samevm mode
30# 2. Causes problems in jtreg -samevm mode for jtreg or tests that follow it
31# 3. The test is too slow or consumes too many system resources
32# 4. The test fails when run on any official build systems
33#
34# It is possible that a test being on this list is a mistake, and that some
35# other test in samevm mode caused tests to fail, mistakes happen.
36#
37# Tests marked @ignore are not run by test/Makefile, but harmless to be listed.
38#
39# Tests that explicitly state "@run main/othervm ...", and are not listed here,
40# will be run in the same batch as the samevm tests.
41#
42# Shell tests are othervm by default.
43#
mduigou76a5cac2011-02-21 13:37:22 -080044# List items are testnames followed by labels, all MUST BE commented
ohair7aae9af2009-11-08 15:11:10 -080045# as to why they are here and use a label:
michaelm046f7f12011-09-21 14:51:01 +010046# generic-all Problems on all platforms
47# generic-ARCH Where ARCH is one of: sparc, sparcv9, x64, i586, etc.
48# OSNAME-all Where OSNAME is one of: solaris, linux, windows
49# OSNAME-ARCH Specific on to one OSNAME and ARCH, e.g. solaris-x64
50# OSNAME-REV Specific on to one OSNAME and REV, e.g. solaris-5.8
mduigou76a5cac2011-02-21 13:37:22 -080051#
ohair7aae9af2009-11-08 15:11:10 -080052# More than one label is allowed but must be on the same line.
53#
54#############################################################################
55#
56# Running the tests:
57# cd test && make JT_HOME=jtreg_home PRODUCT_HOME=jdk_home jdk_all
58# Or instead of jdk_all, use any of the jdk_* targets.
59#
60# Samevm Notes:
61# * Although some tests may have only been seen to fail on some platforms,
62# they might be flagged as 'generic-all' because the problem they have
63# could cause hidden slowdowns on other platforms.
64# Most samevm problems will be generic-all, but windows usually dislikes
65# them the most.
66# Address already in use or connection errors indicate a generic port issue.
67# (this is not necessarily a samevm issue, but an issue for running the tests
68# on shared machines, two people or two test runs will collide).
69# * Samevm problem (windows in particular) is not closing all input/output
70# * Samevm problem when a test calls setSecurityManager()
71# * Samevm problem with setHttps*() is used? (not exactly sure here)
72# * Samevm problem when stuffing system properties with non Strings or anything
73# * Samevm problem when changing vm settings, or registering any vm actions
74# * Samevm problems with deleteOnExit(), if it must happen at end of test
75# * Samevm problems with URLClassLoader? (no details here)
76# * Samevm problems with dependence on predictable GC or finalizations
77#
78# Any of the above problems may mean the test needs to be flagged as "othervm".
79#
80#############################################################################
81#
82# Fixing the tests:
83#
84# Some tests just may need to be run with "othervm", and that can easily be
85# done my adding a @run line (or modifying any existing @run):
86# @run main/othervm NameOfMainClass
87# Make sure this @run follows any use of @library.
88# Otherwise, if the test is a samevm possibility, make sure the test is
89# cleaning up after itself, closing all streams, deleting temp files, etc.
90#
91# Keep in mind that the bug could be in many places, and even different per
92# platform, it could be a bug in any one of:
93# - the testcase
94# - the jdk (jdk classes, native code, or hotspot)
95# - the native compiler
96# - the javac compiler
97# - the OS (depends on what the testcase does)
98#
99# If you managed to really fix one of these tests, here is how you can
100# remove tests from this list:
101# 1. Make sure test passes on all platforms with samevm, or mark it othervm
102# 2. Make sure test passes on all platforms when run with it's entire group
103# 3. Make sure both VMs are tested, -server and -client, if possible
104# 4. Make sure you try the -d64 option on Solaris
105# 5. Use a tool like JPRT or something to verify these results
106# 6. Delete lines in this file, include the changes with your test changes
107#
108# You may need to repeat your testing 2 or even 3 times to verify good
109# results, some of these samevm failures are not very predictable.
110#
111#############################################################################
112
113############################################################################
114
115# jdk_awt
116
ohair7aae9af2009-11-08 15:11:10 -0800117############################################################################
118
119# jdk_beans
120
ohair7aae9af2009-11-08 15:11:10 -0800121############################################################################
122
ohair7aae9af2009-11-08 15:11:10 -0800123# jdk_lang
124
dcubeda2f4c2c2012-08-28 09:40:27 -0700125# 7194607
126java/lang/instrument/VerifyLocalVariableTableOnRetransformTest.sh generic-all
127
alanb937d5f72011-08-22 16:04:04 +0100128# 6944188
michaelm046f7f12011-09-21 14:51:01 +0100129java/lang/management/ThreadMXBean/ThreadStateTest.java generic-all
alanb937d5f72011-08-22 16:04:04 +0100130
smarks83dab672011-08-12 14:51:48 -0700131# 7067973
132java/lang/management/MemoryMXBean/CollectionUsageThreshold.java generic-all
133
alanb3290f522012-02-26 17:25:42 +0000134# 7148492
135java/lang/management/MemoryMXBean/ResetPeakMemoryUsage.java generic-all
136
jcoomescf866b62012-09-14 15:02:24 -0700137# 7196801
138java/lang/management/MemoryMXBean/LowMemoryTest2.sh generic-all
139
jcoomesf9c7b0f2012-09-14 16:04:01 -0700140# Exclude until the fix for 7195557 propagates widely.
141java/lang/management/MemoryMXBean/CollectionUsageThresholdParallelGC.sh generic-all
142java/lang/management/MemoryMXBean/CollectionUsageThresholdSerialGC.sh generic-all
143java/lang/management/MemoryMXBean/MemoryTest.java generic-all
144java/lang/management/MemoryMXBean/MemoryTestAllGC.sh generic-all
145
alanb1fef1cb2012-01-16 16:30:29 +0000146############################################################################
147
148# jdk_management
149
alanb1b66ea92012-10-09 13:28:32 +0100150############################################################################
151
152# jdk_jmx
153
alanbeb8dc4a2012-02-20 19:33:32 +0000154# 6959636
155javax/management/loading/LibraryLoader/LibraryLoaderTest.java windows-all
156
157# 7144846
158javax/management/remote/mandatory/connection/ReconnectTest.java generic-all
159
sladd711372012-09-17 11:27:25 +0200160# 7120365
161javax/management/remote/mandatory/notif/DiffHBTest.java generic-all
162
ohair7aae9af2009-11-08 15:11:10 -0800163############################################################################
164
165# jdk_math
166
ohair7aae9af2009-11-08 15:11:10 -0800167############################################################################
168
alanb1b66ea92012-10-09 13:28:32 +0100169# jdk_other
ohair7aae9af2009-11-08 15:11:10 -0800170
alanb1fef1cb2012-01-16 16:30:29 +0000171# 6988950
172demo/jvmti/compiledMethodLoad/CompiledMethodLoadTest.java generic-all
173
michaelm733d6002012-04-18 16:04:19 +0100174# 7162111
175demo/jvmti/mtrace/TraceJFrame.java macosx-all
176javax/script/CauseExceptionTest.java macosx-all
177javax/script/GetInterfaceTest.java macosx-all
178javax/script/JavaScriptScopeTest.java macosx-all
179javax/script/NullUndefinedVarTest.java macosx-all
180javax/script/PluggableContextTest.java macosx-all
181javax/script/ProviderTest.sh macosx-all
182javax/script/RhinoExceptionTest.java macosx-all
183javax/script/StringWriterPrintTest.java macosx-all
184javax/script/Test1.java macosx-all
185javax/script/Test2.java macosx-all
186javax/script/Test3.java macosx-all
187javax/script/Test4.java macosx-all
188javax/script/Test5.java macosx-all
189javax/script/Test6.java macosx-all
190javax/script/Test7.java macosx-all
191javax/script/Test8.java macosx-all
192javax/script/UnescapedBracketRegExTest.java macosx-all
193javax/script/VersionTest.java macosx-all
ohair7aae9af2009-11-08 15:11:10 -0800194############################################################################
195
196# jdk_net
197
alanb22956fe2011-07-18 13:10:02 +0100198# Filed 7052625
michaelm046f7f12011-09-21 14:51:01 +0100199com/sun/net/httpserver/bugs/6725892/Test.java generic-all
alanb22956fe2011-07-18 13:10:02 +0100200
201# Filed 7036666
michaelm046f7f12011-09-21 14:51:01 +0100202com/sun/net/httpserver/Test9a.java generic-all
alanb22956fe2011-07-18 13:10:02 +0100203
weijun6d8fea82011-08-16 08:53:03 +0800204# 7079145 java/net/ipv6tests/UdpTest.java hang at IPv6 only data exchange
205java/net/ipv6tests/UdpTest.java linux-all
206
michaelmfb59afb2011-10-20 09:21:03 +0100207# 7102670
208java/net/InetAddress/CheckJNI.java linux-all
209
210# failing on vista 32/64 on nightly
211# 7102702
212java/net/PortUnreachableException/OneExceptionOnly.java windows-all
alanbeb8dc4a2012-02-20 19:33:32 +0000213
alanb3290f522012-02-26 17:25:42 +0000214# 7148829
215sun/net/InetAddress/nameservice/simple/CacheTest.java generic-all
216sun/net/InetAddress/nameservice/simple/DefaultCaching.java generic-all
217
michaelm5ac8c152012-03-06 20:34:38 +0000218# 7122846
219java/net/MulticastSocket/NoLoopbackPackets.java macosx-all
220java/net/MulticastSocket/SetLoopbackMode.java macosx-all
221
222# 7145658
223java/net/MulticastSocket/Test.java macosx-all
224
225#7143960
226java/net/DatagramSocket/SendDatagramToBadAddress.java macosx-all
227
228# 7150552
229sun/net/www/protocol/http/B6299712.java macosx-all
230java/net/CookieHandler/CookieManagerTest.java macosx-all
231
ohair7aae9af2009-11-08 15:11:10 -0800232############################################################################
233
alanb902fc682010-06-23 20:19:29 +0100234# jdk_io
235
alanbb1af3402012-08-24 19:35:30 +0100236# 7162111 - these tests need to be updated to run headless
michaelm5ac8c152012-03-06 20:34:38 +0000237java/io/Serializable/resolveClass/deserializeButton/run.sh macosx-all
alanbb1af3402012-08-24 19:35:30 +0100238java/io/Serializable/serialver/classpath/run.sh macosx-all
239java/io/Serializable/serialver/nested/run.sh macosx-all
michaelm5ac8c152012-03-06 20:34:38 +0000240
alanb902fc682010-06-23 20:19:29 +0100241############################################################################
242
ohair7aae9af2009-11-08 15:11:10 -0800243# jdk_nio
244
alanb902fc682010-06-23 20:19:29 +0100245# 6963118
246java/nio/channels/Selector/Wakeup.java windows-all
ohair45110f42010-03-06 14:59:23 -0800247
alanbf9cbc922011-12-05 12:23:46 +0000248# 7052549
249java/nio/channels/FileChannel/ReleaseOnCloseDeadlock.java windows-all
alanb937d5f72011-08-22 16:04:04 +0100250
michaelm5ac8c152012-03-06 20:34:38 +0000251# 7133499, 7133497
252java/nio/channels/AsyncCloseAndInterrupt.java macosx-all
253java/nio/channels/AsynchronousFileChannel/Lock.java macosx-all
254java/nio/channels/FileChannel/Transfer.java macosx-all
255
256# 7141822
257java/nio/channels/DatagramChannel/ChangingAddress.java macosx-all
258
259# 7132677
260java/nio/channels/Selector/OutOfBand.java macosx-all
261
ohair7aae9af2009-11-08 15:11:10 -0800262############################################################################
263
264# jdk_rmi
265
alanb3290f522012-02-26 17:25:42 +0000266# 7146541
267java/rmi/transport/rapidExportUnexport/RapidExportUnexport.java linux-all
268
smarks65c8c8f2012-08-30 18:53:02 -0700269# 7187882
270java/rmi/activation/checkusage/CheckUsage.java generic-all
271
272# 7190106
273java/rmi/reliability/benchmark/runRmiBench.sh generic-all
274
275# 7191877
276java/rmi/transport/checkLeaseInfoLeak/CheckLeaseLeak.java generic-all
277
278# 7195095
279sun/rmi/transport/proxy/EagerHttpFallback.java linux-all
280
ohair7aae9af2009-11-08 15:11:10 -0800281############################################################################
282
283# jdk_security
284
weijund122f1e2012-09-17 17:19:50 +0800285# 7164518: no PortUnreachableException on Mac
286sun/security/krb5/auto/Unreachable.java macosx-all
287
alanbb1af3402012-08-24 19:35:30 +0100288# 7193792
289sun/security/pkcs11/ec/TestECDSA.java solaris-all
290sun/security/pkcs11/ec/TestECDSA.java linux-all
291
292# 7193793
293sun/security/pkcs11/ec/TestECDH.java linux-all
294
weijuneab31672012-09-18 17:38:43 +0800295# 7198198: the test also fails on SuSE Linux
296sun/security/pkcs11/ec/ReadCertificates.java linux-all
297
alanbeb8dc4a2012-02-20 19:33:32 +0000298# 7147060
299com/sun/org/apache/xml/internal/security/transforms/ClassLoaderTest.java generic-all
300
weijuneab31672012-09-18 17:38:43 +0800301# 6988842: 4 tests failing on Solaris 5.10
302sun/security/pkcs11/Secmod/AddPrivateKey.java solaris-all
303sun/security/pkcs11/ec/ReadCertificates.java solaris-all
304sun/security/pkcs11/ec/ReadPKCS12.java solaris-all
305sun/security/pkcs11/sslecc/ClientJSSEServerJSSE.java solaris-all
weijun6d8fea82011-08-16 08:53:03 +0800306
weijunc4ee9be2011-09-05 18:17:55 +0800307# 7041639, Solaris DSA keypair generation bug (Note: jdk_util also affected)
308java/security/KeyPairGenerator/SolarisShortDSA.java solaris-all
309sun/security/tools/jarsigner/onlymanifest.sh solaris-all
310sun/security/tools/jarsigner/ts.sh solaris-all
311sun/security/tools/keytool/emptysubject.sh solaris-all
312sun/security/tools/keytool/importreadall.sh solaris-all
313sun/security/tools/keytool/readjar.sh solaris-all
314sun/security/tools/keytool/selfissued.sh solaris-all
315sun/security/tools/keytool/standard.sh solaris-all
316
ohair7aae9af2009-11-08 15:11:10 -0800317############################################################################
318
alanbeb8dc4a2012-02-20 19:33:32 +0000319# jdk_sound
ohair7aae9af2009-11-08 15:11:10 -0800320
alanbeb8dc4a2012-02-20 19:33:32 +0000321############################################################################
322
323# jdk_swing
ohair7aae9af2009-11-08 15:11:10 -0800324
325############################################################################
326
327# jdk_text
328
naotocd0f04f2012-09-18 10:34:36 -0700329# 7196199
330java/text/Bidi/Bug6665028.java generic-all
alanb1b66ea92012-10-09 13:28:32 +0100331
ohair7aae9af2009-11-08 15:11:10 -0800332############################################################################
333
334# jdk_tools
335
alanb38a5cf62012-02-12 21:09:09 +0000336# 6461635
337com/sun/tools/attach/BasicTests.sh generic-all
338
alanb1b66ea92012-10-09 13:28:32 +0100339# 7172176
340sun/tools/jconsole/ResourceCheckTest.sh generic-all
341sun/tools/jconsole/ImmutableResourceTest.sh generic-all
342
343# 7132203
344sun/jvmstat/monitor/MonitoredVm/CR6672135.java generic-all
345
346# Tests take too long, see 7143279
347tools/pack200/CommandLineTests.java generic-all
348tools/pack200/Pack200Test.java generic-all
349
350# 7150569
351tools/launcher/UnicodeTest.java macosx-all
352
353############################################################################
354
355# jdk_jdi
356
ohairaf343022010-09-24 14:22:01 -0700357# Filed 6952105
michaelm046f7f12011-09-21 14:51:01 +0100358com/sun/jdi/SuspendThreadTest.java generic-all
ohairaf343022010-09-24 14:22:01 -0700359
alanb22956fe2011-07-18 13:10:02 +0100360# Filed 6653793
michaelm046f7f12011-09-21 14:51:01 +0100361com/sun/jdi/RedefineCrossEvent.java generic-all
alanb22956fe2011-07-18 13:10:02 +0100362
363# Filed 6987312
michaelm046f7f12011-09-21 14:51:01 +0100364com/sun/jdi/DoubleAgentTest.java generic-all
alanb22956fe2011-07-18 13:10:02 +0100365
366# Filed 7020857
michaelm046f7f12011-09-21 14:51:01 +0100367com/sun/jdi/FieldWatchpoints.java generic-all
alanb22956fe2011-07-18 13:10:02 +0100368
369# Filed 6402201
michaelm046f7f12011-09-21 14:51:01 +0100370com/sun/jdi/ProcessAttachTest.sh generic-all
alanb22956fe2011-07-18 13:10:02 +0100371
ohair7aae9af2009-11-08 15:11:10 -0800372############################################################################
373
374# jdk_util
375
alanbb1af3402012-08-24 19:35:30 +0100376# 7162111 - test needs to be changed to run headless
377java/util/ResourceBundle/Control/Bug6530694.java macosx-all
378
ohairaf343022010-09-24 14:22:01 -0700379# Filed 6933803
michaelm046f7f12011-09-21 14:51:01 +0100380java/util/concurrent/ThreadPoolExecutor/CoreThreadTimeOut.java generic-all
ohairaf343022010-09-24 14:22:01 -0700381
alanb22956fe2011-07-18 13:10:02 +0100382# Filed 6772009
ohair7aae9af2009-11-08 15:11:10 -0800383java/util/concurrent/locks/ReentrantLock/CancelledLockLoops.java generic-all
384
weijunc4ee9be2011-09-05 18:17:55 +0800385# 7041639, Solaris DSA keypair generation bug
386java/util/TimeZone/TimeZoneDatePermissionCheck.sh solaris-all
387
ohair7aae9af2009-11-08 15:11:10 -0800388############################################################################