blob: 00e820b12ee1e3873b0bca595136e0b5b0863061 [file] [log] [blame]
vprovodin29bc7ae2016-09-13 12:12:33 +07001###########################################################################
2#
3# List of tests that should not be run by test/Makefile, for various reasons:
4# 1. Does not run with jtreg -samevm mode
5# 2. Causes problems in jtreg -samevm mode for jtreg or tests that follow it
6# 3. The test is too slow or consumes too many system resources
7# 4. The test fails when run on any official build systems
8#
9# It is possible that a test being on this list is a mistake, and that some
10# other test in samevm mode caused tests to fail, mistakes happen.
11#
12# Tests marked @ignore are not run by test/Makefile, but harmless to be listed.
13#
14# Tests that explicitly state "@run main/othervm ...", and are not listed here,
15# will be run in the same batch as the samevm tests.
16#
17# Shell tests are othervm by default.
18#
19# List items are testnames followed by labels, all MUST BE commented
20# as to why they are here and use a label:
21# generic-all Problems on all platforms
22# generic-ARCH Where ARCH is one of: sparc, sparcv9, x64, i586, etc.
23# OSNAME-all Where OSNAME is one of: solaris, linux, windows, macosx, aix
24# OSNAME-ARCH Specific on to one OSNAME and ARCH, e.g. solaris-amd64
25# OSNAME-REV Specific on to one OSNAME and REV, e.g. solaris-5.8
26#
27# More than one label is allowed but must be on the same line.
28#
29#############################################################################
30#
31# Running the tests:
32# cd test && make JT_HOME=jtreg_home PRODUCT_HOME=jdk_home jdk_all
33# Or instead of jdk_all, use any of the jdk_* targets.
34#
35# Samevm Notes:
36# * Although some tests may have only been seen to fail on some platforms,
37# they might be flagged as 'generic-all' because the problem they have
38# could cause hidden slowdowns on other platforms.
39# Most samevm problems will be generic-all, but windows usually dislikes
40# them the most.
41# Address already in use or connection errors indicate a generic port issue.
42# (this is not necessarily a samevm issue, but an issue for running the tests
43# on shared machines, two people or two test runs will collide).
44# * Samevm problem (windows in particular) is not closing all input/output
45# * Samevm problem when a test calls setSecurityManager()
46# * Samevm problem with setHttps*() is used? (not exactly sure here)
47# * Samevm problem when stuffing system properties with non Strings or anything
48# * Samevm problem when changing vm settings, or registering any vm actions
49# * Samevm problems with deleteOnExit(), if it must happen at end of test
50# * Samevm problems with URLClassLoader? (no details here)
51# * Samevm problems with dependence on predictable GC or finalizations
52#
53# Any of the above problems may mean the test needs to be flagged as "othervm".
54#
55#############################################################################
56#
57# Fixing the tests:
58#
59# Some tests just may need to be run with "othervm", and that can easily be
60# done my adding a @run line (or modifying any existing @run):
61# @run main/othervm NameOfMainClass
62# Make sure this @run follows any use of @library.
63# Otherwise, if the test is a samevm possibility, make sure the test is
64# cleaning up after itself, closing all streams, deleting temp files, etc.
65#
66# Keep in mind that the bug could be in many places, and even different per
67# platform, it could be a bug in any one of:
68# - the testcase
69# - the jdk (jdk classes, native code, or hotspot)
70# - the native compiler
71# - the javac compiler
72# - the OS (depends on what the testcase does)
73#
74# If you managed to really fix one of these tests, here is how you can
75# remove tests from this list:
76# 1. Make sure test passes on all platforms with samevm, or mark it othervm
77# 2. Make sure test passes on all platforms when run with it's entire group
78# 3. Make sure both VMs are tested, -server and -client, if possible
79# 4. Make sure you try the -d64 option on Solaris
80# 5. Use a tool like JPRT or something to verify these results
81# 6. Delete lines in this file, include the changes with your test changes
82#
83# You may need to repeat your testing 2 or even 3 times to verify good
84# results, some of these samevm failures are not very predictable.
85#
86#############################################################################
87
88############################################################################
89
90# jdk_awt
91
vprovodinf10a8df2016-09-16 14:43:40 +070092# https://bugs.openjdk.java.net/browse/JDK-8075487
93java/awt/Choice/ChoiceKeyEventReaction/ChoiceKeyEventReaction.html macosx-all
94
vprovodind2f9ed82016-09-14 15:10:40 +070095# https://bugs.openjdk.java.net/browse/JDK-6990210
vprovodinf10a8df2016-09-16 14:43:40 +070096java/awt/EventDispatchThread/HandleExceptionOnEDT/HandleExceptionOnEDT.java generic-all
vprovodind2f9ed82016-09-14 15:10:40 +070097
vprovodin29bc7ae2016-09-13 12:12:33 +070098# https://bugs.openjdk.java.net/browse/JDK-4931413
vprovodind2f9ed82016-09-14 15:10:40 +070099java/awt/EventDispatchThread/LoopRobustness/LoopRobustness.html linux-all
100
vprovodinf10a8df2016-09-16 14:43:40 +0700101# https://bugs.openjdk.java.net/browse/JDK-6862004
102java/awt/Focus/AppletInitialFocusTest/AppletInitialFocusTest.html windows-all linux-all
103
104# https://bugs.openjdk.java.net/browse/JDK-6849367
105java/awt/Focus/AppletInitialFocusTest/AppletInitialFocusTest1.html generic-all
106
vprovodind2f9ed82016-09-14 15:10:40 +0700107# similar to
108# http://bugs.java.com/bugdatabase/view_bug.do?bug_id=6848406
vprovodinf10a8df2016-09-16 14:43:40 +0700109java/awt/Focus/AutoRequestFocusTest/AutoRequestFocusToFrontTest.java generic-all
110
111# https://bugs.openjdk.java.net/browse/JDK-6829264
112java/awt/Focus/ActualFocusedWindowTest/ActualFocusedWindowRetaining.java generic-all
vprovodind2f9ed82016-09-14 15:10:40 +0700113
114# similar to
115# https://bugs.openjdk.java.net/browse/JDK-7191928
116java/awt/Focus/ConsumeNextKeyTypedOnModalShowTest/ConsumeNextKeyTypedOnModalShowTest.java windows-all
117
118# https://bugs.openjdk.java.net/browse/JDK-7156130 (open)
vprovodinf10a8df2016-09-16 14:43:40 +0700119java/awt/Focus/ToFrontFocusTest/ToFrontFocus.html generic-all
vprovodind2f9ed82016-09-14 15:10:40 +0700120
vprovodinf10a8df2016-09-16 14:43:40 +0700121# http://bugs.java.com/bugdatabase/view_bug.do?bug_id=6848810
122# https://bugs.openjdk.java.net/browse/JDK-7035459
123java/awt/Focus/TranserFocusToWindow/TranserFocusToWindow.java generic-all
124
125#http://bugs.java.com/bugdatabase/view_bug.do?bug_id=8076151
126java/awt/FontClass/CreateFont/fileaccess/FontFile.java generic-all
127
128# http://bugs.java.com/bugdatabase/view_bug.do?bug_id=8080953
129java/awt/FontClass/DebugFonts.java generic-all
130
131#https://bugs.openjdk.java.net/browse/JDK-8047218
132java/awt/FullScreen/AltTabCrashTest/AltTabCrashTest.java generic-all
133
134# https://bugs.openjdk.java.net/browse/JDK-8001214
135java/awt/Frame/MaximizedToIconified/MaximizedToIconified.java generic-all
136
137# https://bugs.openjdk.java.net/browse/JDK-8144042
138java/awt/Mouse/EnterExitEvents/ResizingFrameTest.java generic-all
vprovodin29bc7ae2016-09-13 12:12:33 +0700139
140# https://bugs.openjdk.java.net/browse/JDK-8129775
vprovodind2f9ed82016-09-14 15:10:40 +0700141java/awt/Mouse/MouseDragEvent/MouseDraggedTest.java linux-all
vprovodin29bc7ae2016-09-13 12:12:33 +0700142
143# https://bugs.openjdk.java.net/browse/JDK-8148041
vprovodind2f9ed82016-09-14 15:10:40 +0700144java/awt/Mouse/TitleBarDoubleClick/TitleBarDoubleClick.html linux-all
145
146# https://bugs.openjdk.java.net/browse/JDK-6829267
147java/awt/Toolkit/ToolkitPropertyTest/ToolkitPropertyTest_Enable.java linux-all
148
149# http://bugs.java.com/view_bug.do?bug_id=8039081
150java/awt/TrayIcon/PopupMenuLeakTest/PopupMenuLeakTest.java generic-all
151
152# https://bugs.openjdk.java.net/browse/JDK-7107528
153java/awt/Robot/AcceptExtraMouseButtons/AcceptExtraMouseButtons.java generic-all
154
155# https://bugs.openjdk.java.net/browse/JDK-8080982
156java/awt/datatransfer/DragImage/MultiResolutionDragImageTest.java linux-all windows-all
157
158# https://bugs.openjdk.java.net/browse/JDK-8039082
159java/awt/dnd/BadSerializaionTest/BadSerializationTest.java generic-all
160
161# https://bugs.openjdk.java.net/browse/JDK-7098447
162java/awt/dnd/ImageTransferTest/ImageTransferTest.java generic-all
163
164# https://bugs.openjdk.java.net/browse/JDK-8030121
165java/awt/dnd/MissingDragExitEventTest/MissingDragExitEventTest.java linux-all
166
167# https://bugs.openjdk.java.net/browse/JDK-8056077
168java/awt/image/DrawImage/IncorrectAlphaSurface2SW.java linux-all
169
170# https://bugs.openjdk.java.net/browse/JDK-8130400
171java/awt/image/DrawImage/IncorrectClipXorModeSW2Surface.java linux-all
172java/awt/image/DrawImage/IncorrectClipXorModeSurface2Surface.java linux-all
173
vprovodinf10a8df2016-09-16 14:43:40 +0700174# no printer found
175java/awt/print/PrinterJob/ExceptionTest.java generic-all
176java/awt/print/PrinterJob/ImagePrinting/NullClipARGB.java generic-all
177java/awt/print/PrinterJob/PrtException.java generic-all
178
vprovodind2f9ed82016-09-14 15:10:40 +0700179############################################################################
180
181# jdk_sound
182
183## https://bugs.openjdk.java.net/browse/JDK-8134632 (fixed in jdk9)
184javax/sound/midi/Devices/InitializationHang.java linux-all
vprovodin29bc7ae2016-09-13 12:12:33 +0700185
186############################################################################
187
188# jdk_beans
189
vprovodind2f9ed82016-09-14 15:10:40 +0700190# https://bugs.openjdk.java.net/browse/JDK-8030123
191java/beans/Introspector/Test8027648.java linux-all
192
193############################################################################
194
195# jdk_io
196
197# Test ignored: This test has huge memory requirements
198java/io/ByteArrayOutputStream/MaxCapacity.java generic-all
199
200# Test ignored: until 6492634 and 6501010 is fixed
201# http://bugs.java.com/view_bug.do?bug_id=6492634
202# http://bugs.java.com/view_bug.do?bug_id=6501010
203java/io/File/GetXSpace.java generic-all
204
205# Test ignored: Test truncates system files when run as root, see 7042603
206# http://bugs.java.com/view_bug.do?bug_id=7042603
207java/io/IOException/LastErrorString.java generic-all
208
209# Test ignored: This test requires console (/dev/tty) input, which is not supported by the current harness
210java/io/SystemInAvailable.java generic-all
211
vprovodin29bc7ae2016-09-13 12:12:33 +0700212############################################################################
213
214# jdk_lang
215
vprovodind2f9ed82016-09-14 15:10:40 +0700216# Test ignored: until bug 6835233 dealt with
217# http://bugs.java.com/view_bug.do?bug_id=6835233
218java/lang/instrument/ParallelTransformerLoader.sh generic-all
219
220# Test ignored: 8078602
221# http://bugs.java.com/view_bug.do?bug_id=8078602
222java/lang/invoke/LFCaching/LFGarbageCollectedTest.java generic-all
223
vprovodin29bc7ae2016-09-13 12:12:33 +0700224############################################################################
225
226# jdk_management
227
228# 8028150
229sun/management/jmxremote/bootstrap/RmiSslBootstrapTest.sh windows-all
230
231############################################################################
232
233# jdk_jmx
234
235# 8030957
236com/sun/management/OperatingSystemMXBean/GetProcessCpuLoad.java aix-all
237com/sun/management/OperatingSystemMXBean/GetSystemCpuLoad.java aix-all
238javax/management/MBeanServer/OldMBeanServerTest.java aix-all
239
240############################################################################
241
242# jdk_math
243
244############################################################################
245
246# jdk_other
247
248# 6988950
249demo/jvmti/compiledMethodLoad/CompiledMethodLoadTest.java generic-all
250
251# 7027502
252demo/jvmti/hprof/MonitorTest.java generic-all
253
254# 8027973
255javax/xml/jaxp/transform/jdk8004476/XSLTExFuncTest.java windows-all
256
vprovodind2f9ed82016-09-14 15:10:40 +0700257# no printer found
258javax/print/CheckDupFlavor.java generic-all
259javax/print/PrintServiceLookup/CountPrintServices.java generic-all
260javax/print/attribute/AttributeTest.java generic-all
261javax/print/attribute/GetCopiesSupported.java generic-all
262javax/print/attribute/SidesPageRangesTest.java generic-all
263javax/print/attribute/SupportedPrintableAreas.java generic-all
264
vprovodin29bc7ae2016-09-13 12:12:33 +0700265############################################################################
266
267# jdk_net
268
269# Filed 7052625
270com/sun/net/httpserver/bugs/6725892/Test.java generic-all
271
272# failing on vista 32/64 on nightly
273# 7102702
274java/net/PortUnreachableException/OneExceptionOnly.java windows-all
275
276# 7148829
277sun/net/InetAddress/nameservice/simple/CacheTest.java generic-all
278sun/net/InetAddress/nameservice/simple/DefaultCaching.java generic-all
279
280# 7122846
281java/net/MulticastSocket/NoLoopbackPackets.java macosx-all
282java/net/MulticastSocket/SetLoopbackMode.java macosx-all
283
284# 7145658
285java/net/MulticastSocket/Test.java macosx-all
286
287# 7143960
288java/net/DatagramSocket/SendDatagramToBadAddress.java macosx-all
289
290############################################################################
291
292# jdk_nio
293
294# 6963118
295java/nio/channels/Selector/Wakeup.java windows-all
296
297# 7141822
298java/nio/channels/DatagramChannel/ChangingAddress.java macosx-all
299
vprovodinf10a8df2016-09-16 14:43:40 +0700300# https://bugs.openjdk.java.net/browse/JDK-8137230
301java/nio/channels/FileChannel/LoopingTruncate.java generic-all
302
vprovodin29bc7ae2016-09-13 12:12:33 +0700303# 7132677
304java/nio/channels/Selector/OutOfBand.java macosx-all
305
306# 7158947, Solaris 11
307java/nio/file/WatchService/Basic.java solaris-all
308java/nio/file/WatchService/LotsOfEvents.java solaris-all
309
310############################################################################
311
312# jdk_rmi
313
314# 7140992
315java/rmi/server/Unreferenced/finiteGCLatency/FiniteGCLatency.java generic-all
316
317# 7146541
318java/rmi/transport/rapidExportUnexport/RapidExportUnexport.java linux-all
319
320# 7191877
321java/rmi/transport/checkLeaseInfoLeak/CheckLeaseLeak.java generic-all
322
323# 7195095
324sun/rmi/transport/proxy/EagerHttpFallback.java generic-all
325
326############################################################################
327
328# jdk_security
329
vprovodind2f9ed82016-09-14 15:10:40 +0700330# Test ignored: Must set up KDC and setup Kerberos configuration file
331javax/security/auth/kerberos/KerberosHashEqualsTest.java generic-all
332javax/security/auth/kerberos/KerberosTixDateTest.java generic-all
333
334# Test ignored: run these by hand
335com/sun/security/auth/callback/TextCallbackHandler/Password.java generic-all
336com/sun/security/auth/callback/TextCallbackHandler/Default.java generic-all
337
338# Test ignored: see runwjaas.csh for instructions for how to run this test
339com/sun/security/sasl/gsskerb/NoSecurityLayer.java generic-all
340com/sun/security/sasl/gsskerb/ConfSecurityLayer.java generic-all
341com/sun/security/sasl/gsskerb/AuthOnly.java generic-all
342
vprovodin29bc7ae2016-09-13 12:12:33 +0700343# 7157786
344sun/security/pkcs11/ec/TestKeyFactory.java generic-all
345
346# 7164518: no PortUnreachableException on Mac
347sun/security/krb5/auto/Unreachable.java macosx-all
348
349# 7147060
350com/sun/org/apache/xml/internal/security/transforms/ClassLoaderTest.java generic-all
351
352# 6988842: 4 tests failing on Solaris 5.10
353sun/security/pkcs11/Secmod/AddPrivateKey.java solaris-all
354sun/security/pkcs11/ec/ReadCertificates.java solaris-all
355sun/security/pkcs11/ec/ReadPKCS12.java solaris-all
356sun/security/pkcs11/sslecc/ClientJSSEServerJSSE.java solaris-all
357
358# 7041639, Solaris DSA keypair generation bug
359java/security/KeyPairGenerator/SolarisShortDSA.java solaris-all
360sun/security/tools/keytool/standard.sh solaris-all
361
362# 8026393
363sun/security/tools/jarsigner/warnings/BadKeyUsageTest.java generic-all
364
365# 8158827
366sun/security/krb5/auto/tools/KinitConfPlusProps.java windows-all
367
368############################################################################
369
vprovodin29bc7ae2016-09-13 12:12:33 +0700370# jdk_swing
371
vprovodinf10a8df2016-09-16 14:43:40 +0700372# https://bugs.openjdk.java.net/browse/JDK-8040797
373javax/swing/JComboBox/8032878/bug8032878.java generic-all
374
375# http://bugs.java.com/view_bug.do?bug_id=8067986
376javax/swing/JComboBox/ConsumedKeyTest/ConsumedKeyTest.java linux-all, windows-all
377
378# https://bugs.openjdk.java.net/browse/JDK-6848852
379javax/swing/JComponent/6683775/bug6683775.java linux-all
380
381# https://bugs.openjdk.java.net/browse/JDK-8064715
382javax/swing/JFileChooser/8062561/bug8062561.java generic-all
383
384# https://bugs.openjdk.java.net/browse/JDK-8032568
385javax/swing/JInternalFrame/8020708/bug8020708.java generic-all
386
387# https://bugs.openjdk.java.net/browse/JDK-8130430
388javax/swing/JRadioButton/8075609/bug8075609.java generic-all
389
390# https://bugs.openjdk.java.net/browse/JDK-8051591
391javax/swing/JTabbedPane/8007563/Test8007563.java linux-all, macosx-all
392
393# http://bugs.java.com/bugdatabase/view_bug.do?bug_id=8011259
394javax/swing/JTree/8003400/Test8003400.java generic-all
395
396# http://bugs.java.com/view_bug.do?bug_id=8008119
397javax/swing/RepaintManager/IconifyTest/IconifyTest.java generic-all
398
399# https://bugs.openjdk.java.net/browse/JDK-8159454
400javax/swing/ToolTipManager/7123767/bug7123767.java generic-all
401
402# https://bugs.openjdk.java.net/browse/JDK-8081764
403javax/swing/plaf/aqua/CustomComboBoxFocusTest.java generic-all
404
405# https://bugs.openjdk.java.net/browse/JDK-8012469
406javax/swing/text/DefaultEditorKit/4278839/bug4278839.java generic-all
407
vprovodind2f9ed82016-09-14 15:10:40 +0700408# https://bugs.openjdk.java.net/browse/JDK-6962725
409javax/swing/JFileChooser/6738668/bug6738668.java generic-all
410
411# https://bugs.openjdk.java.net/browse/JDK-8016746
412javax/swing/JTable/7068740/bug7068740.java generic-all
413
414# https://bugs.openjdk.java.net/browse/JDK-4847025
415javax/swing/JTextArea/4697612/bug4697612.java linux-all
416
vprovodin29bc7ae2016-09-13 12:12:33 +0700417############################################################################
418
419# jdk_text
420
421############################################################################
422
423# jdk_time
424
425############################################################################
426
427# jdk_tools
428
429# Tests take too long, on sparcs see 7143279
430tools/pack200/CommandLineTests.java solaris-all, macosx-all
431tools/pack200/Pack200Test.java solaris-all, macosx-all
432
433# 8007410
434tools/launcher/FXLauncherTest.java linux-all
435
436############################################################################
437
438# jdk_jdi
439
440############################################################################
441
442# jdk_util
443
444# Filed 6772009
445java/util/concurrent/locks/ReentrantLock/CancelledLockLoops.java generic-all
446
vprovodind2f9ed82016-09-14 15:10:40 +0700447# Test ignored: Bug fix temporarily removed as it uncovered other bugs (4992226)
448java/util/AbstractList/CheckForComodification.java generic-all
449
450# Test ignored: until 6842022 is resolved
451java/util/ResourceBundle/RestrictedBundleTest.java generic-all
452
453#Test ignored: 6876961
454java/util/ResourceBundle/Test4300693.java generic-all
455
456Test ignored: until 6842353 is resolved
457java/util/WeakHashMap/GCDuringIteration.java generic-all
458
459# Test ignored: runs for hours and eats up 7 Gigabytes of disk space
460java/util/zip/3GBZipFiles.sh generic-all
461
vprovodin29bc7ae2016-09-13 12:12:33 +0700462############################################################################
463
464# svc_tools
465
466# 8031482
467sun/tools/jcmd/TestJcmdSanity.java windows-all
468
469# 6456333
470sun/tools/jps/TestJpsJarRelative.java generic-all
471
472############################################################################