Gitiles
Code Review Sign In
gerrit-public.fairphone.software / platform / external / testng / b68cf6de8b961ff9b5258ca7defe795f77faa917 / . / CHANGES.txt
blob: 7aca12b33dc84c43d9eb0626d1bc13a438d21999 [file] [log] [blame]
cbeuste4e7d242008-04-06 04:16:13 +0000[diff] [blame]1===========================================================================
cbeusta0726712009-02-22 17:44:20 +0000[diff] [blame]25.9
cbeust01f74792008-04-06 17:33:25 +0000[diff] [blame]3
cbeuste38a74e2009-02-11 17:50:51 +0000[diff] [blame]4Added: -testrunfactory on the command line and in the ant task (Vitalyi Pamajonkov)
cbeust1c5c9aa2009-01-30 21:09:43 +0000[diff] [blame]5Added: TESTNG-298: parallel="classes", which allows entire classes to be run in the same thread
cbeustc3b0ec52009-01-30 17:01:20 +0000[diff] [blame]6Added: @BeforeMethod can now declare Object[] as a parameter, which will be filled by the parameters of the test method
7Added: IAnnotationTransformer2
8Added: @Test(invocationTimeOut), which lets you set a time out for the total time taken by invocationCount
9Added: IInvokedMethodListener
10Added: -testjar supports jar file with no testng.xml file
cbeustb68cf6d2009-02-25 16:07:13 +0000[diff] [blame^]11Fixed: TESTNG-192: JUnit XML output includes wrong tests (Borojevic)
cbeusta0726712009-02-22 17:44:20 +0000[diff] [blame]12Fixed: @Parameters was not working correctly on @BeforeMethods with @DataProvider used on @Test methods
cbeust68749e12009-02-20 01:14:46 +0000[diff] [blame]13Fixed: testng-failed.xml was sometimes incorrectly generated (Borojevic)
cbeustdf28a342009-02-16 19:18:21 +0000[diff] [blame]14Fixed: TestNG-228: Assert.assertEqualsNoOrder
15Fixed: TestNG-229: Assert.assertEquals does not behave properly when arguments are sets
16Fixed: TESTNG-36: assertEquals(Collection actual, Collection expected, String message) may have bug
cbeustee0edc42009-01-30 22:06:57 +0000[diff] [blame]17Fixed: TESTNG-296: Malformed jar URLs breaking -testJar
cbeustc3b0ec52009-01-30 17:01:20 +0000[diff] [blame]18Fixed: TESTNG-297: TestNG seemingly never stops running while building failed test suite (Gregg Yost)
cbeust35371912008-12-10 16:48:29 +0000[diff] [blame]19Fixed: TESTNG-285: @Test(sequential=true) works incorrectly for classes with inheritance
cbeust9f2e0c32008-11-17 16:18:00 +0000[diff] [blame]20Fixed: TESTNG-254: XMLSuite toXML() ignores listeners
cbeust6ca01b52008-10-15 21:11:46 +0000[diff] [blame]21Fixed: TESTNG-276: Thread safety problem in Reporter class
22Fixed: TESTNG-277: Make Reporter.getCurrentTestResult() public
cbeustd04b2ae2008-10-01 22:29:18 +0000[diff] [blame]23Fixed: Potential NPE in XmlTest#getVerbose (Ryan Morgan)
cbeust651ca6a2008-09-26 22:13:43 +0000[diff] [blame]24Fixed: EmailableReporter only displayed the first group for each test method
cbeust6bf0a7d2008-09-09 18:32:58 +0000[diff] [blame]25Fixed: time-outs were not working in <test> and <suite>
cbeust891c6962008-06-19 15:50:55 +0000[diff] [blame]26Fixed: @BeforeTest failing in a base class would not cause subsequent test methods to be skipped
cbeust318a4e42008-06-13 17:53:11 +0000[diff] [blame]27Fixed: TESTNG-195: @AfterMethod has no way of knowing if the current test failed
cbeust486fc182008-05-31 23:16:07 +0000[diff] [blame]28Fixed: TESTNG-249: Overridden test methods were shadowing each other if specified with <include>
cbeust8778efa2008-05-27 20:22:14 +0000[diff] [blame]29Fixed: DataProviders from @Factory-created tests were all invoked from the same instance
cbeuste3264a42008-05-27 02:14:38 +0000[diff] [blame]30Fixed: enabled was not working on configuration methods
cbeust2cdae872008-05-26 19:51:31 +0000[diff] [blame]31Fixed: IIinvokedMethodListener was not correctly added in TestNG
cbeust38ef90d2008-04-19 18:23:17 +0000[diff] [blame]32Fixed: NPE in XmlSuite#toXml
cbeust01f74792008-04-06 17:33:25 +0000[diff] [blame]33Fixed: TESTNG-231: NullPointerException thrown converting a suite to XML (Mark)
cbeuste4e7d242008-04-06 04:16:13 +0000[diff] [blame]34
cbeustf3016e42008-04-06 18:56:04 +0000[diff] [blame]35Doc:
cbeust2cdae872008-05-26 19:51:31 +0000[diff] [blame]36Added: 5.20: IInvokedMethodListener
cbeust398dbfd2008-04-20 16:06:55 +0000[diff] [blame]37Added: -testjar
cbeustf3016e42008-04-06 18:56:04 +0000[diff] [blame]38
cbeuste4e7d242008-04-06 04:16:13 +0000[diff] [blame]39===========================================================================
cbeustd9cf8a02008-02-17 23:38:26 +0000[diff] [blame]405.8
the.mindstorm3a238872007-11-15 01:44:32 +0000[diff] [blame]41
cbeust5191a182008-03-23 04:50:22 +0000[diff] [blame]42Fixed: TestNG-220: Ignore class definition/loader issues when scanning classpath for implicit classes
cbeustd7d31c12008-03-23 04:02:44 +0000[diff] [blame]43Fixed: TestNG-224: Fix for relative suite filenames in XML file
cbeust3e8cd5c2008-03-23 00:42:16 +0000[diff] [blame]44Added: TestNG-213: @Optional on a method parameter to allow optional @Parameters
cbeust920214e2008-03-23 00:18:18 +0000[diff] [blame]45Fixed: TestNG-214: SkipException and TimeBombSkipException should accept nested exceptions
46Fixed: TestNG-211: new Parser(inputStream) doesn't work
cbeustd9cf8a02008-02-17 23:38:26 +0000[diff] [blame]47Added: Methods that form a cycle are now shown when the cycle is detected
cbeust509aca52008-02-04 01:33:30 +0000[diff] [blame]48Added: Support for <listeners> in testng.xml
cbeustfa27df32008-02-03 22:04:37 +0000[diff] [blame]49Added: IMethodInterceptor
cbeust8b9443a2008-01-02 21:46:34 +0000[diff] [blame]50Added: @TestInstance on a data provider method parameter
cbeustd7e50002007-11-21 18:50:52 +0000[diff] [blame]51Fixed: @AfterMethod(lastTimeOnly) didn't work properly with data providers
the.mindstorm79074792007-11-15 01:57:53 +0000[diff] [blame]52Added: antlib.xml to allow autodiscovery of Ant task definition
the.mindstorm3a238872007-11-15 01:44:32 +0000[diff] [blame]53Fixed: name attribute on <test> is required
cbeustd7e50002007-11-21 18:50:52 +0000[diff] [blame]54
cbeust8edb61b2008-03-23 02:11:47 +0000[diff] [blame]55Doc:
56Added: Method Interceptor
57Added: @Optional
cbeust52b3c922008-04-06 03:40:26 +0000[diff] [blame]58Added: Doc for IMethodInterceptor (5.16) and TestNG listeners (5.18)
cbeust8edb61b2008-03-23 02:11:47 +0000[diff] [blame]59Added: 5.19: Dependency injection
60
the.mindstorm31fbf112006-10-25 23:17:06 +0000[diff] [blame]61===========================================================================
cbeust072b1c02007-06-08 15:06:26 +0000[diff] [blame]625.7
63
cbeust45a161f2007-11-01 21:37:49 +0000[diff] [blame]64Added: @BeforeMethod(firstTimeOnly) and @AfterMethod(lastTimeOnly)
cbeustec9d2742007-10-30 17:09:57 +0000[diff] [blame]65Added: @BeforeMethods can now take a Method and ITestContext parameters (like @DataProvider)
the.mindstorm29a0d372007-10-02 12:43:25 +0000[diff] [blame]66Fixed: logging about abstract classes moved to level 5
cbeust2c75cc42007-11-08 16:31:32 +0000[diff] [blame]67Added: if @Parameter is missing from testng.xml then it is read from the System properties
cbeust61e3a372007-09-23 06:54:11 +0000[diff] [blame]68Fixed: Don't run a @DataProvider method as a test when a class-level @Test is present
69Added: Attribute @Test#skipFailedInvocations
the.mindstorm04111212007-06-19 00:23:53 +0000[diff] [blame]70Fixed: TESTNG-169 Error message: <method> is depending on nonexistent method null ("null" is uninformative)
cbeust503726b2007-06-18 20:17:49 +0000[diff] [blame]71Fixed: -listener takes comma-separated classes
cbeust072b1c02007-06-08 15:06:26 +0000[diff] [blame]72Added: RetryAnalyzer (experimental) (Jeremie)
73
cbeust072b1c02007-06-08 15:06:26 +0000[diff] [blame]74===========================================================================
cbeuste7ee9202007-01-30 17:46:49 +0000[diff] [blame]755.6
76
the.mindstormee28d802007-04-12 00:48:56 +0000[diff] [blame]77Added: SkipException/TimeBombedSkipException for manual skipping
cbeust503726b2007-06-18 20:17:49 +0000[diff] [blame]78Added: <tests> can now be disabled at xml level using <test enabled="false">
cbeustc8d9bd62007-03-23 15:06:13 +0000[diff] [blame]79Added: Suite files that only contain other suites do not get reported
cbeustc81cb822007-03-15 11:08:03 +0000[diff] [blame]80Fixed: @BeforeClass methods would incorrectly report cyclic graphs
bileblogfda56212007-03-09 03:12:31 +0000[diff] [blame]81Added: get/setAttribute to ITestContext
the.mindstormaa639c52007-03-07 20:02:47 +0000[diff] [blame]82Added: plugging in factory objects to handle the actual instantiation of tests
cbeust91f466b2007-01-31 05:46:54 +0000[diff] [blame]83Added: dataProvider to @Factory
cbeuste7ee9202007-01-30 17:46:49 +0000[diff] [blame]84Added: ISuite now gives access to the current XmlSuite
the.mindstormc5b9a8c2007-02-13 10:33:16 +0000[diff] [blame]85Fixed: TESTNG-139 dependsOnMethods gets confused when dependency is "protected"
the.mindstormb7e26702007-02-13 10:49:07 +0000[diff] [blame]86Fixed: TESTNG-141 junit attribute set to false in testng-failed.xml when it should be true
the.mindstorm4c2554d2007-02-18 02:08:44 +0000[diff] [blame]87Fixed: TESTNG-142 Exceptions in DataProvider are not reported as failed test
88Added: Improved behavior for @Before/@AfterClass when using @Factory
89(http://forums.opensymphony.com/thread.jspa?threadID=6594&messageID=122294#122294)
90Added: Support for concurrent execution for invocationCount=1 threadPoolSize>1 and @DataProvider
91(http://forums.opensymphony.com/thread.jspa?threadID=64738&tstart=0)
bileblogcc01c6f2007-04-13 15:19:44 +0000[diff] [blame]92Added: New TestNG specific XML report, generated by default in 'xml' subdirectory of test-output
the.mindstorm0f282632007-04-19 00:00:01 +0000[diff] [blame]93Added: support in strprotocol for passing the ITest.getTestName() information
the.mindstorm79718dd2007-04-25 19:58:31 +0000[diff] [blame]94Fixed: TESTNG-152 If DataProvider is not found, the exception message should tell exactly what happened
the.mindstorma30275d2007-04-18 22:39:57 +0000[diff] [blame]95
the.mindstorm6d0b0552007-02-21 23:10:35 +0000[diff] [blame]96Eclipse plug-in
97
98Fixed: Bug that made group launch configurations unusable
the.mindstorma30275d2007-04-18 22:39:57 +0000[diff] [blame]99Fixed: The plugin doesn't create the correct launch configuration for @Factory
100Fixed: Method based launchers cannot be editted
101Fixed: Plugin hangs while executing test with dataprovider that sends \n, \r messages
the.mindstorm0f282632007-04-19 00:00:01 +0000[diff] [blame]102Added: display ITest.getTestName()
bileblogc7104e12007-04-13 12:54:10 +0000[diff] [blame]103
104IDEA plug-in
105
106Fixed: IDEA 7.0 compatibility
107Fixed: occasional 'illegal arguments exception'
108Fixed: TESTNG-151 Final passing test result is not properly hidden
bileblog2bb26842007-04-13 15:18:44 +0000[diff] [blame]109Added: Auto-completion for dependsOnMethods
110Added: Highlighting of invalid groups/methods in dependsOn*
cbeuste7ee9202007-01-30 17:46:49 +0000[diff] [blame]111===========================================================================
the.mindstorm2151a492006-12-13 04:36:44 +0000[diff] [blame]1125.5
113
cbeusta26b36e2007-01-23 23:47:21 +0000[diff] [blame]114Fixed: @BeforeGroup methods were run twice when in a base class
cbeustbab15682007-01-18 00:21:17 +0000[diff] [blame]115Fixed: @BeforeGroup methods were run twice with a @Test at class level
cbeust94b43f72007-01-11 23:57:29 +0000[diff] [blame]116Fixed: parallel="tests" didn't work as advertised
the.mindstorm39c426d2007-01-08 20:24:01 +0000[diff] [blame]117Added: Support for thread-count at test level
cbeustfd841532007-01-03 21:42:51 +0000[diff] [blame]118Added: Method selectors receive a Context and can stop the chain with setStopped()
cbeust88718b42007-01-03 16:31:31 +0000[diff] [blame]119Fixed: XmlMethodSelector was always run first regardless of its priority
the.mindstorm25f69e42006-12-29 02:15:23 +0000[diff] [blame]120Added: @BeforeGroups/@AfterGroups can live in classes without @Test methods
cbeust10efd592006-12-28 18:05:26 +0000[diff] [blame]121Added: DataProvider can now take an ITestContext parameter
cbeuste58af1d2006-12-28 03:17:31 +0000[diff] [blame]122Fixed: Wasn't parsing <selector-class-name> correctly
cbeustf7e88f82006-12-21 23:16:25 +0000[diff] [blame]123Fixed: Annotation Transformers now work on class-level annotations
124Fixed: Some class-level @Test attributes were not always honored
the.mindstorm9a148252006-12-21 22:54:28 +0000[diff] [blame]125Added: Clean separation between @Test invocation events and @Configuration invocation events
126 (see also TESTNG-111)
cbeust57233022006-12-23 16:24:22 +0000[diff] [blame]127Added: Test instances created by @Factory now run in multiple threads in parallel mode
the.mindstorm4a9f5e12006-12-19 20:16:18 +0000[diff] [blame]128Fixed: @Before/@AfterGroups invocation order
the.mindstorm6b388f82006-12-19 16:18:26 +0000[diff] [blame]129Fixed: TESTNG-27: Parameters are not used on <test> level anymore
the.mindstorm81996212006-12-14 03:01:30 +0000[diff] [blame]130Fixed: TESTNG-107 don't create an output directory if "outputDirectory" is null
cbeust68566752006-12-14 00:04:29 +0000[diff] [blame]131Fixed: TESTNG-127 UseDefaultListeners in Ant Task does not work
the.mindstormff19c2b2006-12-13 04:37:25 +0000[diff] [blame]132Fixed: TESTNG-119 Running TestNG runner with invalid '-sourcedir' on JDK14 JavaDoc annotated test classes won't fail.
the.mindstorm8603fcf2006-12-13 04:37:04 +0000[diff] [blame]133Fixed: TESTNG-113 Dependent methods within the same static inner class are not found
the.mindstorm2151a492006-12-13 04:36:44 +0000[diff] [blame]134Fixed: TESTNG-125 TestNG failed for test classes under *.java*.* pakages
135
the.mindstorm531c73e2006-12-22 04:06:09 +0000[diff] [blame]136Eclipse plug-in
137Fixed: issue with launch configuration
138Fixed: TESTNG-124: setting location of testng reports output
139
the.mindstorm2151a492006-12-13 04:36:44 +0000[diff] [blame]140===========================================================================
the.mindstorm20e416d2006-11-23 10:47:39 +0000[diff] [blame]1415.4
the.mindstormc70a9de2006-10-31 00:18:31 +0000[diff] [blame]142
the.mindstorm8ced8ae2006-12-10 03:38:58 +0000[diff] [blame]143Fixed: Ant task issue with paths containing spaces
the.mindstormfeb9f102006-12-08 17:10:25 +0000[diff] [blame]144Added: for @BeforeGroups and @AfterGroups specifying the groups() attribute will auto-include the method
145 into those groups by default (previously you had to also provide the value() attribute).
the.mindstorm6b25aa42006-11-23 10:11:35 +0000[diff] [blame]146Added: the load @Tests (invocationCount + threadPoolSize) are triggered simultaneous
147Fixed: reports are correctly displaying the thread info
the.mindstormf50b6182006-11-02 12:39:37 +0000[diff] [blame]148Added: @DataProvider name defaults to method name
the.mindstormc70a9de2006-10-31 00:18:31 +0000[diff] [blame]149Added: support for remote protocol to pass parameter information
150Fixed: TextReporter logs information about the parameters of the test methods
the.mindstorm63d1b812006-11-01 18:29:35 +0000[diff] [blame]151Fixed: concurrency issue in JUnitXMLReporter
152Fixed: output of JUnitXMLReporter must be CDATA
the.mindstormfd3d6292006-11-12 00:55:45 +0000[diff] [blame]153Fixed: XML unsupported annotations/parallel attribute values are reported
cbeust125d2472006-09-16 19:49:12 +0000[diff] [blame]154
the.mindstormb74384c2006-11-25 03:16:51 +0000[diff] [blame]155Eclipse plug-in
the.mindstormbd2de7a2006-11-30 01:24:05 +0000[diff] [blame]156Fixed: groups with multi-attribute javadoc annotations
the.mindstormb74384c2006-11-25 03:16:51 +0000[diff] [blame]157Fixed: consistent behavior for dependsOnMethods
158Fixed: consistent behavior for tests with dependsOnGroups (a warning is emitted)
159Fixed: consistent merge of configuration arguments when an existing launch configuration exists
the.mindstorm7b73a742006-09-14 17:39:29 +0000[diff] [blame]160===========================================================================
cbeust125d2472006-09-16 19:49:12 +0000[diff] [blame]1615.3
162
the.mindstorm7a14bd82006-10-25 00:56:00 +0000[diff] [blame]163Fixed: use a single instance of bsh.Interpreter
the.mindstorm55948752006-10-24 12:16:16 +0000[diff] [blame]164Added: @Before/@AfterMethod can declare a java.lang.reflect.Method parameter to be informed about the @Test method
the.mindstorm957a0e62006-10-20 00:42:42 +0000[diff] [blame]165Fixed: super classes must not be listed in testng-failures.xml
166Fixed: parallel attribute must not appear if empty or null in testng-failures.xml
the.mindstorm5e5666c2006-10-16 22:07:24 +0000[diff] [blame]167Fixed: parsing for javadoc annotations is done on request only
168Added: improved multiple suite summary page report
169Added: -target option deprecated in favor of -annotations javadoc|jdk
cbeust9e5d6a02006-10-16 00:39:54 +0000[diff] [blame]170Fixed: filesets in the ant task didn't work if the paths have spaces in them
the.mindstorm992befd2006-10-10 22:08:48 +0000[diff] [blame]171Fixed: Before/After Suite were behaving wrong in parallel execution
172Added: A generic/extensible RemoteTestNG was added to the core
the.mindstorm494a8d82006-09-28 23:06:30 +0000[diff] [blame]173Fixed: Before/AfterGroup-s were behaving wrong when using invocationCount, dataProvider and threadPoolSize
174Fixed: improved support for running different annotation type tests in the same suite
175Fixed: testng-failed.xml was generated even if there were no failures/skipps
176Fixed: -usedefaultlisteners was wrongly passed to JVM instead of TestNG options
cbeust3ee1fe02006-09-26 14:00:26 +0000[diff] [blame]177Added: Attribute dataProviderClass for @Test and @testng.test
cbeustada98512006-09-22 20:17:00 +0000[diff] [blame]178Fixed: Forgot to account for cases where both invocationCount and DataProviders are present
cbeust67a9c892006-09-22 05:38:30 +0000[diff] [blame]179Fixed: AfterGroups were invoked out of order with invocationCount and DataProviders
cbeustada98512006-09-22 20:17:00 +0000[diff] [blame]180Fixed: Reporter.getOutput() returned an empty array if a timeOut was specified
cbeust2c303722006-09-17 21:04:34 +0000[diff] [blame]181Added: testng.xml now supports <suite-files>
cbeust125d2472006-09-16 19:49:12 +0000[diff] [blame]182Added: ant task can receive several listeners
the.mindstorm6a229092006-09-18 06:52:11 +0000[diff] [blame]183Fixed: TESTNG-109 Skipped tests with expected exceptions are reported as failures
Bill.Michell55cef1b2006-10-13 16:29:44 +0000[diff] [blame]184Added: ant task can now select the parallel mode for running tests
185Fixed: ant task correctly deals with empty groups and excludedgroups parameters
186Added: ant task can override default suite and test names
187Added: comand line support for setting parallel mode, suite and test names
the.mindstorm7b73a742006-09-14 17:39:29 +0000[diff] [blame]188
189Eclipse plug-in
190Added: Support for configuring per project usedefaultlisteners
the.mindstorm6a229092006-09-18 06:52:11 +0000[diff] [blame]191Added: Contextual drop-down menu on failures tab of the TestNG view to enable running/debugging method failure only
192Added: Suppport for configuring per project TestNG jar usage (project provided one or plugin provided one)
cbeust8855dc42006-08-14 20:20:52 +0000[diff] [blame]193
the.mindstorma10e6b82006-08-06 21:51:57 +0000[diff] [blame]194===========================================================================
cbeust8bee4072006-08-23 23:32:32 +0000[diff] [blame]1955.2
196
cbeustae569972006-09-11 19:47:01 +0000[diff] [blame]197Added: "-usedefaultlisteners true/false" to command line and ant
198Added: EmailableReporter (from Paul Mendelson)
cbeust4b9824b2006-09-01 17:34:08 +0000[diff] [blame]199Added: parallel can now be "methods" or "tests". Boolean version deprecated
cbeustc2408c32006-08-29 17:23:22 +0000[diff] [blame]200Added: TestNGAntTask now uses the @ syntax to invoke TestNG
cbeust26b0c782006-08-29 16:54:38 +0000[diff] [blame]201Added: Command line understands @ syntax
cbeuste24b3802006-08-24 17:47:41 +0000[diff] [blame]202Added: JUnitConverter uses the new syntax
203Added: -groups to JUnitConverter
cbeust8bee4072006-08-23 23:32:32 +0000[diff] [blame]204Fixed: Throw proper exception when a DataProvider declares parameters
the.mindstormf91c2a62006-09-03 01:32:44 +0000[diff] [blame]205Added: completely revamped JUnit support (should run all kind of JUnit tests)
206Fixed: TESTNG-40 (Bug in testng-failed.xml generation)
the.mindstorm2ea93332006-09-04 23:59:44 +0000[diff] [blame]207Fixed: TESTNG-106 (Failed "@BeforeSuite" method just skipps the last test in xml-file)
208Fixed: Success on 0 tests (http://forums.opensymphony.com/thread.jspa?threadID=41213)
the.mindstormf91c2a62006-09-03 01:32:44 +0000[diff] [blame]209
210Eclipse plug-in
211Added: TESTNG-105 Automaticaly define TESTNG_HOME classpath variable
cbeust8bee4072006-08-23 23:32:32 +0000[diff] [blame]212
213===========================================================================
the.mindstorma10e6b82006-08-06 21:51:57 +0000[diff] [blame]2145.1
cbeust336f0ef2006-08-01 22:50:26 +0000[diff] [blame]215
cbeust8855dc42006-08-14 20:20:52 +0000[diff] [blame]216Added: @Test(sequential = true)
cbeustca895ef2006-08-09 21:34:51 +0000[diff] [blame]217Fixed: TESTNG-102 (Incorrect ordering of @BeforeMethod calls when a dependency is specified)
the.mindstorm997a5932006-08-11 19:34:04 +0000[diff] [blame]218Fixed: TESTNG-101 (HTML output contains nested <P> tags and a missing <tr> tag)
the.mindstorma10e6b82006-08-06 21:51:57 +0000[diff] [blame]219Added: support for specifying test-only classpath (http://forums.opensymphony.com/thread.jspa?messageID=78048&tstart=0)
220Fixed: TESTNG-93 (method selectors filtering @BeforeMethod)
221Fixed: TESTNG-81 (Assert.assertFalse() displays wrong expected, actual value)
222Fixed: TESTNG-59 (multiple method selectors usage results in no tests run)
223Fixed: TESTNG-56 (invocation of @Before/AfterClass methods in parallel/sequential scenarios)
224Fixed: TESTNG-40 (failures suite does not contain @Before/After Suite/Test methods)
225Fixed: TESTNG-37 (allow passing null parameter value from testng.xml)
226Fixed: TESTNG-7 (display classname when hovering method)
227
228
229Eclipse plug-in
230
231Added: run contextual test classes with parameters from suite definition files
232Added: TESTNG-100 (Show HTML reports after running tests)
the.mindstorm13e8f502006-08-11 20:27:14 +0000[diff] [blame]233Added: TESTNG-97 (Double click top stack to raise comparison)
the.mindstorma10e6b82006-08-06 21:51:57 +0000[diff] [blame]234Added: TESTNG-84 (plug-in UI for suite option should support absolute path)
235Added: TESTNG-20 (copy stack trace)
236
237Fixed: TESTNG-72 (display groups with non-array values)
238Fixed: TESTNG-64 (Eclipse plug-in applies added groups to all launch configurations)
239Fixed: TESTNG-28 (Cannot select groups from dependent eclipse projects)
240Fixed: TESTNG-25 (do not display fully qualified method name when running contextual test class)
241
242Improved behavior:
243 TESTNG-98 (temporary files have guaranteed fixed names)
244 TESTNG-95 (Assertion failed comparison trims trailing ">")
cbeust96761aa2006-08-15 17:31:35 +0000[diff] [blame]245 TESTNG-70 (TestNG prevents eclipse from opening an older CVS version of a java class)
the.mindstorma10e6b82006-08-06 21:51:57 +0000[diff] [blame]246 display of test hierarchy information (TESTNG-29)
247
cbeust336f0ef2006-08-01 22:50:26 +0000[diff] [blame]248===========================================================================
249
2505.0.1
251
252Eclipse plug-in
253
254Added: Output directory for the tests
255Added: Can now specify listener classes
256
257===========================================================================
2585.0.1
259
260Fixed: reports generated by SuiteHTMLReporter do not work with JDK1.4
261
262===========================================================================
263
2645.0
265
266Added: Ant task: support for JVM, workingDir, timeout
267Added: Stack traces can be interactively shown in the HTML reports
268Added: Link to testng.xml in the reports
269Added: New structure for reports, suites go in their individual directory
270Added: @Test(suiteName) and @Test(testName)
271Added: The stack traces in reports do not include TestNG frames (system property testng.exception)
272 (see: http://groups.google.com/group/testng-dev/browse_thread/thread/9f4d46ade10b0fda)
273Fixed: Exit with error when no methods are run
274 (see: http://groups.google.com/group/testng-dev/browse_thread/thread/3c26e8a5658f22ac)
275Added: List of methods in alphabetical order
276Fixed: Class-scoped annotations were not recognized when inherited
277Added: Deprecated @Configuration and introduced @BeforeSuite/Test/Class/TestMethod
278Added: Deprecated @ExpectedExceptions and moved it into @Test
279Added: expectedExceptions to @Test, deprecated @ExpectedExceptions
280Added: New annotations: @BeforeSuite, @BeforeTest, etc...
281Fixed: Was returning an exit code of 0 if a cyclic graph was detected
282Added: Interface org.testng.ITest so that tests can declare a name
283Fixed: The Text reporter was reporting the square of the actual number of methods
284Fixed: Bug reported by Eran about dependencies with an afterClass method
285Added: IHookCallBack now receives the ITestResult in its run() method
286Added: Name of suite for command line can be set with -Dtestng.suite.name=xxx
287Fixed: TestNGAntTask was hardcoding m_haltOnFSP to true
288Fixed: Passing a null parameter caused an NPE in the reports
289Added: "listener" to the ant task (and documentation)
290Added: if patch-testng-sourcedir.properties is found in the classpath
291 with a property "sourcedir" containing a ; separated list of
292 directories, this list will override -sourcedir.
293
294===========================================================================
295
296
2974.7
298
299Added: Maven 2 plug-in
300Fixed: Message formattings in TestNG assertion utility class
301Fixed: @Factory methods were counted as @Test as well
302 http://jira.opensymphony.com/browse/TESTNG-51
303Fixed: All DataProvider parameters were shown in the HTML report
304Fixed: Bug in testng-failed.xml generation
305Fixed: <packages> bug when using a jar file to load the test classes
306Added: alwaysRun for before @Configuration methods
307 http://jira.opensymphony.com/browse/TESTNG-35
308Fixed: groupless @Configurations were not invoked if a method depends on a group
309 http://jira.opensymphony.com/browse/TESTNG-45
310Added: beforeGroups/afterGroups to @Configuration
311
312Eclipse plugin:
313
314Added: last contextual launch is available in Eclipse launcher lists
315Fixed: 3.2M5 integration (removed dependency on non-existing class)
316Fixed: testng-failures.xml generation
317
318===========================================================================
319
3204.6
321
322Added: Documentation contains the new reports
323Added: TestNG.setUseDefaultListeners(boolean)
324Added: Descriptions now appear in TextReporter (verbose>=2) and the HTML reports
325Added: description attribute to @Test and @Configuration
326Added: combined Reporter output in the reports
327Added: methods not run in the reports
328Added: org.testng.IReporter
329Added: threadPoolSize to @Test
330Added: Reports now show relative timings (start at 0)
331Added: Reports now show different colors depending on the methods' classes
332Added: Reports now show all parameters used to invoke the test method
333Added: org.testng.Reporter
334Added: DataProviders can accept a Method as first parameter
335Fixed: Extraneous implicit inclusion of a method
336
337Eclipse plugin:
338
339Added: Run/Debug as TestNG test from the editor contextual menu
340Fixed: TESTNG-24: 'Run as testng test' does not appear of the Test annotation does not have a group
341Fixed: TESTNG-18: Eclipse plugin ignores Factory annotation
342Fixed: TESTNG-21: Show differences when double clicking assertion exceptions
343Added: UI allows setting orientation (even more space)
344 http://forums.opensymphony.com/thread.jspa?threadID=17225&messageID=33805#33805
345
346===========================================================================
347
3484.5
349
350Core:
351
352Fixed: Methods were not implicitly included, only groups
353Fixed: Bug with failed parent @Configuration don't skip child @Configuration/@Test invocations
354Fixed: Bug with overridding @Configuration methods (both parent and child were run)
355Fixed: Bug when overriding beforeClass methods in base class (cyclic graph)
356Added: Support for JAAS (see org.testng.IHookable)
357Fixed: Problem with nested classes inside <package name="foo.*"
358Fixed: If a group is not found, mark the method as a skip instead of aborting
359Fixed: testng-failed.xml was not respecting dependencies
360Fixed: class/include method in testng.xml didn't work on default package
361Fixed: DTD only allowed one <define>
362Fixed: ArrayIndexOutOfBoundsException for jMock
363Added: dependsOnMethods can contain methods from another class
364Fixed: JUnitConverter required -restore, not any more (option is now a no-op)
365Fixed: JUnit mode wasn't invoking setName() on test classes
366Added: Regular expressions for classes in <package>
367Added: Distributed TestNG
368Fixed: Command line parameters and testng.xml are now cumulative
369Fixed: Reports now work for multiple suites
370Fixed: Was ignoring abstract classes even if they have non-abstract instances
371Fixed: If setUp() failed, methods were not skipped
372Fixed: Was not clearly indicating when beforeSuite fails
373Added: @Configuration.inheritGroups
374Fixed: inconsistency between testng.xml and objects regarding method selectors
375
376Eclipse plug-in:
377
378New look for the progress view.
379
380===========================================================================
381
3824.4
383
384Core:
385
386Fixed: testng-failures.xml was not excluding methods from base classes
387Fixed: Bug in suites of suites for JUnit mode
388
389===========================================================================
390
3914.3
392
393Core:
394
395Fixed: testng-failures.xml was not excluding methods from base classes
396Fixed: Bug in suites of suites for JUnit mode
397Added: Excluded groups on command line and ant task
398Fixed: When including a group, implicitly include groups depended upon
399Fixed: When depending on several groups, wasn't skipped if one of them failed
400Fixed: Failures weren't reported accurately in the JUnitReports report
401Fixed: Wasn't throwing an exception if depending on a non-existing group
402
403===========================================================================
404
4054.2
406
407Core:
408
409Fixed: wasn't excluding methods in base classes
410Added: alwaysRun for tests (soft dependencies)
411Fixed: Class-level enabled=false were not honored
412Fixed: Bug with multiple dataproviders on same class
413Fixed: Bug with dataprovider defined in the parent class
414Fixed: Bug with dataprovider defined in a subclass
415Fixed: Bug with dataprovider defined in an abstract class
416Fixed: testng-failures generation was excluding the methods even if a failed test depended on it
417
418===========================================================================
419
4204.1
421
422Core:
423
424Added: @DataProviders can return Iterable<Object[]>
425Fixed: Superclass test methods were not called in the presence of a class @Test
426Added: Reporter class to log messages in the HTML reports
427
428===========================================================================
429
4304.0
431
432Core:
433
434Fixed: suite methods now invoked only once in a hierarchy
435Added: @DataProvider and @testng.data-provider
436Fixed: Interleave order now respected for before/afterClass methods
437Added: Can now invoke java -jar testng-2.6.jar <...>
438Added: Support for BeanShell
439Added: Method Selectors (IMethodSelector)
440Fixed: In the absence of dependencies, @Configuration methods respect inheritance
441Fixed: Bug in multithreaded dependencies on methods
442Fixed: dependsOnGroups wasn't working on regular expressions
443Fixed: Bug in <package> when directories contain spaces in their names
444Fixed: Introduced a JDK5 dependency in the JDK1.4 build (getEnclosingClass())
445Fixed: Output directory in ant task was not honored if it didn't exist
446Fixed: Problem with timeout according to
447 http://forums.opensymphony.com/thread.jspa?threadID=6707
448
449Eclipse plug-in:
450
451Fixed: Wasn't handling linked directories correctly
452Fixed: Bug in QuickFix implementation
453Added: Quick Fix for JUnit conversion (Annotations and JavaDoc)
454Fixed: Methods Run as TestNG test
455Added: Package level Run as TestNG test
456Fixed: Resources from the linked directories are using a wrong path when
457 passed to command line TestNG
458
459IDEA plug-in:
460
461Added: Support for JDK 1.4 (both projects and IDEA itself)
462Fixed: Classes that contained only configuration were ignored
463
464===========================================================================
465
4662.5
467
468Added: ITestListener.onTestStart(ITestResult)
469Added: Support for <packages>
470Added: Resource files for easier ant taskdefs
471Fixed: @Configuration methods were not invoked with individual test methods
472Fixed: Bug with ExpectedExceptions
473Fixed: Didn't support nested factory classes
474Fixed: NPE if -target is omitted with JDK 1.4
475Fixed: @Configuration failures in a class would cause other classes to fail
476Added: alwaysRun
477Fixed: beforeTestClass/afterTestClass were broken for a pathological case
478Added: @Configuration(alwaysRun)
479Added: JUnitConverter task
480Fixed: < and > characters in reports were not escaped
481
482Eclipse plug-in:
483
484Fixed: Class dialog wasn't showing @Factory classes
485
486IDEA plug-in:
487
488First release!
489
490Documentation:
491
492Added: Brand new look!!!
493Added: Section on testng.xml
494Fixed: Numbering of sections
495
496===========================================================================
497
4982.4
499Changed: New package: testng.org
500Fixed: Bug with @ExpectedException occuring the parallel mode
501Fixed: Bug with parameters and beforeTest
502Added: IInstanceInfo support
503Fixed: methods were not excluded when included by groups
504Fixed: testng-failures.xml is now including also the beforeSuite/afterSuite methods
505Fixed: generating the testng-failures.xml is now working as expected
506Fixed: Factories call all the tests even if some of them fail along the way
507Fixed: Better JUnit support (wasn't creating individual instances)
508Fixed: dependsOnGroups didn't work across different classes
509Added: command line (and Ant) -groups option
510Added: @Parameters (and made parameters attribute deprecated)
511Added: Parameters for constructors
512Fixed: Better interleaving of before/afterTestMethods
513Fixed: Ant task
514Fixed: TestNGException thrown when TestNG conditions are not fulfilled
515
516Documentation:
517- New assert classes
518- New ways to launch
519- JUnitConverter documentation
520- new beforeSuite/afterSuite
521
522===========================================================================
523
5242.3
525
526Fixed: Spaces are now legal in JavaDoc comments
527Added: documentation for @Factory
528Fixed: factories were called multiple times
529Added: beforeSuite and afterSuite
530Fixed: inheritance and scope now working properly for annotations
531Fixed: dependsOnMethods wasn't working for 1.4
532Added: Better stack traces
533Added: Better syntax for included/excluded methods
534Fixed: Better verbose support
535Fixed: Various fixes for the Eclipse plug-in
536Added: Can specify a class name on the command line
537Fixed: Default package bug in JUnitConverter
538Added: Regression tests for JUnitConverter
539Added: -quiet option to JUnitConverter
540
541===========================================================================
542
5432.2
544
545Fixed: Wasn't handling several testng.xml files correctly
546Fixed: Renamed -src to -sourcedir
547Fixed: Complains if no sourcedir is specified in 1.4
548Added: In 1.4, don't require annotations="javadoc"
549Fixed: If setUp fails, complain and mark test methods as skips
550Fixed: Dependent methods weren't working for 1.4
551
552===========================================================================
553
5542.1
555
556Added: Parser can accept an InputStream for testng.xml
557Fixed: expected-exceptions now fails if test passes
558Fixed: reports now use the suite name in HTML
559Added: invocationCount and successPercentage
560Added: dependsOnMethods
561Added: timeOut works in non-parallel mode
562
563===========================================================================
564
5652.0
566
567Added: port on JDK 1.4
568
569===========================================================================
570
5711.3
572
573Added: new view: classes (still experimental)
574Added: timeout on methods
575Added: thread-count
576Added: TestNG is now multithread, see "parallel" in <suite>
577
578===========================================================================
579
5801.2
581
582Added: JUnitConverter
583Fixed: Bug with afterClasses (test: AfterClassCalledAtTheEnd)
584
585===========================================================================
586
5871.1
588
589Added: new links for methods and groups in the HTML report
590Added: <methods>
591Added: <fileset> to <testng>
592
593===========================================================================
594
5951.0
596
597Fixed: Updated to the new DTD
598Fixed: Suite table of contents displays failures first
599Fixed: Bug in afterTestClass
600Added: Validating testng.xml
601Added: Scoped parameters
602Added: testng.xml
603Removed: Property quiet
604Changed: Verbose is now an integer
605Added: Dependent methods
606
607===========================================================================
608
6090.9
610
611Added: Groups of groups
612Added: Groups for Configuration methods
613Added: Parameters
614
615===========================================================================
616
6170.2
618
619Fixed: Merged TestMethod and TestClass into Test
620Added: HTML report
621Added: Regexps for groups
622Fixed: Inheritance of methods
623Fixed: ExpectedException is now called ExpectedExceptions