blob: 453c86d42d56a3b8c7e9d5f79e719f0d1f1b402b [file] [log] [blame]
Cedric Beustcaa93562010-08-05 14:54:45 -07001Current
2
Cedric Beust003d82b2012-06-06 20:28:47 -07003Added: Big performance improvement when generating the reports (Frank Pavageau)
Cedric Beust12900252012-05-28 17:27:10 -07004Added: <dependencies> allows you to specify group dependencies in testng.xml
Cedric Beust2723c032012-06-16 10:00:39 -07005Fixed: BeforeClass failing in parent failed to skip methods in sub classes
Cedric Beustb4d24d82012-06-14 22:43:41 -07006Fixed: Better error message if <suite name=""> is missing
Cedric Beust07fbe572012-06-09 11:30:07 -07007Fixed: GITHUB-221: Honor excludeGroups on testng tests when run in mixed mode (criccio)
Cedric Beust31dc1872012-04-16 14:52:36 -07008Fixed: dependsOnGroups = {regexp} wasn't working properly (Alistair Ward)
Cedric Beustecf7f922012-04-12 20:23:32 -07009Fixed: GITHUB-205: white-space was spelled whitespace in testng.css (carlin-scott)
10
Cedric Beustc6c69bb2012-06-12 13:20:50 -070011Eclipse:
Cedric Beuste14c1922012-06-14 21:59:50 -070012Fixed: Environment is not transferred when rerunning failed tests.
Cedric Beustc6c69bb2012-06-12 13:20:50 -070013Fixed: Rerunning failed tests will preserve the environment of the original launch
14
Cedric Beustecf7f922012-04-12 20:23:32 -070015===========================================================================
16
176.5.1:
1804/10/2012
19
Cedric Beust5ccc31d2012-02-21 14:27:53 -080020Added: <suite allow-return-values="true"> (and in <test> as well)
Cedric Beuste301bc22012-02-28 23:04:28 -080021Added: data-provider attribute to testng-results.xml
Cedric Beust9e3605c2012-03-13 10:57:15 -070022Added: Reporter display the results in the same order as test methods (Libor Zoubek)
Lukas Jungmanne5ea2ae2012-03-13 23:52:36 +010023Added: Support for running JUnit 4 tests (Lukas Jungmann)
24Added: Ability to auto-detect JUnit tests ('-mixed' mode) (Lukas Jungmann)
Lukas Jungmann24fcac62012-03-20 16:26:21 +010025Added: Support for ResourceCollections in an Ant tasks (requires Ant >= 1.7.0) (Lukas Jungmann)
Cedric Beustfe181fc2012-03-23 12:17:26 -070026Fixed: GITHUB-198: JUnitReportsReporter use commas in certain locales, which JUnitReports doesn't like
Cedric Beust00e90c12012-03-22 11:03:12 -070027Fixed: GITHUB-173: Dependent methods executed out-of-order if method names match across classes (jjedMoriAnktah)
Cedric Beust5b756442012-03-07 18:38:40 -080028Fixed: ThreadLocal<ITestResult> leak (aslakknutsen)
Cedric Beust07ae81b2012-03-02 18:33:49 -080029Fixed: In the HTML reports, only show the first 100 characters of the parameters
Cedric Beust2343cba2012-02-20 21:22:15 -080030Fixed: SkippedException are considered as real exception with @Test(expectedExceptions)
31
Cedric Beust3ebee262012-02-26 19:19:37 -080032Eclipse:
Cedric Beuste883ef12012-03-03 16:53:51 -080033Fixed: Java constants are properly resolved if they are used as group names (susanin)
34Fixed: @Test(groups = Foo.CONSTANT) (susanin)
Cedric Beust9f066c02012-03-08 16:19:00 -080035Fixed: Failed tests with allow-return-values="true" were not rerun
Cedric Beust3ebee262012-02-26 19:19:37 -080036Added: <suite allow-return-values="true"> (and in <test> as well)
37
Cedric Beust2343cba2012-02-20 21:22:15 -080038===========================================================================
39
406.4:
4102/15/2012
Cedric Beustad7f7082011-11-23 12:33:08 -080042
Cedric Beusted9cafa2012-01-04 10:26:01 -080043Added: @DataProvider(indices) to return specific indices of a data provider
Cedric Beust4e194522011-12-30 08:36:26 -080044Added: New HTML reports
Cedric Beustb4a69052012-01-25 15:12:36 -080045Added: configfailurepolicy=continue with DataProviders (toddq)
Cedric Beust1bd27822012-02-02 12:04:52 -080046Added: ITestResult#getTestContext (bpedman)
Cedric Beust340a87a2012-02-02 11:06:38 -080047Fixed: invocationCount > 1 + timeOut wasn't timing out properly
Cedric Beust36b13952012-01-25 15:15:37 -080048Fixed: When running TestNG programmatically, child xml suites are not run (when added using setSuiteFIles()) (Gaurav Gupta)
Cedric Beusta3b81182012-01-04 11:47:28 -080049Fixed: GITHUB-145: Excessive test method execution (githubCast)
Cedric Beust4e194522011-12-30 08:36:26 -080050Fixed: GITHUB-149: reversed arguments in failAssertEqualsNoOrder().
Cedric Beustad7f7082011-11-23 12:33:08 -080051Fixed: EmailableReporter: methods are now *really* sorted chronologically.
52
Cedric Beust9984e7a2011-11-26 09:44:40 -080053Eclipse:
54
Cedric Beust340a87a2012-02-02 11:06:38 -080055Added: You can now add the testng.jar sources as a library (Nick Tan)
56Added: Upgraded the plug-in to 3.4+ (Nick Tan)
Cedric Beust9984e7a2011-11-26 09:44:40 -080057Added: dependsOnGroups now fully supported
58Fixed: @Parameters now works with both ("foo") and ({"foo"}) (davekerber)
59
Cedric Beust8f5659d2011-11-22 14:01:25 -080060===========================================================================
616.3.1
6210/22/2011
Cedric Beustad7f7082011-11-23 12:33:08 -080063
Cedric Beustf65ccef2011-11-21 15:10:51 -080064Added: New system property: dataproviderthreadcount (Bill Ross)
65Fixed: Configuration methods were reported incorrectly in listeners.
Cedric Beust910ddcb2011-11-07 22:04:12 -080066Fixed: Was creating too many listeners (Jacek Pulut)
Cédric Beust5e4a8db2011-10-18 23:43:37 -070067Fixed: IAnnotationTransformer2 beforeTest/afterTest booleans were not being set
Cédric Beust92f635b2011-10-27 21:47:54 -070068Fixed: GITHUB-92: @BeforeTest method in a super class will be called multiple time when alwayRun = true (Bubuntux)
Cédric Beusta4006aa2011-10-18 00:02:00 -070069Fixed: GITHUB-111: @AfterClass on base classes run once too many (lrivera)
Cédric Beust09a11dc2011-10-23 13:04:49 -070070Fixed: GITHUB-107: Displaying 0 tests run if a listener modifies the parameters of the suite
Cédric Beusta4006aa2011-10-18 00:02:00 -070071
72===========================================================================
736.3
7410/17/2011
75
Cédric Beust05337512011-09-26 22:53:17 -070076Added: "description" attribute on <include>, made available on ITestNGMethod#getDescription
Cédric Beust3a1d3382011-09-30 13:48:24 -070077Added: RemoteTestNG waits infinitely for a connection (Aleksey Kabanov)
Cédric Beustece47a92011-10-05 22:34:39 -070078Fixed: A method that's both a test and a factory would not invoke its data provider
Cédric Beust7c34e4f2011-10-02 18:41:19 -070079Fixed: @AfterClass was not called if one of the methods was not enabled (Aleksey Kabanov)
Cédric Beust05337512011-09-26 22:53:17 -070080Fixed: Groovy access bug
Cédric Beustaa48f782011-08-25 22:16:15 -070081Fixed: The XML parser doesn't recognize parallel="instances"
Cédric Beustb17252e2011-08-24 10:06:44 -070082Fixed: NPE when using inner classes
Cédric Beust413eb432011-09-04 12:32:44 -070083Fixed: GITHUB-90: @AfterClass not being run when the class contains included and not included methods
Cédric Beust3dee4222011-08-24 12:46:26 -070084Fixed: @AfterClass not being run in some subclassing situations
Cédric Beustb17252e2011-08-24 10:06:44 -070085
Cédric Beust4a85c6a2011-08-26 09:00:02 -070086Eclipse:
87
Cédric Beust7c34e4f2011-10-02 18:41:19 -070088Fixed: Verbose levels specified in suites not respected
Cédric Beust2840ff02011-08-26 09:09:00 -070089Fixed: Variable substitution in VM arguments is not working properly (svenhoff)
Cédric Beust4a85c6a2011-08-26 09:00:02 -070090
Cédric Beustb17252e2011-08-24 10:06:44 -070091===========================================================================
92
936.2
9408/18/2011
95
Cedric Beust55b90e72011-07-06 10:18:37 -070096Added: xmlpathinjar to the TestNG ant task
Cedric Beust99c74da2011-07-06 11:00:52 -070097Added: TestNG can now invoke package protected constructors
Cedric Beustb3a4d752011-07-06 13:25:13 -070098Added: Injectors created by the @Guice annotation are now shared at the <test> level
Cedric Beust7b198e62011-08-18 14:53:55 -070099Added: IConfigurationListener is now a public listener, along with a new one: IConfigurationListener2
Cedric Beustc2164112011-08-01 15:15:19 -0700100Added: When a method fails, only dependents of the same instance will be skipped
101Added: parallel=instances for factory instance parallel runs
Cedric Beust53e6fdc2011-08-11 11:15:22 -0700102Added: @Factory(enabled)
Cedric Beust88fa06c2011-08-17 13:43:13 -0700103Fixed: JUnitReports reports now report the cumulated time @{Before,After}Method+@Test for each test method
Cedric Beust342a7852011-08-12 14:49:41 -0700104Fixed: JUnitReports reports have the name of the <test> instead of that of the first class
Cedric Beustb5f3f002011-08-10 13:06:58 -0700105Fixed: Using preserve-order with a factory that creates instances of a different class causes NPE
Cedric Beustd1579792011-08-08 12:37:21 -0700106Fixed: GITHUB-74: Bad ordering of test methods when using a @Factory constructor with dataProvider
Cedric Beust4dc9ed52011-08-09 11:02:34 -0700107Fixed: Changing the test result from success to failure in a listener would still count the test as a success
Cedric Beustf38bbfa2011-08-08 10:56:21 -0700108Fixed: ServiceLoader wasn't resolving correctly if no service loader classloader was specified
Cedric Beust0679dd42011-07-28 12:22:48 -0700109Fixed: Better ordering with mixed priorities and dependencies
Cedric Beusta17da982011-07-28 12:46:26 -0700110Fixed: Improved detection of graph cycles in parallel runs
Cedric Beustcaaf31e2011-07-26 10:24:09 -0700111Fixed: @BeforeTest was invoked multiple times if a factory is used
Cedric Beustd1579792011-08-08 12:37:21 -0700112Fixed: GITHUB-57: Allow usage of package protected constructor of test classes
Cedric Beust12ff94c2011-07-08 10:57:32 -0700113Fixed: Injecting both Object[] and Method in @BeforeMethod didn't always work
114Fixed: testng-results.xml now lists the results chronologically
Cedric Beust0d11e812011-07-11 11:12:01 -0700115Fixed: @Listeners specified on a base class will only be run once per listener class (dbriones)
Cedric Beustbad94772011-07-11 10:53:16 -0700116Fixed: -groups and -excludegroups were no longer overriding testng.xml
Cedric Beust12ff94c2011-07-08 10:57:32 -0700117
118Eclipse:
119
Cedric Beust32ed3962011-07-12 11:53:44 -0700120Added: Each data provider method now has a separate node entry in the TestNG view
Cedric Beust89aff822011-08-09 13:11:40 -0700121Fixed: Nodes in error would sometimes remain green
Cedric Beust12ff94c2011-07-08 10:57:32 -0700122Fixed: The TestNG context menu no longer appears where it shouldn't
Cedric Beust55b90e72011-07-06 10:18:37 -0700123
124===========================================================================
125
1266.1.1
1277/5/2011
128
Cedric Beustfc108082011-07-05 13:27:13 -0700129Fixed: https://github.com/cbeust/testng/issues/56 testng-results.xml was reporting the instance name instead of the method name
Cedric Beust54160fc2011-07-05 13:28:22 -0700130Fixed: NPE when using preserve-order and factories.
Cedric Beust60916e42011-07-05 15:08:35 -0700131Fixed: Depending on a skipped method would not cause a method to be skipped
Cedric Beustfc108082011-07-05 13:27:13 -0700132
133===========================================================================
134
1356.1
1366/30/2011
137
Cedric Beustbcb654d2011-06-08 10:55:30 -0700138Possible backward incompatible changes:
139
140- Don't mutate the value returned by XmlTest#getIncludedGroups and XmlTest#getExcludedGroups.
141Instead, use addIncludedGroup/addExcludedGroup.
142- Failing methods that have dependees will only cause skips in the same instance. Different
143test instances will not be affected
Cedric Beust2354de52011-05-27 09:45:22 -0700144
Cedric Beust1d96b172011-06-21 14:39:15 -0700145Added: Support for ServiceLoader for ITestNGListener
Cedric Beust27dd9e82011-03-24 13:23:12 -0700146Added: @Factory(dataProvider / dataProviderClass) on constructors
Cedric Beust6810cca2011-03-25 12:51:27 -0700147Added: assertNotEquals() to Assert
Cedric Beusta4fde212011-03-24 13:06:17 -0700148Added: assertArrayEquals() to AssertJUnit
Cedric Beustf4f95bf2011-05-12 13:48:10 -0700149Added: Nested classes are now automatically added for consideration for inclusion
Cedric Beust24215382011-05-12 14:25:43 -0700150Added: <suite preserve-order="true"> will cause this attribute to be propagated to all <test> tags
Cedric Beustba016b82011-05-23 15:53:27 -0700151Added: <groups> can now be specified under a <suite>
Cedric Beust6ee92792011-06-03 10:24:57 -0700152Added: Tycho compatibility (Aleksander Pohl)
Cedric Beust8c68a682011-06-08 14:36:14 -0700153Added: New <test> and <suite> flag: group-by-instances
Cedric Beust8ad7bc92011-06-13 14:57:18 -0700154Added: -xmlpathinjar to specify the path of testng.xml inside a test jar file
Cedric Beust483bb5a2011-06-15 09:53:15 -0700155Added: ISuite#getAllMethods, to retrieve all the methods at the start of a suite.
Cedric Beustf4e673f2011-06-29 10:25:16 -0700156Added: Output ITestResult attributes in xml report (nguillaumin)
Cedric Beust61a0a8a2011-06-24 11:17:06 -0700157Fixed: Thread safety problem in MethodInvocationHelper (Baron Roberts)
Cedric Beust9cb7e932011-06-24 12:39:08 -0700158Fixed: Group dependencies were not being skipped properly.
Cedric Beustbcb654d2011-06-08 10:55:30 -0700159Fixed: Dependency failures only impact the same instance
Cedric Beust9bbc55d2011-06-08 09:47:46 -0700160Fixed: Static classes could cause a StackOverFlowError
Cedric Beustd5c66972011-06-03 09:49:56 -0700161Fixed: IConfigurationListener was not extending ITestNGListener
Cedric Beust6d083a42011-05-13 14:32:32 -0700162Fixed: IConfigurationListener#onConfigurationFailure was never called
Cedric Beust24215382011-05-12 14:25:43 -0700163Fixed: TESTNG-476: <test> tags are now run in the order found in testng.xml
Cedric Beust618c10e2011-05-03 14:31:18 -0700164Fixed: Now showing failed/skipped error messages on the console for verbose >= 2
Cedric Beustf4f95bf2011-05-12 13:48:10 -0700165Fixed: ITestResult#getEndMillis() return 0
Cedric Beust93bdaf82011-04-27 16:04:45 -0700166Fixed: TESTNG-410: Clearer error message
Cedric Beuste7405392011-04-26 13:59:43 -0700167Fixed: TESTNG-475: @DataProvider doesn't support varargs
Cedric Beust97d56912011-04-21 15:02:17 -0700168Fixed: Performance problems in EmailableReporter
Cedric Beust8b53fef2011-04-12 15:09:49 -0700169Fixed: TESTNG-472: Better output for assertNull()
Cedric Beuste0014c22011-04-12 14:54:35 -0700170Fixed: ConcurrentModificationException when using parallel data providers.
Cedric Beustf2397342011-04-12 13:43:00 -0700171Fixed: TESTNG-282: Problem when including+excluding packages (addicted)
Cedric Beust53754e62011-04-04 14:42:02 -0700172Fixed: TESTNG-471: assertEquals(Map, Map) fails if a map is a subset of the other
Cedric Beustdf7b7b62011-03-17 10:11:09 -0700173Fixed: JUnitReporter generates an <error> tag for successful expectedExceptions tests
Cedric Beust6e7f12e2011-06-15 11:20:30 -0700174Fixed: ISSUE-47: Don't allow two <test>s with same name within same suite (Nalin Makar)
Cedric Beust58df7fe2011-06-17 10:56:35 -0700175Fixed: If a listener implements both ISuiteListener and IInvokedMethodListener, only one of them gets invoked
Cedric Beustdf7b7b62011-03-17 10:11:09 -0700176
Cedric Beust03d4e9b2011-03-21 15:43:15 -0700177Eclipse:
178
Cedric Beustecc0d502011-06-01 12:16:32 -0700179Added: New quick fix "Add static import org.testng.AssertJUnit.assertXXX"
Cedric Beust2354de52011-05-27 09:45:22 -0700180Added: New workspace wide setting: excluded stack traces, to provide shorter stack traces in the view
Cedric Beustd8fe6f92011-04-25 15:10:49 -0700181Added: New "Clear results" icon in the tool bar
182Added: When the search filter is modified, don't update the tree live if it is too big
Cedric Beust53754e62011-04-04 14:42:02 -0700183Added: Two new @Test refactorings (pull to class level, push to method level)
Cedric Beust6810cca2011-03-25 12:51:27 -0700184Added: JUnit conversion: @Ignore
Cedric Beusta4fde212011-03-24 13:06:17 -0700185Added: JUnit conversion: assertArrayEquals()
186Added: JUnit conversion: @RunWith(Parameterized.class)
Cedric Beustba016b82011-05-23 15:53:27 -0700187Added: Support for Hamcrest failed assertions in the compare dialog
Cedric Beust8bb99572011-06-24 10:19:23 -0700188Added: JUnit conversion: suite() methods can now either be removed, commented out or left untouched
Cedric Beust1d96b172011-06-21 14:39:15 -0700189Fixed: JUnit conversion: super.setUp()/tearDown() were being removed when extending a class other than TestCase
Cedric Beust1d059e22011-06-07 13:43:25 -0700190Fixed: "Run as" menu not appearing for methods that take a generic parameter.
Cedric Beust167e09d2011-06-02 12:22:34 -0700191Fixed: The tree was incorrect if the same class is used in different <test> tags
Cedric Beuste0014c22011-04-12 14:54:35 -0700192Fixed: When creating a new Run/Debug configuration, "Launch.label" was displayed
Cedric Beustf2397342011-04-12 13:43:00 -0700193Fixed: TESTNG-459: TestNG menu should not always be present in context menu (Mykola Nikishov)
Cedric Beust19cd3d32011-04-12 11:59:13 -0700194Fixed: Performance problems in the plug-in
Cedric Beust53754e62011-04-04 14:42:02 -0700195Fixed: Workspace-wide XML template files are not being honored.
Cedric Beust03d4e9b2011-03-21 15:43:15 -0700196Fixed: @BeforeClass/@AfterClass from JUnit4 are not being properly converted
197Fixed: Conversions generate @Test() instead of @Test
198
Cedric Beustdf7b7b62011-03-17 10:11:09 -0700199===========================================================================
200
2016.0
2022011/03/16
203
Cedric Beust8b48bb62011-02-09 15:03:31 -0800204Added: @Guice(moduleFactory) and IModuleFactory
205Added: @Guice(module)
Cedric Beust0dba7d62010-09-27 14:48:01 -0700206Added: timeOut for configuration methods
Cedric Beust82762732010-09-14 20:53:43 -0700207Added: -randomizesuites (Nalin Makar)
Cedric Beust8d596362010-09-07 11:00:41 -0700208Added: IConfigurable
Cedric Beust00c08fa2011-02-17 13:40:32 -0800209Fixed: @Test(priority) was not being honored in parallel mode
Cedric Beust349a0502011-02-23 14:06:58 -0800210Fixed: @Test(timeOut) was causing threadPoolSize to be ignored
Cedric Beust85a731a2011-02-04 11:21:46 -0800211Fixed: TESTNG-468: Listeners defined in suite XML file are ignored (Michael Benz)
Cedric Beust71ab6052011-02-04 11:08:39 -0800212Fixed: TESTNG-465: Guice modules are bound individually to an injector meaning that multiple modules can't be effectively used (Danny Thomas)
Cedric Beust2f149882011-02-09 14:47:40 -0800213Fixed: Method selectors from suites were not properly initialized (toddq)
Cedric Beustf5fc1732010-12-16 14:18:33 -0800214Fixed: Throw an error when two data providers have the same name
Cedric Beust1bcbafa2010-12-07 13:20:01 -0800215Fixed: Better handling of classes that don't have any TestNG annotations
Cedric Beust6b983ac2010-11-23 12:38:09 -0800216Fixed: XmlTest#toXml wasn't displaying the thread-count attribute
nullin20a0bb12010-11-08 00:34:03 -0800217Fixed: TESTNG-438: Regression in 5.14.1: JUnit Test Execution no longer working
Cedric Beust01aee422010-11-02 11:06:05 -0700218Fixed: TESTNG-436: Deep Map comparison for assertEquals() (Nikolay Metchev)
Cedric Beust676b37b2010-10-24 22:36:05 -0700219Fixed: Skipped tests were not always counted.
Cedric Beust836556f2010-12-02 13:17:37 -0800220Fixed: test listeners that throw were not reporting correctly (ansgarkonermann)
Cedric Beust96a74c92010-12-02 11:32:31 -0800221Fixed: <suite junit="true"> wasn't working.
Cedric Beust6b7d28b2011-02-15 13:55:27 -0800222Fixed: In parallel "methods" mode, method interceptors that remove methods would cause a lock up
Cedric Beust98224a32010-10-13 13:48:46 -0700223Fixed: EmailableReporter now sorts methods chronologically
nullin28e899a2010-10-17 01:32:57 -0700224Fixed: TESTNG-411: Throw exception on mismatch of parameter values (via DP and/or Inject) and test parameters
Cedric Beust2a310da2010-10-06 12:09:02 -0700225Fixed: IDEA-59073: exceptions that don't match don't have stack trace printed in console (Anna Kozlova)
Cedric Beuste04d1202010-10-05 13:39:03 -0700226Fixed: IDEA's plug-in was not honoring ITest (fixed in TestResultMessage)
Cedric Beustf10c3a12010-10-05 11:00:56 -0700227Fixed: Methods depending on a group they belong were skipped instead of throwing a cycle exception
Cedric Beust9102fec2010-10-04 11:17:08 -0700228Fixed: TESTNG-401: ClassCastException when using a listener from Maven
Lukas Jungmannc4c8ad32012-03-14 16:15:33 +0100229Fixed: TESTNG-186: Rename IWorkerApadter to IWorkerAdapter (Tomas Pollak)
nullineb7e1b62010-09-26 22:47:52 -0700230Fixed: TESTNG-415: Assert.assertEquals() for sets and maps fails with 'null' as arguments
Cedric Beustc987a162010-08-30 09:50:31 -0700231Fixed: typo -testRunFactory
nullin14e2b692010-08-30 12:15:35 -0700232Fixed: NPE while printing results for an empty suite (Nalin Makar)
nullinaacb2072010-08-30 13:44:11 -0700233Fixed: Invoke IInvokedMethodListener.afterInvocation after fixing results for tests expecting exceptions (Nalin Makar)
Cedric Beust347f2c92010-11-10 15:33:43 -0800234Fixed: TESTNG-441: NPE in SuiteHTMLReporter#generateMethodsChronologically caused by a race condition (Slawomir Ginter)
Cedric Beustc987a162010-08-30 09:50:31 -0700235
Cedric Beust89c386f2010-09-12 11:58:05 -0700236Eclipse:
Cedric Beusta7de7af2011-02-25 14:20:17 -0800237Added: Convert to YAML
Cedric Beust67b319d2011-02-22 10:46:03 -0800238Added: New global preference: JVM args
Cedric Beust13b120d2010-12-15 10:03:09 -0800239Added: Eclipse can now monitor a test-output/ directory and update the view when a new result is created
Cedric Beust552f0e22010-11-17 14:03:22 -0800240Added: Right clicking on a class/package/project now offers a menu "TestNG/Convert to TestNG"
Cedric Beust4054ab42010-11-05 15:19:18 -0700241Added: Excluded methods are now listed in the Summary tab
Cedric Beust0b4295f2010-11-10 14:48:45 -0800242Added: "Description" column in the excluded methods table
Cedric Beust1bcbafa2010-12-07 13:20:01 -0800243Added: Dialog box when the plug-in can't contact RemoteTestNG
Cedric Beust4054ab42010-11-05 15:19:18 -0700244Added: Double clicking on an excluded method in the Summary tab will take you to its definition
Cedric Beusta4eabd22010-11-04 16:09:38 -0700245Added: If you select a package before invoking the "New TestNG class" wizard, the source and package text boxes will be auto-filled
Cedric Beust0e7989f2010-11-03 09:42:47 -0700246Added: When an item is selected in a tab, the same item will be selected when switching tabs
247Added: A new "Summary" tab that allows the user to see a summary of the tests, sort them by time, name, etc...
Cedric Beustf375d1a2010-10-20 19:31:14 -0700248Added: It's now possible "Run/Debug As" with a right click from pretty much any element that makes sense in the tree.
Cedric Beustd18505d2011-02-09 14:53:53 -0800249Added: JUnit conversion: correctly replaces assertNull and assertNotNull
250Added: JUnit conversion: removes super.setUp() and super.tearDown()
251Added: JUnit conversion: removes @Override
252Added: JUnit conversion: replaces @Test(timeout) with @Test(timeOut) (5.14.2.4)
253Added: JUnit conversion: replaces @Test(expected) with @Test(expectedExceptions) (5.14.2.4)
254Added: JUnit conversion: replaces fail() with AssertJUnit.fail() (5.14.2.2)
255Added: JUnit conversion: replaces Assert with AssertJUnit (5.14.2.1)
Cedric Beuste49b1452010-10-06 14:34:47 -0700256Added: The progress bar is now orange if the suite contained skipped tests and no failures
Cedric Beust64700132010-09-27 12:22:34 -0700257Added: Skipped test and suite icons are now orange (previously: blue)
Cedric Beust89c386f2010-09-12 11:58:05 -0700258Added: New method shortcuts: "Alt+Shift+X N", "Alt+Shift+D N" (Sven Johansson)
Cedric Beust3fe45512011-01-26 13:04:37 -0800259Added: "Create TestNG class" context menu
Cedric Beust8f678af2011-02-14 14:19:30 -0800260Added: When generating a new class, handle overridden methods by generating mangled test method names
261Fixed: Green nodes could override red parent nodes back to green
Cedric Beust749ad0b2011-02-07 13:32:00 -0800262Fixed: Was trying to load the classes found in the XML template file
Cedric Beustfb5fc072010-12-23 11:34:48 -0800263Fixed: Stack traces of skipped tests were not showing in the Exception view
Cedric Beust552f0e22010-11-17 14:03:22 -0800264Fixed: XML files should be run in place and not copied.
Cedric Beust4054ab42010-11-05 15:19:18 -0700265Fixed: NPE when you select a passed test and click on the Compare Result icon (Mohamed Mansour)
Cedric Beust0e7989f2010-11-03 09:42:47 -0700266Fixed: When the run is over, the plug-in will no longer force the focus back to the Console view
Cedric Beust47f07d92010-10-25 09:18:27 -0700267Fixed: The counter in the progress bar sometimes went over the total number of test methods (5.14.2.9)
Cedric Beust6f7afd12010-10-13 13:03:24 -0700268Fixed: org.eclipse.ui.internal.ErrorViewPart cannot be cast to org.testng.eclipse.ui.TestRunnerViewPart (5.14.2.9)
Cedric Beuste53ab8c2010-10-01 11:09:14 -0700269Fixed: Workspace preferences now offer the "XML template" option as well as the project specific preferences (Asiel Brumfield)
Cedric Beust82ed7e92010-09-25 08:51:12 -0700270Fixed: TESTNG-418: Only last suite-file in testng.xml run by Eclipse plugin
Cedric Beust89c386f2010-09-12 11:58:05 -0700271
272Documentation:
273Added: Section on Selenium (Felipe Knorr Kuhn)
Cedric Beustcc2ecd82010-10-05 13:43:22 -0700274Added: Link to an article on TestNG, Mockito and Emma in the Misc section
Cedric Beust89c386f2010-09-12 11:58:05 -0700275
Cedric Beustc987a162010-08-30 09:50:31 -0700276===========================================================================
277
Cedric Beustdc381132011-01-27 12:53:45 -08002785.14.7
2792011/01/27
280
281Release for IDEA
282
283===========================================================================
284
Cedric Beust5523eb42010-10-04 12:06:16 -07002855.14.1
2862010/10/2
287
288Fixed: TESTNG-401: ClassCastException when using a listener from Maven
289
290===========================================================================
291
Cedric Beustc987a162010-08-30 09:50:31 -07002925.14
Cedric Beust63f2ea72010-09-07 11:15:23 -07002932010/08/28
Cedric Beustc987a162010-08-30 09:50:31 -0700294
Cedric Beust1621e392010-09-05 16:24:35 -0700295Added: test suites can now be run in parallel with -suitethreadpoolsize
Cedric Beustb4645402010-08-26 10:16:12 -0700296Fixed: @Listeners now aggregate through base classes
Cedric Beust93379112010-08-25 09:49:14 -0700297Fixed: ISuite was no longer serializable
Cedric Beust3cedfdf2010-08-25 07:15:35 -0700298Fixed: Injection was sometimes not working properly when used with @Parameters
299Fixed: TESTNG-400: afterMethod was called after onTestFailure()
Cedric Beust7e735d92010-08-24 07:20:40 -0700300Fixed: "excludedgroups" was not working on the ant task because of a typo
Cedric Beuste0eb7402010-08-22 09:44:52 -0700301Fixed: ant task error if <classfileset> is used with no classes (welex91)
Cedric Beust3cedfdf2010-08-25 07:15:35 -0700302Fixed: TESTNG-404: threaded tests fail due to use of non-threadsafe collections (Marcus Better)
Cedric Beust40be3852010-08-17 10:12:53 -0700303Fixed: preserve-order was not preserving class order with dependent methods
Cedric Beust9ae4e702010-08-05 21:09:48 -0700304Fixed: RetryAnalyzer wasn't working properly with factories
Cedric Beustcaa93562010-08-05 14:54:45 -0700305Fixed: The ant task was no longer supporting ',' for testclass
306
Cedric Beust39fb6ed2010-08-19 10:00:21 -0700307Eclipse:
308
309Fixed: The plug-in wasn't running Groovy tests correctly (Andrew Eisenberg)
Cedric Beust3cedfdf2010-08-25 07:15:35 -0700310Fixed: TESTNG-402 [Eclipse Plug-In] NPE occurred when I run twice a custom "Run configuration" on a group
Cedric Beust39fb6ed2010-08-19 10:00:21 -0700311
Cedric Beustcaa93562010-08-05 14:54:45 -0700312===========================================================================
313
Cedric Beustcaa93562010-08-05 14:54:45 -07003145.13.1
3152010/08/05
cbeust10b41092009-04-07 16:04:39 +0000316
Cedric Beustec2c6742010-07-21 10:32:22 -0700317Added: -methods
nullin62a82c62010-07-16 15:01:45 -0700318Added: -configfailurepolicy (Todd Quessenberry)
Cedric Beustb3a84262010-07-10 16:36:39 -0700319Added: -methodselectors (Todd Quessenberry)
Cedric Beustaba3ac22010-07-09 16:35:50 -0700320Added: @NoInjection
Cedric Beust9dea4442010-07-04 11:33:25 -0700321Added: <test preserve-order="true">
Cedric Beustfffc20f2010-07-01 07:40:45 -0700322Added: -testnames (command line) and testnames (ant)
cbeuste6eaf482010-05-25 20:59:10 +0000323Added: New ant task tag: propertyset (Todd Wells)
cbeust268e3e02010-04-23 20:49:03 +0000324Added: ITestNGListenerFactory
cbeustaf701af2010-06-11 19:54:19 +0000325Added: Passing command line properties via the ant task and doc update (Todd Wells)
Cedric Beustbef56532010-06-29 13:39:49 -0700326Added: Hierarchical XmlSuites (Nalin Makar)
Cedric Beustbf02fc82010-07-03 08:56:30 -0700327Added: Reporter#clear()
Cedric Beustf3818372010-07-29 17:50:01 -0700328Fixed: NullPointerException when a suite produces no results (Cefn Hoile)
Cedric Beuste157c702010-07-08 23:11:37 -0700329Fixed: Identical configuration methods were not always invoked in the correct order in superclasses (Nalin Makar)
Cedric Beustacd388b2010-07-07 14:58:22 -0700330Fixed: @DataProvider(parallel = true) was passing incorrect parameters with injection
Cedric Beustbeaff9a2010-07-06 23:00:33 -0700331Fixed: Replaced @Test(sequential) with @Test(singleThreaded)
nullin675d7072010-07-06 00:06:14 -0700332Fixed: If inherited configuration methods had defined deps, they could be invoked in incorrect order (Nalin Makar)
nullin32b42ad2010-07-01 16:47:22 -0700333Fixed: Initialize all Suite/Test runners at beginning to catch configuration issues right at start (Nalin Makar)
nullin675d7072010-07-06 00:06:14 -0700334Fixed: Issue7: Issue86 Incorrect dates reported for configuration methods
335Fixed: Issue24: OOM errors in SuiteHTMLReporter (Nalin Makar)
cbeust8222e202010-06-27 19:41:34 +0000336Fixed: Time outs specified in XML were not honored for <suite parallel="tests">
cbeust100885a2010-06-27 19:15:32 +0000337Fixed: <suite> and <test> time outs were hardcoded, they now honor their time-out attribute
cbeustecf39722010-06-27 16:20:49 +0000338Fixed: TestNG was hanging if no test methods were found
cbeust721fb912010-06-27 15:55:22 +0000339Fixed: onTestSuccess() was called after @AfterMethod instead of after the test method (test: test.listener.ListenerTest)
cbeustc4b46792010-06-25 13:15:09 +0000340Fixed: XML test results contained skipfailedinvocationCounts instead of skipfailedinvocationcounts
nalin.makar@gmail.comff94a1b2010-06-21 05:07:34 +0000341Fixed: Issue4 assertEquals for primitive arrays, Issue34 assertNull javadoc updated
nalin.makar@gmail.come3b52052010-06-20 07:22:42 +0000342Fixed: Issue78 NPE with non-public class. Now throws TestNG exception
cbeustf1ae0de2010-06-19 14:41:39 +0000343Fixed: NPE with @Optional null parameters (Yves Dessertine)
Lukas Jungmannc4c8ad32012-03-14 16:15:33 +0100344Fixed: TESTNG-387 TestNG not rerunning test method with the right data set from Data Provider (Francois Reynaud)
nalin.makar@gmail.comd3c04c32010-06-15 00:23:44 +0000345Fixed: Show correct number of pass/failed numbers for tests using @DataProvider
346Fixed: Return correct method status and exception (if any) in InvokedMethodListener.afterInvocation()
nalin.makar@gmail.comd16c4e52010-06-10 20:59:55 +0000347Fixed: Trivial fixes: TESTNG-241 (log message at Info), Issue2 (throw SAXException and not NPE for invalid testng xml)
348Fixed: Configuration methods couldn't depend on an abstract method (Nalin Makar)
cbeust52fd78d2010-05-20 20:39:57 +0000349Fixed: TestNG#setTestClasses was not resetting m_suites
cbeustdb66a3d2010-04-29 01:59:33 +0000350Fixed: Exceptions thrown by IInvokedMethodListeners were not caught (Nalin Makar)
cbeustbfac6512010-04-19 17:42:35 +0000351Fixed: @Listeners now works on base classes as well
352Fixed: Test priorities were not working properly in non-parallel mode
cbeust4f8e3e62010-04-15 21:36:02 +0000353Fixed: @Listeners wasn't working properly with ITestListener
cbeust0813ae82010-03-31 22:03:25 +0000354
Cedric Beust4601d932010-07-30 13:22:36 -0700355Eclipse
356
Cedric Beustca615d72010-07-30 14:07:18 -0700357Fixed: TESTNG-395 New wizard was creating classes called "NewTest"
358Fixed: TESTNG-397 Class level @Test was preventing groups from showing up in the launch configuration
Cedric Beust4601d932010-07-30 13:22:36 -0700359
cbeust1e615022010-06-24 01:53:30 +0000360Doc
361Updated Maven documentation (Brett Porter)
362
cbeust0813ae82010-03-31 22:03:25 +0000363===========================================================================
cbeustdb66a3d2010-04-29 01:59:33 +0000364
3655.12.1
Cedric Beustac025d52010-07-20 23:06:08 -07003662010/03/29
cbeustdb66a3d2010-04-29 01:59:33 +0000367
368Maven update
369
370===========================================================================
cbeust0813ae82010-03-31 22:03:25 +00003715.12
372
cbeustf0183e12010-01-17 02:34:35 +0000373Removed: Javadoc annotation support
374
cbeustcfe1bf22010-03-24 20:26:31 +0000375Added: @Listeners
cbeusta26e1572010-03-16 17:42:14 +0000376Added: IAttributes#getAttributeNames and IAttributes#removeAttribute
cbeust416a6c62010-03-10 17:16:39 +0000377Added: testng-results.xml now includes test duration in the <suite> tag (Cosmin Marginean)
cbeust1e15cc32010-03-03 16:59:55 +0000378Added: Injection now works for data providers
cbeust419f6682010-02-12 21:03:30 +0000379Added: TestNG#setObjectFactory(IObjectFactory)
cbeustbf8793f2010-01-29 06:36:16 +0000380Added: Priorities: @Test(priority = -1)
cbeustcfe1bf22010-03-24 20:26:31 +0000381Added: New attribute invocation-numbers in <include>
cbeustdd84c4f2010-01-24 21:28:02 +0000382Added: testng-failed.xml only contains the data provider invocations that failed
cbeust68f45042009-12-30 01:58:29 +0000383Added: IInvokedMethodListener2 to have access to ITestContext in listeners (Karthik Krishnan)
cbeuste350d762010-02-20 03:23:08 +0000384Fixed: @Before methods run from factories were not properly interleaved
cbeustc319bb52009-12-30 20:32:29 +0000385Fixed: The TextReporter reports skipped tests as PASSED (Ankur Agrawal)
cbeust68f45042009-12-30 01:58:29 +0000386
cbeusta5fceea2009-12-08 23:01:26 +0000387Eclipse:
388
cbeust4aa07e22010-01-05 01:29:09 +0000389Added: New file wizard: can now create a class with annotations, including @DataProvider
cbeust1a7cabf2009-12-11 22:56:02 +0000390Added: You can now select multiple XML suites to be run in the launch dialog
cbeuste350d762010-02-20 03:23:08 +0000391Fixed: @Test(groups = <constant>) was taking name of the constant instead of its value.
cbeustbeb3f2f2010-01-15 05:21:02 +0000392Fixed: http://jira.codehaus.org/browse/GRECLIPSE-476 NPE with Groovy Tests (Andrew Eisenberg)
cbeust1a7cabf2009-12-11 22:56:02 +0000393Fixed: The custom XML file is now created in the temp directory instead of inside the project
cbeusta5fceea2009-12-08 23:01:26 +0000394Fixed: In the launch dialog, now display an error if trying to pick groups when no project is selected
395Fixed: Was not setting the parallel attribute correctly on the temporary XML file
cbeuste02a82b2009-12-07 21:25:38 +0000396
397===========================================================================
3985.11
Cedric Beustac025d52010-07-20 23:06:08 -07003992009/12/08
cbeuste02a82b2009-12-07 21:25:38 +0000400
cbeusta4e68922009-11-26 19:46:45 +0000401Added: Dependent methods can now run in their own thread
cbeust88b72992009-10-25 23:00:55 +0000402Added: dataProviderThreadCount can be set from the command line and from ant (Adrian Grealish)
cbeust77ec73c2009-09-17 15:18:32 +0000403Added: ITestAnnotation#setDataProvider
cbeust99b4d6c2009-11-03 18:48:14 +0000404Added: Assert#assertEquals() methods for Sets and Maps
cbeust3ee46382009-12-08 18:04:59 +0000405Fixed: The text reporter was no longer reporting stack traces for verbose >= 2
cbeuste9b7e752009-12-05 19:57:30 +0000406Fixed: dataProviderClass was not respecting inheritance (like most attributes still)
cbeust0501e252009-12-02 19:09:41 +0000407Fixed: @BeforeSuite/@AfterSuite would run multiple times when used in a @Factory
cbeustf4bff962009-12-01 21:31:44 +0000408Fixed: packages=".*" wasn't working properly (sandopolus)
cbeust2cc1cc22009-11-29 01:32:19 +0000409Fixed: TestResult#getName now returns the description instead of the method
cbeusta4e68922009-11-26 19:46:45 +0000410Fixed: @DataProvider and dependent methods were not skipping correctly (Francois Reynaud)
cbeust15d8b692009-11-14 19:54:58 +0000411Fixed: TESTNG-347 suite with parallel="tests" and test with parallel="classes" doesn't work correctly (Rob Allen)
cbeustbf8f9f52009-11-06 16:35:04 +0000412Fixed: TESTNG-67: @Configuration/@Factory methods in base class being ignored
cbeust6006c862009-11-02 18:57:01 +0000413Fixed: Inner test classes were not excluded properly (Carsten Gubernator)
cbeust43f186d2009-10-03 01:55:40 +0000414Fixed: threadPoolSize without invocationCount was causing reporters not to be invoked
cbeustdbdf74f2009-09-18 18:17:21 +0000415Fixed: A @Factory throwing an exception did not cause any error
cbeust6d300dc2009-09-10 13:33:35 +0000416Fixed: <classfilesetref> was not working properly in the ant task (Ed Randall)
cbeustafd25d62009-09-01 17:57:59 +0000417Fixed: @BeforeClass methods were not running in parallel (Aidan Short)
DanFabulich19ba35f2009-10-03 04:37:51 +0000418Fixed: Test class with @ObjectFactory doesn't get instantiated via the factory
419Fixed: Allow IObjectFactory to load from non-standard classloader (for PowerMock support)
cbeustafd25d62009-09-01 17:57:59 +0000420
cbeusta5fceea2009-12-08 23:01:26 +0000421Eclipse 5.11.0.19:
cbeustf4bff962009-12-01 21:31:44 +0000422Added: New "parallel" preference setting (Windows / Preferences / TestNG)
cbeust3ee46382009-12-08 18:04:59 +0000423Fixed: IIinvokedMethodListeners were not invoked
cbeustf4bff962009-12-01 21:31:44 +0000424
cbeustafd25d62009-09-01 17:57:59 +0000425===========================================================================
4265.10
427
cosminaru0480c022009-05-23 17:30:47 +0000428Added: The output in the testng-results.xml is now sorted by the starting timestamp (Daniel Rudman)
cbeust9f2367a2009-05-18 19:16:14 +0000429Added: Better display of the test name and method description in the default and Emailable report
cbeust54520072009-05-13 16:49:07 +0000430Added: If both -testjar and an XML file are provided on the command line, the latter will be used
cbeustfa41a362009-05-12 16:22:42 +0000431Added: @Before and @After methods can be injected with the current XmlTest
cbeust572c7e62009-05-05 18:28:37 +0000432Added: Methods that time out now display the stack trace showing where the time out occurred
cbeust94efdf82009-05-04 21:27:11 +0000433Added: ITestResult#getAttribute and ITestResult#setAttribute
cbeustfa41a362009-05-12 16:22:42 +0000434Added: @After methods can now be injected with an ITestResult
cbeust94efdf82009-05-04 21:27:11 +0000435Added: @BeforeMethod and @AfterMethod methods can now be injected an ITestResult
cbeustda4f4522009-04-30 22:26:02 +0000436Added: ISuite#getAttribute and ISuite#setAttribute to share data within a suite
cbeust27e81a62009-05-05 17:57:26 +0000437Added: @Test(expectedExceptionsMessageRegExp = ".*foo.*")
438Added: @DataProvider(parallel=true)
cbeust06169672009-07-21 15:35:51 +0000439Fixed: @Test(dataProvider) was not working at the class level
cbeust4c02d892009-06-26 22:30:55 +0000440Fixed: Display a better error message if the wrong exception is thrown with an expectedExceptions
cbeustb6eb3672009-06-10 18:32:25 +0000441Fixed: Classes created by factories were not run in the order they were created
cbeustb7eacc52009-06-03 15:36:21 +0000442Fixed: Dependent methods are now run closer to methods within their class
cbeustb72906e2009-06-02 15:16:24 +0000443Fixed: xmlFileSet in ant was not working correctly (Sean Shou)
cbeust18d27ed2009-06-01 15:49:09 +0000444Fixed: Various oversights in the DTD (Will McQueen)
cosminaru0480c022009-05-23 17:30:47 +0000445Fixed: XMLUtils was not escaping XML attribute values
cbeust9da51c42009-05-18 20:21:13 +0000446Fixed: TESTNG-317: Sequence order mis-calculation: testing using suite in sequence for classes and same method names creates non-sequential order
cbeust45f8a9c2009-05-15 19:18:23 +0000447Fixed: Test names (classes that implement org.testng.ITest) now appear more prominently in the HTML reports
cbeust572c7e62009-05-05 18:28:37 +0000448Fixed: expectedExceptions=RuntimeException.class was not failing when no exception was throw
cbeust62009f02009-04-29 20:58:21 +0000449Fixed: TESTNG-291: Exceptions thrown by Iterable DataProviders are not caught, no failed test reported (Roberto Tyley)
cbeustb1b62052009-04-29 19:02:40 +0000450Fixed: TESTNG-301: Need to include parameters in testNG report for test created by @Factory
cbeustd1bcd192009-04-27 22:07:43 +0000451Fixed: testng-failed.xml now includes skipped tests
cbeust27fb3842009-04-20 16:02:44 +0000452Fixed: TestNG couldn't find Groovy files (Haw-Bin)
453
cbeust10b41092009-04-07 16:04:39 +0000454Eclipse
455
cbeust6dd2aaf2009-05-12 16:39:37 +0000456Fixed: TESTNG-313: Provide extension point to contribute test and report listeners (Erik Putrycz)
cbeust10b41092009-04-07 16:04:39 +0000457Fixed: Quick fixes no longer introduce deprecated annotations (Greg Turnquist)
458
cbeuste4e7d242008-04-06 04:16:13 +0000459===========================================================================
cbeusta0726712009-02-22 17:44:20 +00004605.9
Cedric Beustac025d52010-07-20 23:06:08 -07004612009/04/09
cbeust01f74792008-04-06 17:33:25 +0000462
cbeust5c38f852009-03-23 03:46:06 +0000463Added: New ant task boolean flag: delegateCommandSystemProperties (Justin)
cbeust32a38ce2009-03-24 17:30:31 +0000464Added: skipfailedinvocations under <suite> in testng-1.0.dtd (Gael Marziou / Stevo Slavic)
cbeuste38a74e2009-02-11 17:50:51 +0000465Added: -testrunfactory on the command line and in the ant task (Vitalyi Pamajonkov)
cbeust1c5c9aa2009-01-30 21:09:43 +0000466Added: TESTNG-298: parallel="classes", which allows entire classes to be run in the same thread
cbeustc3b0ec52009-01-30 17:01:20 +0000467Added: @BeforeMethod can now declare Object[] as a parameter, which will be filled by the parameters of the test method
468Added: IAnnotationTransformer2
469Added: @Test(invocationTimeOut), which lets you set a time out for the total time taken by invocationCount
470Added: IInvokedMethodListener
471Added: -testjar supports jar file with no testng.xml file
cbeust08e5ac52009-03-31 21:56:17 +0000472Fixed: IInvokedMethodListener wasn't properly recognized from the command line (Leonardo Rafaeli)
cbeust7ce0e722009-03-30 15:02:34 +0000473Fixed: TESTNG-309 Illegal default value for attribute in DTD file
474Fixed: TESTNG-192: JUnit XML output includes wrong tests (Aleksandar Borojevic)
cbeust36040b12009-03-28 05:01:47 +0000475Fixed: Set a generated suite to default to non-parallel (Mark Derricutt)
cbeust52df24d2009-03-18 19:40:31 +0000476Fixed: -testJar command line parsing bug
cbeust8beffc12009-03-18 19:27:21 +0000477Fixed: testng-failed.xml didn't include the listeners
cbeust1b7fe502009-03-14 16:05:33 +0000478Fixed: annotation transformers were not run when specified in testng.xml
cbeustb68cf6d2009-02-25 16:07:13 +0000479Fixed: TESTNG-192: JUnit XML output includes wrong tests (Borojevic)
cbeusta0726712009-02-22 17:44:20 +0000480Fixed: @Parameters was not working correctly on @BeforeMethods with @DataProvider used on @Test methods
cbeust68749e12009-02-20 01:14:46 +0000481Fixed: testng-failed.xml was sometimes incorrectly generated (Borojevic)
cbeustdf28a342009-02-16 19:18:21 +0000482Fixed: TestNG-228: Assert.assertEqualsNoOrder
483Fixed: TestNG-229: Assert.assertEquals does not behave properly when arguments are sets
484Fixed: TESTNG-36: assertEquals(Collection actual, Collection expected, String message) may have bug
cbeustee0edc42009-01-30 22:06:57 +0000485Fixed: TESTNG-296: Malformed jar URLs breaking -testJar
cbeustc3b0ec52009-01-30 17:01:20 +0000486Fixed: TESTNG-297: TestNG seemingly never stops running while building failed test suite (Gregg Yost)
cbeust35371912008-12-10 16:48:29 +0000487Fixed: TESTNG-285: @Test(sequential=true) works incorrectly for classes with inheritance
cbeust9f2e0c32008-11-17 16:18:00 +0000488Fixed: TESTNG-254: XMLSuite toXML() ignores listeners
cbeust6ca01b52008-10-15 21:11:46 +0000489Fixed: TESTNG-276: Thread safety problem in Reporter class
490Fixed: TESTNG-277: Make Reporter.getCurrentTestResult() public
cbeustd04b2ae2008-10-01 22:29:18 +0000491Fixed: Potential NPE in XmlTest#getVerbose (Ryan Morgan)
cbeust651ca6a2008-09-26 22:13:43 +0000492Fixed: EmailableReporter only displayed the first group for each test method
cbeust6bf0a7d2008-09-09 18:32:58 +0000493Fixed: time-outs were not working in <test> and <suite>
cbeust891c6962008-06-19 15:50:55 +0000494Fixed: @BeforeTest failing in a base class would not cause subsequent test methods to be skipped
cbeust318a4e42008-06-13 17:53:11 +0000495Fixed: TESTNG-195: @AfterMethod has no way of knowing if the current test failed
cbeust486fc182008-05-31 23:16:07 +0000496Fixed: TESTNG-249: Overridden test methods were shadowing each other if specified with <include>
cbeust8778efa2008-05-27 20:22:14 +0000497Fixed: DataProviders from @Factory-created tests were all invoked from the same instance
cbeuste3264a42008-05-27 02:14:38 +0000498Fixed: enabled was not working on configuration methods
cbeust2cdae872008-05-26 19:51:31 +0000499Fixed: IIinvokedMethodListener was not correctly added in TestNG
cbeust38ef90d2008-04-19 18:23:17 +0000500Fixed: NPE in XmlSuite#toXml
cbeust01f74792008-04-06 17:33:25 +0000501Fixed: TESTNG-231: NullPointerException thrown converting a suite to XML (Mark)
cbeuste4e7d242008-04-06 04:16:13 +0000502
cbeustf3016e42008-04-06 18:56:04 +0000503Doc:
cbeust2cdae872008-05-26 19:51:31 +0000504Added: 5.20: IInvokedMethodListener
cbeust398dbfd2008-04-20 16:06:55 +0000505Added: -testjar
cbeustf3016e42008-04-06 18:56:04 +0000506
cbeuste4e7d242008-04-06 04:16:13 +0000507===========================================================================
cbeustd9cf8a02008-02-17 23:38:26 +00005085.8
the.mindstorm3a238872007-11-15 01:44:32 +0000509
cbeust5191a182008-03-23 04:50:22 +0000510Fixed: TestNG-220: Ignore class definition/loader issues when scanning classpath for implicit classes
cbeustd7d31c12008-03-23 04:02:44 +0000511Fixed: TestNG-224: Fix for relative suite filenames in XML file
cbeust3e8cd5c2008-03-23 00:42:16 +0000512Added: TestNG-213: @Optional on a method parameter to allow optional @Parameters
cbeust920214e2008-03-23 00:18:18 +0000513Fixed: TestNG-214: SkipException and TimeBombSkipException should accept nested exceptions
514Fixed: TestNG-211: new Parser(inputStream) doesn't work
cbeustd9cf8a02008-02-17 23:38:26 +0000515Added: Methods that form a cycle are now shown when the cycle is detected
cbeust509aca52008-02-04 01:33:30 +0000516Added: Support for <listeners> in testng.xml
cbeustfa27df32008-02-03 22:04:37 +0000517Added: IMethodInterceptor
cbeust8b9443a2008-01-02 21:46:34 +0000518Added: @TestInstance on a data provider method parameter
cbeustd7e50002007-11-21 18:50:52 +0000519Fixed: @AfterMethod(lastTimeOnly) didn't work properly with data providers
the.mindstorm79074792007-11-15 01:57:53 +0000520Added: antlib.xml to allow autodiscovery of Ant task definition
the.mindstorm3a238872007-11-15 01:44:32 +0000521Fixed: name attribute on <test> is required
cbeustd7e50002007-11-21 18:50:52 +0000522
cbeust8edb61b2008-03-23 02:11:47 +0000523Doc:
524Added: Method Interceptor
525Added: @Optional
cbeust52b3c922008-04-06 03:40:26 +0000526Added: Doc for IMethodInterceptor (5.16) and TestNG listeners (5.18)
cbeust8edb61b2008-03-23 02:11:47 +0000527Added: 5.19: Dependency injection
528
the.mindstorm31fbf112006-10-25 23:17:06 +0000529===========================================================================
cbeust072b1c02007-06-08 15:06:26 +00005305.7
531
cbeust45a161f2007-11-01 21:37:49 +0000532Added: @BeforeMethod(firstTimeOnly) and @AfterMethod(lastTimeOnly)
cbeustec9d2742007-10-30 17:09:57 +0000533Added: @BeforeMethods can now take a Method and ITestContext parameters (like @DataProvider)
the.mindstorm29a0d372007-10-02 12:43:25 +0000534Fixed: logging about abstract classes moved to level 5
cbeust2c75cc42007-11-08 16:31:32 +0000535Added: if @Parameter is missing from testng.xml then it is read from the System properties
cbeust61e3a372007-09-23 06:54:11 +0000536Fixed: Don't run a @DataProvider method as a test when a class-level @Test is present
537Added: Attribute @Test#skipFailedInvocations
the.mindstorm04111212007-06-19 00:23:53 +0000538Fixed: TESTNG-169 Error message: <method> is depending on nonexistent method null ("null" is uninformative)
cbeust503726b2007-06-18 20:17:49 +0000539Fixed: -listener takes comma-separated classes
cbeust072b1c02007-06-08 15:06:26 +0000540Added: RetryAnalyzer (experimental) (Jeremie)
541
cbeust072b1c02007-06-08 15:06:26 +0000542===========================================================================
cbeuste7ee9202007-01-30 17:46:49 +00005435.6
Cedric Beustac025d52010-07-20 23:06:08 -07005442007/06/14
cbeuste7ee9202007-01-30 17:46:49 +0000545
the.mindstormee28d802007-04-12 00:48:56 +0000546Added: SkipException/TimeBombedSkipException for manual skipping
cbeust503726b2007-06-18 20:17:49 +0000547Added: <tests> can now be disabled at xml level using <test enabled="false">
cbeustc8d9bd62007-03-23 15:06:13 +0000548Added: Suite files that only contain other suites do not get reported
cbeustc81cb822007-03-15 11:08:03 +0000549Fixed: @BeforeClass methods would incorrectly report cyclic graphs
bileblogfda56212007-03-09 03:12:31 +0000550Added: get/setAttribute to ITestContext
the.mindstormaa639c52007-03-07 20:02:47 +0000551Added: plugging in factory objects to handle the actual instantiation of tests
cbeust91f466b2007-01-31 05:46:54 +0000552Added: dataProvider to @Factory
cbeuste7ee9202007-01-30 17:46:49 +0000553Added: ISuite now gives access to the current XmlSuite
the.mindstormc5b9a8c2007-02-13 10:33:16 +0000554Fixed: TESTNG-139 dependsOnMethods gets confused when dependency is "protected"
the.mindstormb7e26702007-02-13 10:49:07 +0000555Fixed: TESTNG-141 junit attribute set to false in testng-failed.xml when it should be true
the.mindstorm4c2554d2007-02-18 02:08:44 +0000556Fixed: TESTNG-142 Exceptions in DataProvider are not reported as failed test
557Added: Improved behavior for @Before/@AfterClass when using @Factory
558(http://forums.opensymphony.com/thread.jspa?threadID=6594&messageID=122294#122294)
559Added: Support for concurrent execution for invocationCount=1 threadPoolSize>1 and @DataProvider
560(http://forums.opensymphony.com/thread.jspa?threadID=64738&tstart=0)
bileblogcc01c6f2007-04-13 15:19:44 +0000561Added: New TestNG specific XML report, generated by default in 'xml' subdirectory of test-output
the.mindstorm0f282632007-04-19 00:00:01 +0000562Added: support in strprotocol for passing the ITest.getTestName() information
the.mindstorm79718dd2007-04-25 19:58:31 +0000563Fixed: TESTNG-152 If DataProvider is not found, the exception message should tell exactly what happened
the.mindstorma30275d2007-04-18 22:39:57 +0000564
the.mindstorm6d0b0552007-02-21 23:10:35 +0000565Eclipse plug-in
566
567Fixed: Bug that made group launch configurations unusable
the.mindstorma30275d2007-04-18 22:39:57 +0000568Fixed: The plugin doesn't create the correct launch configuration for @Factory
569Fixed: Method based launchers cannot be editted
570Fixed: Plugin hangs while executing test with dataprovider that sends \n, \r messages
the.mindstorm0f282632007-04-19 00:00:01 +0000571Added: display ITest.getTestName()
bileblogc7104e12007-04-13 12:54:10 +0000572
573IDEA plug-in
574
575Fixed: IDEA 7.0 compatibility
576Fixed: occasional 'illegal arguments exception'
577Fixed: TESTNG-151 Final passing test result is not properly hidden
bileblog2bb26842007-04-13 15:18:44 +0000578Added: Auto-completion for dependsOnMethods
579Added: Highlighting of invalid groups/methods in dependsOn*
Cedric Beustac025d52010-07-20 23:06:08 -0700580
cbeuste7ee9202007-01-30 17:46:49 +0000581===========================================================================
the.mindstorm2151a492006-12-13 04:36:44 +00005825.5
Cedric Beustac025d52010-07-20 23:06:08 -07005832007/01/25
the.mindstorm2151a492006-12-13 04:36:44 +0000584
cbeusta26b36e2007-01-23 23:47:21 +0000585Fixed: @BeforeGroup methods were run twice when in a base class
cbeustbab15682007-01-18 00:21:17 +0000586Fixed: @BeforeGroup methods were run twice with a @Test at class level
cbeust94b43f72007-01-11 23:57:29 +0000587Fixed: parallel="tests" didn't work as advertised
the.mindstorm39c426d2007-01-08 20:24:01 +0000588Added: Support for thread-count at test level
cbeustfd841532007-01-03 21:42:51 +0000589Added: Method selectors receive a Context and can stop the chain with setStopped()
cbeust88718b42007-01-03 16:31:31 +0000590Fixed: XmlMethodSelector was always run first regardless of its priority
the.mindstorm25f69e42006-12-29 02:15:23 +0000591Added: @BeforeGroups/@AfterGroups can live in classes without @Test methods
cbeust10efd592006-12-28 18:05:26 +0000592Added: DataProvider can now take an ITestContext parameter
cbeuste58af1d2006-12-28 03:17:31 +0000593Fixed: Wasn't parsing <selector-class-name> correctly
cbeustf7e88f82006-12-21 23:16:25 +0000594Fixed: Annotation Transformers now work on class-level annotations
595Fixed: Some class-level @Test attributes were not always honored
the.mindstorm9a148252006-12-21 22:54:28 +0000596Added: Clean separation between @Test invocation events and @Configuration invocation events
597 (see also TESTNG-111)
cbeust57233022006-12-23 16:24:22 +0000598Added: Test instances created by @Factory now run in multiple threads in parallel mode
the.mindstorm4a9f5e12006-12-19 20:16:18 +0000599Fixed: @Before/@AfterGroups invocation order
the.mindstorm6b388f82006-12-19 16:18:26 +0000600Fixed: TESTNG-27: Parameters are not used on <test> level anymore
the.mindstorm81996212006-12-14 03:01:30 +0000601Fixed: TESTNG-107 don't create an output directory if "outputDirectory" is null
cbeust68566752006-12-14 00:04:29 +0000602Fixed: TESTNG-127 UseDefaultListeners in Ant Task does not work
the.mindstormff19c2b2006-12-13 04:37:25 +0000603Fixed: TESTNG-119 Running TestNG runner with invalid '-sourcedir' on JDK14 JavaDoc annotated test classes won't fail.
the.mindstorm8603fcf2006-12-13 04:37:04 +0000604Fixed: TESTNG-113 Dependent methods within the same static inner class are not found
the.mindstorm2151a492006-12-13 04:36:44 +0000605Fixed: TESTNG-125 TestNG failed for test classes under *.java*.* pakages
606
the.mindstorm531c73e2006-12-22 04:06:09 +0000607Eclipse plug-in
608Fixed: issue with launch configuration
609Fixed: TESTNG-124: setting location of testng reports output
610
the.mindstorm2151a492006-12-13 04:36:44 +0000611===========================================================================
the.mindstorm20e416d2006-11-23 10:47:39 +00006125.4
the.mindstormc70a9de2006-10-31 00:18:31 +0000613
the.mindstorm8ced8ae2006-12-10 03:38:58 +0000614Fixed: Ant task issue with paths containing spaces
the.mindstormfeb9f102006-12-08 17:10:25 +0000615Added: for @BeforeGroups and @AfterGroups specifying the groups() attribute will auto-include the method
616 into those groups by default (previously you had to also provide the value() attribute).
the.mindstorm6b25aa42006-11-23 10:11:35 +0000617Added: the load @Tests (invocationCount + threadPoolSize) are triggered simultaneous
618Fixed: reports are correctly displaying the thread info
the.mindstormf50b6182006-11-02 12:39:37 +0000619Added: @DataProvider name defaults to method name
the.mindstormc70a9de2006-10-31 00:18:31 +0000620Added: support for remote protocol to pass parameter information
621Fixed: TextReporter logs information about the parameters of the test methods
the.mindstorm63d1b812006-11-01 18:29:35 +0000622Fixed: concurrency issue in JUnitXMLReporter
623Fixed: output of JUnitXMLReporter must be CDATA
the.mindstormfd3d6292006-11-12 00:55:45 +0000624Fixed: XML unsupported annotations/parallel attribute values are reported
cbeust125d2472006-09-16 19:49:12 +0000625
the.mindstormb74384c2006-11-25 03:16:51 +0000626Eclipse plug-in
the.mindstormbd2de7a2006-11-30 01:24:05 +0000627Fixed: groups with multi-attribute javadoc annotations
the.mindstormb74384c2006-11-25 03:16:51 +0000628Fixed: consistent behavior for dependsOnMethods
629Fixed: consistent behavior for tests with dependsOnGroups (a warning is emitted)
630Fixed: consistent merge of configuration arguments when an existing launch configuration exists
the.mindstorm7b73a742006-09-14 17:39:29 +0000631===========================================================================
cbeust125d2472006-09-16 19:49:12 +00006325.3
Cedric Beustac025d52010-07-20 23:06:08 -07006332006/10/30
cbeust125d2472006-09-16 19:49:12 +0000634
the.mindstorm7a14bd82006-10-25 00:56:00 +0000635Fixed: use a single instance of bsh.Interpreter
the.mindstorm55948752006-10-24 12:16:16 +0000636Added: @Before/@AfterMethod can declare a java.lang.reflect.Method parameter to be informed about the @Test method
the.mindstorm957a0e62006-10-20 00:42:42 +0000637Fixed: super classes must not be listed in testng-failures.xml
638Fixed: parallel attribute must not appear if empty or null in testng-failures.xml
the.mindstorm5e5666c2006-10-16 22:07:24 +0000639Fixed: parsing for javadoc annotations is done on request only
640Added: improved multiple suite summary page report
641Added: -target option deprecated in favor of -annotations javadoc|jdk
cbeust9e5d6a02006-10-16 00:39:54 +0000642Fixed: filesets in the ant task didn't work if the paths have spaces in them
the.mindstorm992befd2006-10-10 22:08:48 +0000643Fixed: Before/After Suite were behaving wrong in parallel execution
644Added: A generic/extensible RemoteTestNG was added to the core
the.mindstorm494a8d82006-09-28 23:06:30 +0000645Fixed: Before/AfterGroup-s were behaving wrong when using invocationCount, dataProvider and threadPoolSize
646Fixed: improved support for running different annotation type tests in the same suite
647Fixed: testng-failed.xml was generated even if there were no failures/skipps
648Fixed: -usedefaultlisteners was wrongly passed to JVM instead of TestNG options
cbeust3ee1fe02006-09-26 14:00:26 +0000649Added: Attribute dataProviderClass for @Test and @testng.test
cbeustada98512006-09-22 20:17:00 +0000650Fixed: Forgot to account for cases where both invocationCount and DataProviders are present
cbeust67a9c892006-09-22 05:38:30 +0000651Fixed: AfterGroups were invoked out of order with invocationCount and DataProviders
cbeustada98512006-09-22 20:17:00 +0000652Fixed: Reporter.getOutput() returned an empty array if a timeOut was specified
cbeust2c303722006-09-17 21:04:34 +0000653Added: testng.xml now supports <suite-files>
cbeust125d2472006-09-16 19:49:12 +0000654Added: ant task can receive several listeners
the.mindstorm6a229092006-09-18 06:52:11 +0000655Fixed: TESTNG-109 Skipped tests with expected exceptions are reported as failures
Bill.Michell55cef1b2006-10-13 16:29:44 +0000656Added: ant task can now select the parallel mode for running tests
657Fixed: ant task correctly deals with empty groups and excludedgroups parameters
658Added: ant task can override default suite and test names
659Added: comand line support for setting parallel mode, suite and test names
the.mindstorm7b73a742006-09-14 17:39:29 +0000660
661Eclipse plug-in
662Added: Support for configuring per project usedefaultlisteners
the.mindstorm6a229092006-09-18 06:52:11 +0000663Added: Contextual drop-down menu on failures tab of the TestNG view to enable running/debugging method failure only
664Added: Suppport for configuring per project TestNG jar usage (project provided one or plugin provided one)
cbeust8855dc42006-08-14 20:20:52 +0000665
the.mindstorma10e6b82006-08-06 21:51:57 +0000666===========================================================================
cbeust8bee4072006-08-23 23:32:32 +00006675.2
668
cbeustae569972006-09-11 19:47:01 +0000669Added: "-usedefaultlisteners true/false" to command line and ant
670Added: EmailableReporter (from Paul Mendelson)
cbeust4b9824b2006-09-01 17:34:08 +0000671Added: parallel can now be "methods" or "tests". Boolean version deprecated
cbeustc2408c32006-08-29 17:23:22 +0000672Added: TestNGAntTask now uses the @ syntax to invoke TestNG
cbeust26b0c782006-08-29 16:54:38 +0000673Added: Command line understands @ syntax
cbeuste24b3802006-08-24 17:47:41 +0000674Added: JUnitConverter uses the new syntax
675Added: -groups to JUnitConverter
cbeust8bee4072006-08-23 23:32:32 +0000676Fixed: Throw proper exception when a DataProvider declares parameters
the.mindstormf91c2a62006-09-03 01:32:44 +0000677Added: completely revamped JUnit support (should run all kind of JUnit tests)
678Fixed: TESTNG-40 (Bug in testng-failed.xml generation)
the.mindstorm2ea93332006-09-04 23:59:44 +0000679Fixed: TESTNG-106 (Failed "@BeforeSuite" method just skipps the last test in xml-file)
680Fixed: Success on 0 tests (http://forums.opensymphony.com/thread.jspa?threadID=41213)
the.mindstormf91c2a62006-09-03 01:32:44 +0000681
682Eclipse plug-in
683Added: TESTNG-105 Automaticaly define TESTNG_HOME classpath variable
cbeust8bee4072006-08-23 23:32:32 +0000684
685===========================================================================
the.mindstorma10e6b82006-08-06 21:51:57 +00006865.1
Cedric Beustac025d52010-07-20 23:06:08 -07006872006/08/18
cbeust336f0ef2006-08-01 22:50:26 +0000688
cbeust8855dc42006-08-14 20:20:52 +0000689Added: @Test(sequential = true)
cbeustca895ef2006-08-09 21:34:51 +0000690Fixed: TESTNG-102 (Incorrect ordering of @BeforeMethod calls when a dependency is specified)
the.mindstorm997a5932006-08-11 19:34:04 +0000691Fixed: TESTNG-101 (HTML output contains nested <P> tags and a missing <tr> tag)
the.mindstorma10e6b82006-08-06 21:51:57 +0000692Added: support for specifying test-only classpath (http://forums.opensymphony.com/thread.jspa?messageID=78048&tstart=0)
693Fixed: TESTNG-93 (method selectors filtering @BeforeMethod)
694Fixed: TESTNG-81 (Assert.assertFalse() displays wrong expected, actual value)
695Fixed: TESTNG-59 (multiple method selectors usage results in no tests run)
696Fixed: TESTNG-56 (invocation of @Before/AfterClass methods in parallel/sequential scenarios)
697Fixed: TESTNG-40 (failures suite does not contain @Before/After Suite/Test methods)
698Fixed: TESTNG-37 (allow passing null parameter value from testng.xml)
699Fixed: TESTNG-7 (display classname when hovering method)
700
701
702Eclipse plug-in
703
704Added: run contextual test classes with parameters from suite definition files
705Added: TESTNG-100 (Show HTML reports after running tests)
the.mindstorm13e8f502006-08-11 20:27:14 +0000706Added: TESTNG-97 (Double click top stack to raise comparison)
the.mindstorma10e6b82006-08-06 21:51:57 +0000707Added: TESTNG-84 (plug-in UI for suite option should support absolute path)
708Added: TESTNG-20 (copy stack trace)
709
710Fixed: TESTNG-72 (display groups with non-array values)
711Fixed: TESTNG-64 (Eclipse plug-in applies added groups to all launch configurations)
712Fixed: TESTNG-28 (Cannot select groups from dependent eclipse projects)
713Fixed: TESTNG-25 (do not display fully qualified method name when running contextual test class)
714
715Improved behavior:
716 TESTNG-98 (temporary files have guaranteed fixed names)
717 TESTNG-95 (Assertion failed comparison trims trailing ">")
cbeust96761aa2006-08-15 17:31:35 +0000718 TESTNG-70 (TestNG prevents eclipse from opening an older CVS version of a java class)
the.mindstorma10e6b82006-08-06 21:51:57 +0000719 display of test hierarchy information (TESTNG-29)
720
cbeust336f0ef2006-08-01 22:50:26 +0000721===========================================================================
722
7235.0.1
724
725Eclipse plug-in
726
727Added: Output directory for the tests
728Added: Can now specify listener classes
729
730===========================================================================
7315.0.1
732
733Fixed: reports generated by SuiteHTMLReporter do not work with JDK1.4
734
735===========================================================================
736
7375.0
Cedric Beustac025d52010-07-20 23:06:08 -07007382009/04/01
cbeust336f0ef2006-08-01 22:50:26 +0000739
740Added: Ant task: support for JVM, workingDir, timeout
741Added: Stack traces can be interactively shown in the HTML reports
742Added: Link to testng.xml in the reports
743Added: New structure for reports, suites go in their individual directory
744Added: @Test(suiteName) and @Test(testName)
745Added: The stack traces in reports do not include TestNG frames (system property testng.exception)
746 (see: http://groups.google.com/group/testng-dev/browse_thread/thread/9f4d46ade10b0fda)
747Fixed: Exit with error when no methods are run
748 (see: http://groups.google.com/group/testng-dev/browse_thread/thread/3c26e8a5658f22ac)
749Added: List of methods in alphabetical order
750Fixed: Class-scoped annotations were not recognized when inherited
751Added: Deprecated @Configuration and introduced @BeforeSuite/Test/Class/TestMethod
752Added: Deprecated @ExpectedExceptions and moved it into @Test
753Added: expectedExceptions to @Test, deprecated @ExpectedExceptions
754Added: New annotations: @BeforeSuite, @BeforeTest, etc...
755Fixed: Was returning an exit code of 0 if a cyclic graph was detected
756Added: Interface org.testng.ITest so that tests can declare a name
757Fixed: The Text reporter was reporting the square of the actual number of methods
758Fixed: Bug reported by Eran about dependencies with an afterClass method
759Added: IHookCallBack now receives the ITestResult in its run() method
760Added: Name of suite for command line can be set with -Dtestng.suite.name=xxx
761Fixed: TestNGAntTask was hardcoding m_haltOnFSP to true
762Fixed: Passing a null parameter caused an NPE in the reports
763Added: "listener" to the ant task (and documentation)
764Added: if patch-testng-sourcedir.properties is found in the classpath
765 with a property "sourcedir" containing a ; separated list of
766 directories, this list will override -sourcedir.
767
768===========================================================================
769
770
7714.7
772
773Added: Maven 2 plug-in
774Fixed: Message formattings in TestNG assertion utility class
775Fixed: @Factory methods were counted as @Test as well
776 http://jira.opensymphony.com/browse/TESTNG-51
777Fixed: All DataProvider parameters were shown in the HTML report
778Fixed: Bug in testng-failed.xml generation
779Fixed: <packages> bug when using a jar file to load the test classes
780Added: alwaysRun for before @Configuration methods
781 http://jira.opensymphony.com/browse/TESTNG-35
782Fixed: groupless @Configurations were not invoked if a method depends on a group
783 http://jira.opensymphony.com/browse/TESTNG-45
784Added: beforeGroups/afterGroups to @Configuration
785
786Eclipse plugin:
787
788Added: last contextual launch is available in Eclipse launcher lists
789Fixed: 3.2M5 integration (removed dependency on non-existing class)
790Fixed: testng-failures.xml generation
791
792===========================================================================
793
7944.6
Cedric Beustac025d52010-07-20 23:06:08 -07007952006/27/02
cbeust336f0ef2006-08-01 22:50:26 +0000796
797Added: Documentation contains the new reports
798Added: TestNG.setUseDefaultListeners(boolean)
799Added: Descriptions now appear in TextReporter (verbose>=2) and the HTML reports
800Added: description attribute to @Test and @Configuration
801Added: combined Reporter output in the reports
802Added: methods not run in the reports
803Added: org.testng.IReporter
804Added: threadPoolSize to @Test
805Added: Reports now show relative timings (start at 0)
806Added: Reports now show different colors depending on the methods' classes
807Added: Reports now show all parameters used to invoke the test method
808Added: org.testng.Reporter
809Added: DataProviders can accept a Method as first parameter
810Fixed: Extraneous implicit inclusion of a method
811
812Eclipse plugin:
813
814Added: Run/Debug as TestNG test from the editor contextual menu
815Fixed: TESTNG-24: 'Run as testng test' does not appear of the Test annotation does not have a group
816Fixed: TESTNG-18: Eclipse plugin ignores Factory annotation
817Fixed: TESTNG-21: Show differences when double clicking assertion exceptions
818Added: UI allows setting orientation (even more space)
819 http://forums.opensymphony.com/thread.jspa?threadID=17225&messageID=33805#33805
820
821===========================================================================
822
8234.5
Cedric Beustac025d52010-07-20 23:06:08 -07008242007/07/02
cbeust336f0ef2006-08-01 22:50:26 +0000825
826Core:
827
828Fixed: Methods were not implicitly included, only groups
829Fixed: Bug with failed parent @Configuration don't skip child @Configuration/@Test invocations
830Fixed: Bug with overridding @Configuration methods (both parent and child were run)
831Fixed: Bug when overriding beforeClass methods in base class (cyclic graph)
832Added: Support for JAAS (see org.testng.IHookable)
833Fixed: Problem with nested classes inside <package name="foo.*"
834Fixed: If a group is not found, mark the method as a skip instead of aborting
835Fixed: testng-failed.xml was not respecting dependencies
836Fixed: class/include method in testng.xml didn't work on default package
837Fixed: DTD only allowed one <define>
838Fixed: ArrayIndexOutOfBoundsException for jMock
839Added: dependsOnMethods can contain methods from another class
840Fixed: JUnitConverter required -restore, not any more (option is now a no-op)
841Fixed: JUnit mode wasn't invoking setName() on test classes
842Added: Regular expressions for classes in <package>
843Added: Distributed TestNG
844Fixed: Command line parameters and testng.xml are now cumulative
845Fixed: Reports now work for multiple suites
846Fixed: Was ignoring abstract classes even if they have non-abstract instances
847Fixed: If setUp() failed, methods were not skipped
848Fixed: Was not clearly indicating when beforeSuite fails
849Added: @Configuration.inheritGroups
850Fixed: inconsistency between testng.xml and objects regarding method selectors
851
852Eclipse plug-in:
853
854New look for the progress view.
855
856===========================================================================
857
8584.4
859
860Core:
861
862Fixed: testng-failures.xml was not excluding methods from base classes
863Fixed: Bug in suites of suites for JUnit mode
864
865===========================================================================
866
8674.3
868
869Core:
870
871Fixed: testng-failures.xml was not excluding methods from base classes
872Fixed: Bug in suites of suites for JUnit mode
873Added: Excluded groups on command line and ant task
874Fixed: When including a group, implicitly include groups depended upon
875Fixed: When depending on several groups, wasn't skipped if one of them failed
876Fixed: Failures weren't reported accurately in the JUnitReports report
877Fixed: Wasn't throwing an exception if depending on a non-existing group
878
879===========================================================================
880
8814.2
882
883Core:
884
885Fixed: wasn't excluding methods in base classes
886Added: alwaysRun for tests (soft dependencies)
887Fixed: Class-level enabled=false were not honored
888Fixed: Bug with multiple dataproviders on same class
889Fixed: Bug with dataprovider defined in the parent class
890Fixed: Bug with dataprovider defined in a subclass
891Fixed: Bug with dataprovider defined in an abstract class
892Fixed: testng-failures generation was excluding the methods even if a failed test depended on it
893
894===========================================================================
895
8964.1
897
898Core:
899
900Added: @DataProviders can return Iterable<Object[]>
901Fixed: Superclass test methods were not called in the presence of a class @Test
902Added: Reporter class to log messages in the HTML reports
903
904===========================================================================
905
9064.0
Cedric Beustac025d52010-07-20 23:06:08 -07009072005/11/10
cbeust336f0ef2006-08-01 22:50:26 +0000908
909Core:
910
911Fixed: suite methods now invoked only once in a hierarchy
912Added: @DataProvider and @testng.data-provider
913Fixed: Interleave order now respected for before/afterClass methods
914Added: Can now invoke java -jar testng-2.6.jar <...>
915Added: Support for BeanShell
916Added: Method Selectors (IMethodSelector)
917Fixed: In the absence of dependencies, @Configuration methods respect inheritance
918Fixed: Bug in multithreaded dependencies on methods
919Fixed: dependsOnGroups wasn't working on regular expressions
920Fixed: Bug in <package> when directories contain spaces in their names
921Fixed: Introduced a JDK5 dependency in the JDK1.4 build (getEnclosingClass())
922Fixed: Output directory in ant task was not honored if it didn't exist
923Fixed: Problem with timeout according to
924 http://forums.opensymphony.com/thread.jspa?threadID=6707
925
926Eclipse plug-in:
927
928Fixed: Wasn't handling linked directories correctly
929Fixed: Bug in QuickFix implementation
930Added: Quick Fix for JUnit conversion (Annotations and JavaDoc)
931Fixed: Methods Run as TestNG test
932Added: Package level Run as TestNG test
933Fixed: Resources from the linked directories are using a wrong path when
934 passed to command line TestNG
935
936IDEA plug-in:
937
938Added: Support for JDK 1.4 (both projects and IDEA itself)
939Fixed: Classes that contained only configuration were ignored
940
941===========================================================================
942
9432.5
Cedric Beustac025d52010-07-20 23:06:08 -07009442005/08/08
cbeust336f0ef2006-08-01 22:50:26 +0000945
946Added: ITestListener.onTestStart(ITestResult)
947Added: Support for <packages>
948Added: Resource files for easier ant taskdefs
949Fixed: @Configuration methods were not invoked with individual test methods
950Fixed: Bug with ExpectedExceptions
951Fixed: Didn't support nested factory classes
952Fixed: NPE if -target is omitted with JDK 1.4
953Fixed: @Configuration failures in a class would cause other classes to fail
954Added: alwaysRun
955Fixed: beforeTestClass/afterTestClass were broken for a pathological case
956Added: @Configuration(alwaysRun)
957Added: JUnitConverter task
958Fixed: < and > characters in reports were not escaped
959
960Eclipse plug-in:
961
962Fixed: Class dialog wasn't showing @Factory classes
963
964IDEA plug-in:
965
966First release!
967
968Documentation:
969
970Added: Brand new look!!!
971Added: Section on testng.xml
972Fixed: Numbering of sections
973
974===========================================================================
975
9762.4
Cedric Beustac025d52010-07-20 23:06:08 -07009772005/07/05
978
cbeust336f0ef2006-08-01 22:50:26 +0000979Changed: New package: testng.org
980Fixed: Bug with @ExpectedException occuring the parallel mode
981Fixed: Bug with parameters and beforeTest
982Added: IInstanceInfo support
983Fixed: methods were not excluded when included by groups
984Fixed: testng-failures.xml is now including also the beforeSuite/afterSuite methods
985Fixed: generating the testng-failures.xml is now working as expected
986Fixed: Factories call all the tests even if some of them fail along the way
987Fixed: Better JUnit support (wasn't creating individual instances)
988Fixed: dependsOnGroups didn't work across different classes
989Added: command line (and Ant) -groups option
990Added: @Parameters (and made parameters attribute deprecated)
991Added: Parameters for constructors
992Fixed: Better interleaving of before/afterTestMethods
993Fixed: Ant task
994Fixed: TestNGException thrown when TestNG conditions are not fulfilled
995
996Documentation:
997- New assert classes
998- New ways to launch
999- JUnitConverter documentation
1000- new beforeSuite/afterSuite
1001
1002===========================================================================
1003
10042.3
Cedric Beustac025d52010-07-20 23:06:08 -070010052005/04/12
cbeust336f0ef2006-08-01 22:50:26 +00001006
1007Fixed: Spaces are now legal in JavaDoc comments
1008Added: documentation for @Factory
1009Fixed: factories were called multiple times
1010Added: beforeSuite and afterSuite
1011Fixed: inheritance and scope now working properly for annotations
1012Fixed: dependsOnMethods wasn't working for 1.4
1013Added: Better stack traces
1014Added: Better syntax for included/excluded methods
1015Fixed: Better verbose support
1016Fixed: Various fixes for the Eclipse plug-in
1017Added: Can specify a class name on the command line
1018Fixed: Default package bug in JUnitConverter
1019Added: Regression tests for JUnitConverter
1020Added: -quiet option to JUnitConverter
1021
1022===========================================================================
1023
10242.2
1025
1026Fixed: Wasn't handling several testng.xml files correctly
1027Fixed: Renamed -src to -sourcedir
1028Fixed: Complains if no sourcedir is specified in 1.4
1029Added: In 1.4, don't require annotations="javadoc"
1030Fixed: If setUp fails, complain and mark test methods as skips
1031Fixed: Dependent methods weren't working for 1.4
1032
1033===========================================================================
1034
10352.1
Cedric Beustac025d52010-07-20 23:06:08 -070010362005/02/12
cbeust336f0ef2006-08-01 22:50:26 +00001037
1038Added: Parser can accept an InputStream for testng.xml
1039Fixed: expected-exceptions now fails if test passes
1040Fixed: reports now use the suite name in HTML
1041Added: invocationCount and successPercentage
1042Added: dependsOnMethods
1043Added: timeOut works in non-parallel mode
1044
1045===========================================================================
1046
10472.0
Cedric Beustac025d52010-07-20 23:06:08 -070010482004/12/06
cbeust336f0ef2006-08-01 22:50:26 +00001049
1050Added: port on JDK 1.4
1051
1052===========================================================================
1053
10541.3
1055
1056Added: new view: classes (still experimental)
1057Added: timeout on methods
1058Added: thread-count
1059Added: TestNG is now multithread, see "parallel" in <suite>
1060
1061===========================================================================
1062
10631.2
1064
1065Added: JUnitConverter
1066Fixed: Bug with afterClasses (test: AfterClassCalledAtTheEnd)
1067
1068===========================================================================
1069
10701.1
1071
1072Added: new links for methods and groups in the HTML report
1073Added: <methods>
1074Added: <fileset> to <testng>
1075
1076===========================================================================
1077
10781.0
Cedric Beustac025d52010-07-20 23:06:08 -070010792004/04/28
1080http://beust.com/weblog/2004/04/28/
cbeust336f0ef2006-08-01 22:50:26 +00001081
1082Fixed: Updated to the new DTD
1083Fixed: Suite table of contents displays failures first
1084Fixed: Bug in afterTestClass
1085Added: Validating testng.xml
1086Added: Scoped parameters
1087Added: testng.xml
1088Removed: Property quiet
1089Changed: Verbose is now an integer
1090Added: Dependent methods
1091
1092===========================================================================
1093
10940.9
1095
1096Added: Groups of groups
1097Added: Groups for Configuration methods
1098Added: Parameters
1099
1100===========================================================================
1101
11020.2
1103
1104Fixed: Merged TestMethod and TestClass into Test
1105Added: HTML report
1106Added: Regexps for groups
1107Fixed: Inheritance of methods
1108Fixed: ExpectedException is now called ExpectedExceptions