cbeust | 125d247 | 2006-09-16 19:49:12 +0000 | [diff] [blame] | 1 | |
the.mindstorm | 7b73a74 | 2006-09-14 17:39:29 +0000 | [diff] [blame] | 2 | =========================================================================== |
cbeust | 125d247 | 2006-09-16 19:49:12 +0000 | [diff] [blame] | 3 | 5.3 |
| 4 | |
| 5 | Added: ant task can receive several listeners |
the.mindstorm | 7b73a74 | 2006-09-14 17:39:29 +0000 | [diff] [blame] | 6 | |
| 7 | Eclipse plug-in |
| 8 | Added: Support for configuring per project usedefaultlisteners |
cbeust | 8855dc4 | 2006-08-14 20:20:52 +0000 | [diff] [blame] | 9 | |
the.mindstorm | a10e6b8 | 2006-08-06 21:51:57 +0000 | [diff] [blame] | 10 | =========================================================================== |
cbeust | 8bee407 | 2006-08-23 23:32:32 +0000 | [diff] [blame] | 11 | 5.2 |
| 12 | |
cbeust | ae56997 | 2006-09-11 19:47:01 +0000 | [diff] [blame] | 13 | Added: "-usedefaultlisteners true/false" to command line and ant |
| 14 | Added: EmailableReporter (from Paul Mendelson) |
cbeust | 4b9824b | 2006-09-01 17:34:08 +0000 | [diff] [blame] | 15 | Added: parallel can now be "methods" or "tests". Boolean version deprecated |
cbeust | c2408c3 | 2006-08-29 17:23:22 +0000 | [diff] [blame] | 16 | Added: TestNGAntTask now uses the @ syntax to invoke TestNG |
cbeust | 26b0c78 | 2006-08-29 16:54:38 +0000 | [diff] [blame] | 17 | Added: Command line understands @ syntax |
cbeust | e24b380 | 2006-08-24 17:47:41 +0000 | [diff] [blame] | 18 | Added: JUnitConverter uses the new syntax |
| 19 | Added: -groups to JUnitConverter |
cbeust | 8bee407 | 2006-08-23 23:32:32 +0000 | [diff] [blame] | 20 | Fixed: Throw proper exception when a DataProvider declares parameters |
the.mindstorm | f91c2a6 | 2006-09-03 01:32:44 +0000 | [diff] [blame] | 21 | Added: completely revamped JUnit support (should run all kind of JUnit tests) |
| 22 | Fixed: TESTNG-40 (Bug in testng-failed.xml generation) |
the.mindstorm | 2ea9333 | 2006-09-04 23:59:44 +0000 | [diff] [blame] | 23 | Fixed: TESTNG-106 (Failed "@BeforeSuite" method just skipps the last test in xml-file) |
| 24 | Fixed: Success on 0 tests (http://forums.opensymphony.com/thread.jspa?threadID=41213) |
the.mindstorm | f91c2a6 | 2006-09-03 01:32:44 +0000 | [diff] [blame] | 25 | |
| 26 | Eclipse plug-in |
| 27 | Added: TESTNG-105 Automaticaly define TESTNG_HOME classpath variable |
cbeust | 8bee407 | 2006-08-23 23:32:32 +0000 | [diff] [blame] | 28 | |
| 29 | =========================================================================== |
the.mindstorm | a10e6b8 | 2006-08-06 21:51:57 +0000 | [diff] [blame] | 30 | 5.1 |
cbeust | 336f0ef | 2006-08-01 22:50:26 +0000 | [diff] [blame] | 31 | |
cbeust | 8855dc4 | 2006-08-14 20:20:52 +0000 | [diff] [blame] | 32 | Added: @Test(sequential = true) |
cbeust | ca895ef | 2006-08-09 21:34:51 +0000 | [diff] [blame] | 33 | Fixed: TESTNG-102 (Incorrect ordering of @BeforeMethod calls when a dependency is specified) |
the.mindstorm | 997a593 | 2006-08-11 19:34:04 +0000 | [diff] [blame] | 34 | Fixed: TESTNG-101 (HTML output contains nested <P> tags and a missing <tr> tag) |
the.mindstorm | a10e6b8 | 2006-08-06 21:51:57 +0000 | [diff] [blame] | 35 | Added: support for specifying test-only classpath (http://forums.opensymphony.com/thread.jspa?messageID=78048&tstart=0) |
| 36 | Fixed: TESTNG-93 (method selectors filtering @BeforeMethod) |
| 37 | Fixed: TESTNG-81 (Assert.assertFalse() displays wrong expected, actual value) |
| 38 | Fixed: TESTNG-59 (multiple method selectors usage results in no tests run) |
| 39 | Fixed: TESTNG-56 (invocation of @Before/AfterClass methods in parallel/sequential scenarios) |
| 40 | Fixed: TESTNG-40 (failures suite does not contain @Before/After Suite/Test methods) |
| 41 | Fixed: TESTNG-37 (allow passing null parameter value from testng.xml) |
| 42 | Fixed: TESTNG-7 (display classname when hovering method) |
| 43 | |
| 44 | |
| 45 | Eclipse plug-in |
| 46 | |
| 47 | Added: run contextual test classes with parameters from suite definition files |
| 48 | Added: TESTNG-100 (Show HTML reports after running tests) |
the.mindstorm | 13e8f50 | 2006-08-11 20:27:14 +0000 | [diff] [blame] | 49 | Added: TESTNG-97 (Double click top stack to raise comparison) |
the.mindstorm | a10e6b8 | 2006-08-06 21:51:57 +0000 | [diff] [blame] | 50 | Added: TESTNG-84 (plug-in UI for suite option should support absolute path) |
| 51 | Added: TESTNG-20 (copy stack trace) |
| 52 | |
| 53 | Fixed: TESTNG-72 (display groups with non-array values) |
| 54 | Fixed: TESTNG-64 (Eclipse plug-in applies added groups to all launch configurations) |
| 55 | Fixed: TESTNG-28 (Cannot select groups from dependent eclipse projects) |
| 56 | Fixed: TESTNG-25 (do not display fully qualified method name when running contextual test class) |
| 57 | |
| 58 | Improved behavior: |
| 59 | TESTNG-98 (temporary files have guaranteed fixed names) |
| 60 | TESTNG-95 (Assertion failed comparison trims trailing ">") |
cbeust | 96761aa | 2006-08-15 17:31:35 +0000 | [diff] [blame] | 61 | TESTNG-70 (TestNG prevents eclipse from opening an older CVS version of a java class) |
the.mindstorm | a10e6b8 | 2006-08-06 21:51:57 +0000 | [diff] [blame] | 62 | display of test hierarchy information (TESTNG-29) |
| 63 | |
cbeust | 336f0ef | 2006-08-01 22:50:26 +0000 | [diff] [blame] | 64 | =========================================================================== |
| 65 | |
| 66 | 5.0.1 |
| 67 | |
| 68 | Eclipse plug-in |
| 69 | |
| 70 | Added: Output directory for the tests |
| 71 | Added: Can now specify listener classes |
| 72 | |
| 73 | =========================================================================== |
| 74 | 5.0.1 |
| 75 | |
| 76 | Fixed: reports generated by SuiteHTMLReporter do not work with JDK1.4 |
| 77 | |
| 78 | =========================================================================== |
| 79 | |
| 80 | 5.0 |
| 81 | |
| 82 | Added: Ant task: support for JVM, workingDir, timeout |
| 83 | Added: Stack traces can be interactively shown in the HTML reports |
| 84 | Added: Link to testng.xml in the reports |
| 85 | Added: New structure for reports, suites go in their individual directory |
| 86 | Added: @Test(suiteName) and @Test(testName) |
| 87 | Added: The stack traces in reports do not include TestNG frames (system property testng.exception) |
| 88 | (see: http://groups.google.com/group/testng-dev/browse_thread/thread/9f4d46ade10b0fda) |
| 89 | Fixed: Exit with error when no methods are run |
| 90 | (see: http://groups.google.com/group/testng-dev/browse_thread/thread/3c26e8a5658f22ac) |
| 91 | Added: List of methods in alphabetical order |
| 92 | Fixed: Class-scoped annotations were not recognized when inherited |
| 93 | Added: Deprecated @Configuration and introduced @BeforeSuite/Test/Class/TestMethod |
| 94 | Added: Deprecated @ExpectedExceptions and moved it into @Test |
| 95 | Added: expectedExceptions to @Test, deprecated @ExpectedExceptions |
| 96 | Added: New annotations: @BeforeSuite, @BeforeTest, etc... |
| 97 | Fixed: Was returning an exit code of 0 if a cyclic graph was detected |
| 98 | Added: Interface org.testng.ITest so that tests can declare a name |
| 99 | Fixed: The Text reporter was reporting the square of the actual number of methods |
| 100 | Fixed: Bug reported by Eran about dependencies with an afterClass method |
| 101 | Added: IHookCallBack now receives the ITestResult in its run() method |
| 102 | Added: Name of suite for command line can be set with -Dtestng.suite.name=xxx |
| 103 | Fixed: TestNGAntTask was hardcoding m_haltOnFSP to true |
| 104 | Fixed: Passing a null parameter caused an NPE in the reports |
| 105 | Added: "listener" to the ant task (and documentation) |
| 106 | Added: if patch-testng-sourcedir.properties is found in the classpath |
| 107 | with a property "sourcedir" containing a ; separated list of |
| 108 | directories, this list will override -sourcedir. |
| 109 | |
| 110 | =========================================================================== |
| 111 | |
| 112 | |
| 113 | 4.7 |
| 114 | |
| 115 | Added: Maven 2 plug-in |
| 116 | Fixed: Message formattings in TestNG assertion utility class |
| 117 | Fixed: @Factory methods were counted as @Test as well |
| 118 | http://jira.opensymphony.com/browse/TESTNG-51 |
| 119 | Fixed: All DataProvider parameters were shown in the HTML report |
| 120 | Fixed: Bug in testng-failed.xml generation |
| 121 | Fixed: <packages> bug when using a jar file to load the test classes |
| 122 | Added: alwaysRun for before @Configuration methods |
| 123 | http://jira.opensymphony.com/browse/TESTNG-35 |
| 124 | Fixed: groupless @Configurations were not invoked if a method depends on a group |
| 125 | http://jira.opensymphony.com/browse/TESTNG-45 |
| 126 | Added: beforeGroups/afterGroups to @Configuration |
| 127 | |
| 128 | Eclipse plugin: |
| 129 | |
| 130 | Added: last contextual launch is available in Eclipse launcher lists |
| 131 | Fixed: 3.2M5 integration (removed dependency on non-existing class) |
| 132 | Fixed: testng-failures.xml generation |
| 133 | |
| 134 | =========================================================================== |
| 135 | |
| 136 | 4.6 |
| 137 | |
| 138 | Added: Documentation contains the new reports |
| 139 | Added: TestNG.setUseDefaultListeners(boolean) |
| 140 | Added: Descriptions now appear in TextReporter (verbose>=2) and the HTML reports |
| 141 | Added: description attribute to @Test and @Configuration |
| 142 | Added: combined Reporter output in the reports |
| 143 | Added: methods not run in the reports |
| 144 | Added: org.testng.IReporter |
| 145 | Added: threadPoolSize to @Test |
| 146 | Added: Reports now show relative timings (start at 0) |
| 147 | Added: Reports now show different colors depending on the methods' classes |
| 148 | Added: Reports now show all parameters used to invoke the test method |
| 149 | Added: org.testng.Reporter |
| 150 | Added: DataProviders can accept a Method as first parameter |
| 151 | Fixed: Extraneous implicit inclusion of a method |
| 152 | |
| 153 | Eclipse plugin: |
| 154 | |
| 155 | Added: Run/Debug as TestNG test from the editor contextual menu |
| 156 | Fixed: TESTNG-24: 'Run as testng test' does not appear of the Test annotation does not have a group |
| 157 | Fixed: TESTNG-18: Eclipse plugin ignores Factory annotation |
| 158 | Fixed: TESTNG-21: Show differences when double clicking assertion exceptions |
| 159 | Added: UI allows setting orientation (even more space) |
| 160 | http://forums.opensymphony.com/thread.jspa?threadID=17225&messageID=33805#33805 |
| 161 | |
| 162 | =========================================================================== |
| 163 | |
| 164 | 4.5 |
| 165 | |
| 166 | Core: |
| 167 | |
| 168 | Fixed: Methods were not implicitly included, only groups |
| 169 | Fixed: Bug with failed parent @Configuration don't skip child @Configuration/@Test invocations |
| 170 | Fixed: Bug with overridding @Configuration methods (both parent and child were run) |
| 171 | Fixed: Bug when overriding beforeClass methods in base class (cyclic graph) |
| 172 | Added: Support for JAAS (see org.testng.IHookable) |
| 173 | Fixed: Problem with nested classes inside <package name="foo.*" |
| 174 | Fixed: If a group is not found, mark the method as a skip instead of aborting |
| 175 | Fixed: testng-failed.xml was not respecting dependencies |
| 176 | Fixed: class/include method in testng.xml didn't work on default package |
| 177 | Fixed: DTD only allowed one <define> |
| 178 | Fixed: ArrayIndexOutOfBoundsException for jMock |
| 179 | Added: dependsOnMethods can contain methods from another class |
| 180 | Fixed: JUnitConverter required -restore, not any more (option is now a no-op) |
| 181 | Fixed: JUnit mode wasn't invoking setName() on test classes |
| 182 | Added: Regular expressions for classes in <package> |
| 183 | Added: Distributed TestNG |
| 184 | Fixed: Command line parameters and testng.xml are now cumulative |
| 185 | Fixed: Reports now work for multiple suites |
| 186 | Fixed: Was ignoring abstract classes even if they have non-abstract instances |
| 187 | Fixed: If setUp() failed, methods were not skipped |
| 188 | Fixed: Was not clearly indicating when beforeSuite fails |
| 189 | Added: @Configuration.inheritGroups |
| 190 | Fixed: inconsistency between testng.xml and objects regarding method selectors |
| 191 | |
| 192 | Eclipse plug-in: |
| 193 | |
| 194 | New look for the progress view. |
| 195 | |
| 196 | =========================================================================== |
| 197 | |
| 198 | 4.4 |
| 199 | |
| 200 | Core: |
| 201 | |
| 202 | Fixed: testng-failures.xml was not excluding methods from base classes |
| 203 | Fixed: Bug in suites of suites for JUnit mode |
| 204 | |
| 205 | =========================================================================== |
| 206 | |
| 207 | 4.3 |
| 208 | |
| 209 | Core: |
| 210 | |
| 211 | Fixed: testng-failures.xml was not excluding methods from base classes |
| 212 | Fixed: Bug in suites of suites for JUnit mode |
| 213 | Added: Excluded groups on command line and ant task |
| 214 | Fixed: When including a group, implicitly include groups depended upon |
| 215 | Fixed: When depending on several groups, wasn't skipped if one of them failed |
| 216 | Fixed: Failures weren't reported accurately in the JUnitReports report |
| 217 | Fixed: Wasn't throwing an exception if depending on a non-existing group |
| 218 | |
| 219 | =========================================================================== |
| 220 | |
| 221 | 4.2 |
| 222 | |
| 223 | Core: |
| 224 | |
| 225 | Fixed: wasn't excluding methods in base classes |
| 226 | Added: alwaysRun for tests (soft dependencies) |
| 227 | Fixed: Class-level enabled=false were not honored |
| 228 | Fixed: Bug with multiple dataproviders on same class |
| 229 | Fixed: Bug with dataprovider defined in the parent class |
| 230 | Fixed: Bug with dataprovider defined in a subclass |
| 231 | Fixed: Bug with dataprovider defined in an abstract class |
| 232 | Fixed: testng-failures generation was excluding the methods even if a failed test depended on it |
| 233 | |
| 234 | =========================================================================== |
| 235 | |
| 236 | 4.1 |
| 237 | |
| 238 | Core: |
| 239 | |
| 240 | Added: @DataProviders can return Iterable<Object[]> |
| 241 | Fixed: Superclass test methods were not called in the presence of a class @Test |
| 242 | Added: Reporter class to log messages in the HTML reports |
| 243 | |
| 244 | =========================================================================== |
| 245 | |
| 246 | 4.0 |
| 247 | |
| 248 | Core: |
| 249 | |
| 250 | Fixed: suite methods now invoked only once in a hierarchy |
| 251 | Added: @DataProvider and @testng.data-provider |
| 252 | Fixed: Interleave order now respected for before/afterClass methods |
| 253 | Added: Can now invoke java -jar testng-2.6.jar <...> |
| 254 | Added: Support for BeanShell |
| 255 | Added: Method Selectors (IMethodSelector) |
| 256 | Fixed: In the absence of dependencies, @Configuration methods respect inheritance |
| 257 | Fixed: Bug in multithreaded dependencies on methods |
| 258 | Fixed: dependsOnGroups wasn't working on regular expressions |
| 259 | Fixed: Bug in <package> when directories contain spaces in their names |
| 260 | Fixed: Introduced a JDK5 dependency in the JDK1.4 build (getEnclosingClass()) |
| 261 | Fixed: Output directory in ant task was not honored if it didn't exist |
| 262 | Fixed: Problem with timeout according to |
| 263 | http://forums.opensymphony.com/thread.jspa?threadID=6707 |
| 264 | |
| 265 | Eclipse plug-in: |
| 266 | |
| 267 | Fixed: Wasn't handling linked directories correctly |
| 268 | Fixed: Bug in QuickFix implementation |
| 269 | Added: Quick Fix for JUnit conversion (Annotations and JavaDoc) |
| 270 | Fixed: Methods Run as TestNG test |
| 271 | Added: Package level Run as TestNG test |
| 272 | Fixed: Resources from the linked directories are using a wrong path when |
| 273 | passed to command line TestNG |
| 274 | |
| 275 | IDEA plug-in: |
| 276 | |
| 277 | Added: Support for JDK 1.4 (both projects and IDEA itself) |
| 278 | Fixed: Classes that contained only configuration were ignored |
| 279 | |
| 280 | =========================================================================== |
| 281 | |
| 282 | 2.5 |
| 283 | |
| 284 | Added: ITestListener.onTestStart(ITestResult) |
| 285 | Added: Support for <packages> |
| 286 | Added: Resource files for easier ant taskdefs |
| 287 | Fixed: @Configuration methods were not invoked with individual test methods |
| 288 | Fixed: Bug with ExpectedExceptions |
| 289 | Fixed: Didn't support nested factory classes |
| 290 | Fixed: NPE if -target is omitted with JDK 1.4 |
| 291 | Fixed: @Configuration failures in a class would cause other classes to fail |
| 292 | Added: alwaysRun |
| 293 | Fixed: beforeTestClass/afterTestClass were broken for a pathological case |
| 294 | Added: @Configuration(alwaysRun) |
| 295 | Added: JUnitConverter task |
| 296 | Fixed: < and > characters in reports were not escaped |
| 297 | |
| 298 | Eclipse plug-in: |
| 299 | |
| 300 | Fixed: Class dialog wasn't showing @Factory classes |
| 301 | |
| 302 | IDEA plug-in: |
| 303 | |
| 304 | First release! |
| 305 | |
| 306 | Documentation: |
| 307 | |
| 308 | Added: Brand new look!!! |
| 309 | Added: Section on testng.xml |
| 310 | Fixed: Numbering of sections |
| 311 | |
| 312 | =========================================================================== |
| 313 | |
| 314 | 2.4 |
| 315 | Changed: New package: testng.org |
| 316 | Fixed: Bug with @ExpectedException occuring the parallel mode |
| 317 | Fixed: Bug with parameters and beforeTest |
| 318 | Added: IInstanceInfo support |
| 319 | Fixed: methods were not excluded when included by groups |
| 320 | Fixed: testng-failures.xml is now including also the beforeSuite/afterSuite methods |
| 321 | Fixed: generating the testng-failures.xml is now working as expected |
| 322 | Fixed: Factories call all the tests even if some of them fail along the way |
| 323 | Fixed: Better JUnit support (wasn't creating individual instances) |
| 324 | Fixed: dependsOnGroups didn't work across different classes |
| 325 | Added: command line (and Ant) -groups option |
| 326 | Added: @Parameters (and made parameters attribute deprecated) |
| 327 | Added: Parameters for constructors |
| 328 | Fixed: Better interleaving of before/afterTestMethods |
| 329 | Fixed: Ant task |
| 330 | Fixed: TestNGException thrown when TestNG conditions are not fulfilled |
| 331 | |
| 332 | Documentation: |
| 333 | - New assert classes |
| 334 | - New ways to launch |
| 335 | - JUnitConverter documentation |
| 336 | - new beforeSuite/afterSuite |
| 337 | |
| 338 | =========================================================================== |
| 339 | |
| 340 | 2.3 |
| 341 | |
| 342 | Fixed: Spaces are now legal in JavaDoc comments |
| 343 | Added: documentation for @Factory |
| 344 | Fixed: factories were called multiple times |
| 345 | Added: beforeSuite and afterSuite |
| 346 | Fixed: inheritance and scope now working properly for annotations |
| 347 | Fixed: dependsOnMethods wasn't working for 1.4 |
| 348 | Added: Better stack traces |
| 349 | Added: Better syntax for included/excluded methods |
| 350 | Fixed: Better verbose support |
| 351 | Fixed: Various fixes for the Eclipse plug-in |
| 352 | Added: Can specify a class name on the command line |
| 353 | Fixed: Default package bug in JUnitConverter |
| 354 | Added: Regression tests for JUnitConverter |
| 355 | Added: -quiet option to JUnitConverter |
| 356 | |
| 357 | =========================================================================== |
| 358 | |
| 359 | 2.2 |
| 360 | |
| 361 | Fixed: Wasn't handling several testng.xml files correctly |
| 362 | Fixed: Renamed -src to -sourcedir |
| 363 | Fixed: Complains if no sourcedir is specified in 1.4 |
| 364 | Added: In 1.4, don't require annotations="javadoc" |
| 365 | Fixed: If setUp fails, complain and mark test methods as skips |
| 366 | Fixed: Dependent methods weren't working for 1.4 |
| 367 | |
| 368 | =========================================================================== |
| 369 | |
| 370 | 2.1 |
| 371 | |
| 372 | Added: Parser can accept an InputStream for testng.xml |
| 373 | Fixed: expected-exceptions now fails if test passes |
| 374 | Fixed: reports now use the suite name in HTML |
| 375 | Added: invocationCount and successPercentage |
| 376 | Added: dependsOnMethods |
| 377 | Added: timeOut works in non-parallel mode |
| 378 | |
| 379 | =========================================================================== |
| 380 | |
| 381 | 2.0 |
| 382 | |
| 383 | Added: port on JDK 1.4 |
| 384 | |
| 385 | =========================================================================== |
| 386 | |
| 387 | 1.3 |
| 388 | |
| 389 | Added: new view: classes (still experimental) |
| 390 | Added: timeout on methods |
| 391 | Added: thread-count |
| 392 | Added: TestNG is now multithread, see "parallel" in <suite> |
| 393 | |
| 394 | =========================================================================== |
| 395 | |
| 396 | 1.2 |
| 397 | |
| 398 | Added: JUnitConverter |
| 399 | Fixed: Bug with afterClasses (test: AfterClassCalledAtTheEnd) |
| 400 | |
| 401 | =========================================================================== |
| 402 | |
| 403 | 1.1 |
| 404 | |
| 405 | Added: new links for methods and groups in the HTML report |
| 406 | Added: <methods> |
| 407 | Added: <fileset> to <testng> |
| 408 | |
| 409 | =========================================================================== |
| 410 | |
| 411 | 1.0 |
| 412 | |
| 413 | Fixed: Updated to the new DTD |
| 414 | Fixed: Suite table of contents displays failures first |
| 415 | Fixed: Bug in afterTestClass |
| 416 | Added: Validating testng.xml |
| 417 | Added: Scoped parameters |
| 418 | Added: testng.xml |
| 419 | Removed: Property quiet |
| 420 | Changed: Verbose is now an integer |
| 421 | Added: Dependent methods |
| 422 | |
| 423 | =========================================================================== |
| 424 | |
| 425 | 0.9 |
| 426 | |
| 427 | Added: Groups of groups |
| 428 | Added: Groups for Configuration methods |
| 429 | Added: Parameters |
| 430 | |
| 431 | =========================================================================== |
| 432 | |
| 433 | 0.2 |
| 434 | |
| 435 | Fixed: Merged TestMethod and TestClass into Test |
| 436 | Added: HTML report |
| 437 | Added: Regexps for groups |
| 438 | Fixed: Inheritance of methods |
| 439 | Fixed: ExpectedException is now called ExpectedExceptions |