blob: d076c8b3838e31c3f99aac7ecb5d9f16520abf29 [file] [log] [blame] [view]
Martin Moenee8225052017-08-24 15:21:36 +02001<a id="top"></a>
Martin Hořeňovský49f59192017-08-18 20:15:00 +02002# 2.0.0 (in progress)
3
4## Breaking changes
5* Removed C++98 support
6* Removed legacy reporter support
7* Removed legacy generator support
8 * Generator support will come back later, reworked
9* Removed `Catch::toString` support
10 * The new stringification machinery uses `Catch::StringMaker` specializations first and `operator<<` overloads second.
11* Removed legacy `SCOPED_MSG` and `SCOPED_INFO` macros
Martin Hořeňovský053c29a2017-08-27 17:03:32 +020012* Removed `INTERNAL_CATCH_REGISTER_REPORTER`
13 * `CATCH_REGISTER_REPORTER` should be used to register reporters
14* Removed legacy `[hide]` tag
15 * `[.]`, `[.foo]` and `[!hide]` are still supported
Martin Hořeňovský49f59192017-08-18 20:15:00 +020016* Output into debugger is now colourized
17* `*_THROWS_AS(expr, exception_type)` now unconditionally appends `const&` to the exception type.
18* `CATCH_CONFIG_FAST_COMPILE` now affects the `CHECK_` family of assertions as well as `REQUIRE_` family of assertions
19 * This is most noticeable in `CHECK(throws())`, which would previously report failure, properly stringify the exception and continue. Now it will report failure and stop executing current section.
20
21## Improvements
22* Reporters and Listeners can be defined in files different from the main file
23 * The file has to define `CATCH_CONFIG_EXTERNAL_INTERFACES` before including catch.hpp.
24* Errors that happen during set up before main are now caught and properly reported once main is entered
25 * If you are providing your own main, you can access and use these as well.
26* New assertion macros, *_THROWS_WITH(expr, exception_type, matcher) are provided
27 * As the arguments suggest, these allow you to assert that an expression throws desired type of exception and pass the exception to a matcher.
28* JUnit reporter no longer has significantly different output for test cases with and without sections
29* Most assertions now support expressions containing commas (ie `REQUIRE(foo() == std::vector<int>{1, 2, 3});`)
30* Catch now contains experimental micro benchmarking support
31 * See `projects/SelfTest/Benchmark.tests.cpp` for examples
32 * The support being experiment means that it can be changed without prior notice
33* Catch uses new CLI parsing library (Clara)
34 * Users can now easily add new command line options to the final executable
35 * This also leads to some changes in `Catch::Session` interface
Martin Hořeňovský053c29a2017-08-27 17:03:32 +020036* All parts of matchers can be removed from a TU by defining `CATCH_CONFIG_DISABLE_MATCHERS`
37 * This can be used to somewhat speed up compilation times
38* An experimental implementation of `CATCH_CONFIG_DISABLE` has been added
39 * Speeds up compilation by removing away Catch tests
40 * Currently removes all assertions and prevents `TEST_CASE` registrations
41 * Useful for implementing tests in source files
42 * ie for functions in anonymous namespaces
43 * Inspired by Doctest's `DOCTEST_CONFIG_DISABLE`
Martin Hořeňovský49f59192017-08-18 20:15:00 +020044
45## Fixes
46
47
48## Internal changes
49* The development version now uses .cpp files instead of header files containing implementation.
50 * This makes partial rebuilds much faster during development
51* The expression decomposition layer has been rewritten
52* The evaluation layer has been rewritten
53* New library (TextFlow) is used for formatting text to output
54
55
Martin Hořeňovskýee67ac62017-06-27 12:21:48 +020056# 1.9.6
57
58### Improvements
59* Catch's runtime overhead has been significantly decreased (#937, #939)
60* Added `--list-extra-info` cli option (#934).
61 * It lists all tests together with extra information, ie filename, line number and description.
62
63
64
Martin Hořeňovský017a63d2017-06-15 13:08:26 +020065# 1.9.5
66
67### Fixes
68* Truthy expressions are now reconstructed properly, not as booleans (#914)
69* Various warnings are no longer erroneously suppressed in test files (files that include `catch.hpp`, but do not define `CATCH_CONFIG_MAIN` or `CATCH_CONFIG_RUNNER`) (#871)
70* Catch no longer fails to link when main is compiled as C++, but linked against Objective-C (#855)
71* Fixed incorrect gcc version detection when deciding to use `__COUNTER__` (#928)
72 * Previously any GCC with minor version less than 3 would be incorrectly classified as not supporting `__COUNTER__`.
73* Suppressed C4996 warning caused by upcoming updated to MSVC 2017, marking `std::uncaught_exception` as deprecated. (#927)
74
75### Improvements
76* CMake integration script now incorporates debug messages and registers tests in an improved way (#911)
77* Various documentation improvements
78
79
80
Martin Hořeňovský3dcc9232017-05-16 13:59:29 +020081# 1.9.4
82
83### Fixes
84* `CATCH_FAIL` macro no longer causes compilation error without variadic macro support
85* `INFO` messages are no longer cleared after being reported once
86
87### Improvements and minor changes
88* Catch now uses `wmain` when compiled under Windows and `UNICODE` is defined.
89 * Note that Catch still officially supports only ASCII
90
Phil Nasha0ada2e2017-04-25 14:23:06 +000091# 1.9.3
92
93### Fixes
94* Completed the fix for (lack of) uint64_t in earlier Visual Studios
95
Martin Hořeňovskýfc7f0a02017-04-25 11:08:02 +020096# 1.9.2
97
98### Improvements and minor changes
99* All of `Approx`'s member functions now accept strong typedefs in C++11 mode (#888)
100 * Previously `Approx::scale`, `Approx::epsilon`, `Approx::margin` and `Approx::operator()` didn't.
101
102
103### Fixes
104* POSIX signals are now disabled by default under QNX (#889)
105 * QNX does not support current enough (2001) POSIX specification
106* JUnit no longer counts exceptions as failures if given test case is marked as ok to fail.
107* `Catch::Option` should now have its storage properly aligned.
108* Catch no longer attempts to define `uint64_t` on windows (#862)
109 * This was causing trouble when compiled under Cygwin
110
111### Other
112* Catch is now compiled under MSVC 2017 using `std:c++latest` (C++17 mode) in CI
113* We now provide cmake script that autoregisters Catch tests into ctest.
114 * See `contrib` folder.
115
116
Martin Hořeňovskýc6990cd2017-04-09 21:25:20 +0200117# 1.9.1
118
119### Fixes
120* Unexpected exceptions are no longer ignored by default (#885, #887)
121
122
Martin Hořeňovský1b03c5a2017-04-07 22:56:36 +0200123# 1.9.0
124
125
126### Improvements and minor changes
127* Catch no longer attempts to ensure the exception type passed by user in `REQUIRE_THROWS_AS` is a constant reference.
128 * It was causing trouble when `REQUIRE_THROWS_AS` was used inside templated functions
129 * This actually reverts changes made in v1.7.2
130* Catch's `Version` struct should no longer be double freed when multiple instances of Catch tests are loaded into single program (#858)
131 * It is now a static variable in an inline function instead of being an `extern`ed struct.
132* Attempt to register invalid tag or tag alias now throws instead of calling `exit()`.
133 * Because this happen before entering main, it still aborts execution
134 * Further improvements to this are coming
135* `CATCH_CONFIG_FAST_COMPILE` now speeds-up compilation of `REQUIRE*` assertions by further ~15%.
136 * The trade-off is disabling translation of unexpected exceptions into text.
137* When Catch is compiled using C++11, `Approx` is now constructible with anything that can be explicitly converted to `double`.
138* Captured messages are now printed on unexpected exceptions
139
140### Fixes:
141* Clang's `-Wexit-time-destructors` should be suppressed for Catch's internals
142* GCC's `-Wparentheses` is now suppressed for all TU's that include `catch.hpp`.
143 * This is functionally a revert of changes made in 1.8.0, where we tried using `_Pragma` based suppression. This should have kept the suppression local to Catch's assertions, but bugs in GCC's handling of `_Pragma`s in C++ mode meant that it did not always work.
144* You can now tell Catch to use C++11-based check when checking whether a type can be streamed to output.
145 * This fixes cases when an unstreamable type has streamable private base (#877)
146 * [Details can be found in documentation](configuration.md#catch_config_cpp11_stream_insertable_check)
147
148
149### Other notes:
150* We have added VS 2017 to our CI
151* Work on Catch 2 should start soon
152
153
154
Martin Hořeňovský0c015aa2017-03-13 21:29:30 +0100155# 1.8.2
156
157
158### Improvements and minor changes
159* TAP reporter now behaves as if `-s` was always set
160 * This should be more consistent with the protocol desired behaviour.
161* Compact reporter now obeys `-d yes` argument (#780)
162 * The format is "XXX.123 s: <section-name>" (3 decimal places are always present).
163 * Before it did not report the durations at all.
164* XML reporter now behaves the same way as Console reporter in regards to `INFO`
165 * This means it reports `INFO` messages on success, if output on success (`-s`) is enabled.
166 * Previously it only reported `INFO` messages on failure.
167* `CAPTURE(expr)` now stringifies `expr` in the same way assertion macros do (#639)
Martin Moene6c09b452017-08-24 15:33:38 +0200168* Listeners are now finally [documented](event-listeners.md#top).
Martin Hořeňovský0c015aa2017-03-13 21:29:30 +0100169 * Listeners provide a way to hook into events generated by running your tests, including start and end of run, every test case, every section and every assertion.
170
171
172### Fixes:
173* Catch no longer attempts to reconstruct expression that led to a fatal error (#810)
174 * This fixes possible signal/SEH loop when processing expressions, where the signal was triggered by expression decomposition.
175* Fixed (C4265) missing virtual destructor warning in Matchers (#844)
176* `std::string`s are now taken by `const&` everywhere (#842).
177 * Previously some places were taking them by-value.
178* Catch should no longer change errno (#835).
179 * This was caused by libstdc++ bug that we now work around.
180* Catch now provides `FAIL_CHECK( ... )` macro (#765).
181 * Same as `FAIL( ... )`, but does not abort the test.
182* Functions like `fabs`, `tolower`, `memset`, `isalnum` are now used with `std::` qualification (#543).
183* Clara no longer assumes first argument (binary name) is always present (#729)
184 * If it is missing, empty string is used as default.
185* Clara no longer reads 1 character past argument string (#830)
Phil Nash06923172017-03-15 09:04:09 +0000186* Regression in Objective-C bindings (Matchers) fixed (#854)
Martin Hořeňovský0c015aa2017-03-13 21:29:30 +0100187
188
189### Other notes:
190* We have added VS 2013 and 2015 to our CI
191* Catch Classic (1.x.x) now contains its own, forked, version of Clara (the argument parser).
192
193
194
Phil Nash658b5f62017-03-01 16:06:48 +0000195# 1.8.1
196
197### Fixes
198
199Cygwin issue with `gettimeofday` - `#define` was not early enough
200
Phil Nash0952b762017-02-28 14:19:09 +0000201# 1.8.0
202
203### New features/ minor changes
204
205* Matchers have new, simpler (and documented) interface.
206 * Catch provides string and vector matchers.
Martin Moene6c09b452017-08-24 15:33:38 +0200207 * For details see [Matchers documentation](matchers.md#top).
Phil Nash0952b762017-02-28 14:19:09 +0000208* Changed console reporter test duration reporting format (#322)
209 * Old format: `Some simple comparisons between doubles completed in 0.000123s`
210 * New format: `xxx.123s: Some simple comparisons between doubles` _(There will always be exactly 3 decimal places)_
211* Added opt-in leak detection under MSVC + Windows (#439)
212 * Enable it by compiling Catch's main with `CATCH_CONFIG_WINDOWS_CRTDBG`
213* Introduced new compile-time flag, `CATCH_CONFIG_FAST_COMPILE`, trading features for compilation speed.
Martin Hořeňovskýaf1ed702017-03-03 15:03:23 +0100214 * Moves debug breaks out of tests and into implementation, speeding up test compilation time (~10% on linux).
Phil Nash0952b762017-02-28 14:19:09 +0000215 * _More changes are coming_
216* Added [TAP (Test Anything Protocol)](https://testanything.org/) and [Automake](https://www.gnu.org/software/automake/manual/html_node/Log-files-generation-and-test-results-recording.html#Log-files-generation-and-test-results-recording) reporters.
217 * These are not present in the default single-include header and need to be downloaded from GitHub separately.
Martin Moene6c09b452017-08-24 15:33:38 +0200218 * For details see [documentation about integrating with build systems](build-systems.md#top).
Phil Nash0952b762017-02-28 14:19:09 +0000219* XML reporter now reports filename as part of the `Section` and `TestCase` tags.
220* `Approx` now supports an optional margin of absolute error
Martin Moene6c09b452017-08-24 15:33:38 +0200221 * It has also received [new documentation](assertions.md#top).
Phil Nash0952b762017-02-28 14:19:09 +0000222
223### Fixes
224* Silenced C4312 ("conversion from int to 'ClassName *") warnings in the evaluate layer.
225* Fixed C4512 ("assignment operator could not be generated") warnings under VS2013.
226* Cygwin compatibility fixes
227 * Signal handling is no longer compiled by default.
228 * Usage of `gettimeofday` inside Catch should no longer cause compilation errors.
229* Improved `-Wparentheses` supression for gcc (#674)
230 * When compiled with gcc 4.8 or newer, the supression is localized to assertions only
231 * Otherwise it is supressed for the whole TU
232* Fixed test spec parser issue (with escapes in multiple names)
233
234### Other
235* Various documentation fixes and improvements
236
237
Phil Nashd08cee22017-02-13 16:15:42 +0000238# 1.7.2
239
240### Fixes and minor improvements
241Xml:
242
243(technically the first two are breaking changes but are also fixes and arguably break few if any people)
244* C-escape control characters instead of XML encoding them (which requires XML 1.1)
245* Revert XML output to XML 1.0
246* Can provide stylesheet references by extending the XML reporter
247* Added description and tags attribites to XML Reporter
248* Tags are closed and the stream flushed more eagerly to avoid stdout interpolation
249
250
251Other:
252* `REQUIRE_THROWS_AS` now catches exception by `const&` and reports expected type
253* In `SECTION`s the file/ line is now of the `SECTION`. not the `TEST_CASE`
254* Added std:: qualification to some functions from C stdlib
255* Removed use of RTTI (`dynamic_cast`) that had crept back in
256* Silenced a few more warnings in different circumstances
257* Travis improvements
258
Martin Hořeňovský7b8a27e2017-02-07 10:06:52 +0100259# 1.7.1
260
261### Fixes:
262* Fixed inconsistency in defining `NOMINMAX` and `WIN32_LEAN_AND_MEAN` inside `catch.hpp`.
263* Fixed SEH-related compilation error under older MinGW compilers, by making Windows SEH handling opt-in for compilers other than MSVC.
Martin Moene6c09b452017-08-24 15:33:38 +0200264 * For specifics, look into the [documentation](configuration.md#top).
Martin Hořeňovský7b8a27e2017-02-07 10:06:52 +0100265* Fixed compilation error under MinGW caused by improper compiler detection.
266* Fixed XML reporter sometimes leaving an empty output file when a test ends with signal/structured exception.
267* Fixed XML reporter not reporting captured stdout/stderr.
268* Fixed possible infinite recursion in Windows SEH.
269* Fixed possible compilation error caused by Catch's operator overloads being ambiguous in regards to user-defined templated operators.
270
Martin Hořeňovský7b8a27e2017-02-07 10:06:52 +0100271## 1.7.0
Martin Hořeňovskýce37f482017-02-01 21:47:43 +0100272
273### Features/ Changes:
274* Catch now runs significantly faster for passing tests
275 * Microbenchmark focused on Catch's overhead went from ~3.4s to ~0.7s.
276 * Real world test using [JSON for Modern C++](https://github.com/nlohmann/json)'s test suite went from ~6m 25s to ~4m 14s.
277* Catch can now run specific sections within test cases.
Martin Moene6c09b452017-08-24 15:33:38 +0200278 * For now the support is only basic (no wildcards or tags), for details see the [documentation](command-line.md#top).
Martin Hořeňovskýce37f482017-02-01 21:47:43 +0100279* Catch now supports SEH on Windows as well as signals on Linux.
280 * After receiving a signal, Catch reports failing assertion and then passes the signal onto the previous handler.
281* Approx can be used to compare values against strong typedefs (available in C++11 mode only).
282 * Strong typedefs mean types that are explicitly convertible to double.
283* CHECK macro no longer stops executing section if an exception happens.
284* Certain characters (space, tab, etc) are now pretty printed.
285 * This means that a `char c = ' '; REQUIRE(c == '\t');` would be printed as `' ' == '\t'`, instead of ` == 9`.
286
287### Fixes:
288* Text formatting no longer attempts to access out-of-bounds characters under certain conditions.
289* THROW family of assertions no longer trigger `-Wunused-value` on expressions containing explicit cast.
290* Breaking into debugger under OS X works again and no longer required `DEBUG` to be defined.
291* Compilation no longer breaks under certain compiler if a lambda is used inside assertion macro.
292
293### Other:
294* Catch's CMakeLists now defines install command.
295* Catch's CMakeLists now generates projects with warnings enabled.
296
297
Martin Hořeňovskýce37f482017-02-01 21:47:43 +0100298## 1.6.1
Martin Hořeňovský9a566092017-01-20 12:49:59 +0100299
300### Features/ Changes:
301* Catch now supports breaking into debugger on Linux
302
303### Fixes:
304* Generators no longer leak memory (generators are still unsupported in general)
305* JUnit reporter now reports UTC timestamps, instead of "tbd"
306* `CHECK_THAT` macro is now properly defined as `CATCH_CHECK_THAT` when using `CATCH_` prefixed macros
307
308### Other:
309* Types with overloaded `&&` operator are no longer evaluated twice when used in an assertion macro.
310* The use of `__COUNTER__` is supressed when Catch is parsed by CLion
311 * This change is not active when compiling a binary
312* Approval tests can now be run on Windows
313* CMake will now warn if a file is present in the `include` folder but not is not enumerated as part of the project
314* Catch now defines `NOMINMAX` and `WIN32_LEAN_AND_MEAN` before including `windows.h`
Martin Moene6c09b452017-08-24 15:33:38 +0200315 * This can be disabled if needed, see [documentation](configuration.md#top) for details.
Martin Hořeňovský9a566092017-01-20 12:49:59 +0100316
317
Martin Hořeňovský9a566092017-01-20 12:49:59 +0100318## 1.6.0
Phil Nash3b2f2062017-01-11 16:43:56 +0000319
320### Cmake/ projects:
321* Moved CMakeLists.txt to root, made it friendlier for CLion and generating XCode and VS projects, and removed the manually maintained XCode and VS projects.
322
323### Features/ Changes:
Phil Nash1ff0acf2017-01-11 16:50:35 +0000324* Approx now supports `>=` and `<=`
325* Can now use `\` to escape chars in test names on command line
Phil Nash3b2f2062017-01-11 16:43:56 +0000326* Standardize C++11 feature toggles
327
328### Fixes:
329* Blue shell colour
Phil Nash1ff0acf2017-01-11 16:50:35 +0000330* Missing argument to `CATCH_CHECK_THROWS`
Phil Nash3b2f2062017-01-11 16:43:56 +0000331* Don't encode extended ASCII in XML
Phil Nashe6aa1f42017-01-11 17:14:28 +0000332* use `std::shuffle` on more compilers (fixes deprecation warning/error)
Phil Nash1ff0acf2017-01-11 16:50:35 +0000333* Use `__COUNTER__` more consistently (where available)
Phil Nash3b2f2062017-01-11 16:43:56 +0000334
335### Other:
336* Tweaks and changes to scripts - particularly for Approval test - to make them more portable
337
Phil Nash3b2f2062017-01-11 16:43:56 +0000338
Phil Nash0952b762017-02-28 14:19:09 +0000339# Older versions
340Release notes were not maintained prior to v1.6.0, but you should be able to work them out from the Git history
341
Phil Nash3b2f2062017-01-11 16:43:56 +0000342---
343
Martin Moene6c09b452017-08-24 15:33:38 +0200344[Home](Readme.md#top)