Janis Danisevskis | 53e448c | 2016-03-31 13:35:25 +0100 | [diff] [blame] | 1 | News about PCRE2 releases |
| 2 | ------------------------- |
| 3 | |
Elliott Hughes | 653c210 | 2019-01-09 15:41:36 -0800 | [diff] [blame] | 4 | |
Elliott Hughes | 378b175 | 2021-06-08 13:42:40 -0700 | [diff] [blame^] | 5 | Version 10.37 26-May-2021 |
| 6 | ------------------------- |
| 7 | |
| 8 | A few more bug fixes and tidies. The only change of real note is the removal of |
| 9 | the actual POSIX names regcomp etc. from the POSIX wrapper library because |
| 10 | these have caused issues for some applications (see 10.33 #2 below). |
| 11 | |
| 12 | |
Elliott Hughes | 3435c42 | 2020-12-04 13:18:28 -0800 | [diff] [blame] | 13 | Version 10.36 04-December-2020 |
| 14 | ------------------------------ |
| 15 | |
| 16 | Again, mainly bug fixes and tidies. The only enhancements are the addition of |
| 17 | GNU grep's -m (aka --max-count) option to pcre2grep, and also unifying the |
| 18 | handling of substitution strings for both -O and callouts in pcre2grep, with |
| 19 | the addition of $x{...} and $o{...} to allow for characters whose code points |
| 20 | are greater than 255 in Unicode mode. |
| 21 | |
| 22 | NOTE: there is an outstanding issue with JIT support for MacOS on arm64 |
| 23 | hardware. For details, please see Bugzilla issue #2618. |
| 24 | |
| 25 | |
Elliott Hughes | 2dbd7d2 | 2020-06-03 14:32:37 -0700 | [diff] [blame] | 26 | Version 10.35 15-April-2020 |
| 27 | --------------------------- |
| 28 | |
| 29 | Bugfixes, tidies, and a few new enhancements. |
| 30 | |
| 31 | 1. Capturing groups that contain recursive backreferences to themselves are no |
| 32 | longer automatically atomic, because the restriction is no longer necessary |
| 33 | as a result of the 10.30 restructuring. |
| 34 | |
| 35 | 2. Several new options for pcre2_substitute(). |
| 36 | |
| 37 | 3. When Unicode is supported and PCRE2_UCP is set without PCRE2_UTF, Unicode |
| 38 | character properties are used for upper/lower case computations on characters |
| 39 | whose code points are greater than 127. |
| 40 | |
| 41 | 4. The character tables (for low-valued characters) can now more easily be |
| 42 | saved and restored in binary. |
| 43 | |
| 44 | 5. Updated to Unicode 13.0.0. |
| 45 | |
| 46 | |
| 47 | Version 10.34 21-November-2019 |
| 48 | ------------------------------ |
| 49 | |
| 50 | Another release with a few enhancements as well as bugfixes and tidies. The |
| 51 | main new features are: |
| 52 | |
| 53 | 1. There is now some support for matching in invalid UTF strings. |
| 54 | |
| 55 | 2. Non-atomic positive lookarounds are implemented in the pcre2_match() |
| 56 | interpreter, but not in JIT. |
| 57 | |
| 58 | 3. Added two new functions: pcre2_get_match_data_size() and |
| 59 | pcre2_maketables_free(). |
| 60 | |
| 61 | 4. Upgraded to Unicode 12.1.0. |
| 62 | |
| 63 | |
| 64 | Version 10.33 16-April-2019 |
| 65 | --------------------------- |
Elliott Hughes | 0c26e19 | 2019-08-07 12:24:46 -0700 | [diff] [blame] | 66 | |
| 67 | Yet more bugfixes, tidies, and a few enhancements, summarized here (see |
| 68 | ChangeLog for the full list): |
| 69 | |
| 70 | 1. Callouts from pcre2_substitute() are now available. |
| 71 | |
| 72 | 2. The POSIX functions are now all called pcre2_regcomp() etc., with wrapper |
| 73 | functions that use the standard POSIX names. However, in pcre2posix.h the POSIX |
| 74 | names are defined as macros. This should help avoid linking with the wrong |
| 75 | library in some environments, while still exporting the POSIX names for |
| 76 | pre-existing programs that use them. |
| 77 | |
| 78 | 3. Some new options: |
| 79 | |
| 80 | (a) PCRE2_EXTRA_ESCAPED_CR_IS_LF makes \r behave as \n. |
| 81 | |
| 82 | (b) PCRE2_EXTRA_ALT_BSUX enables support for ECMAScript 6's \u{hh...} |
| 83 | construct. |
| 84 | |
| 85 | (c) PCRE2_COPY_MATCHED_SUBJECT causes a copy of a matched subject to be |
| 86 | made, instead of just remembering a pointer. |
| 87 | |
| 88 | 4. Some new Perl features: |
| 89 | |
| 90 | (a) Perl 5.28's experimental alphabetic names for atomic groups and |
| 91 | lookaround assertions, for example, (*pla:...) and (*atomic:...). |
| 92 | |
| 93 | (b) The new Perl "script run" features (*script_run:...) and |
| 94 | (*atomic_script_run:...) aka (*sr:...) and (*asr:...). |
| 95 | |
| 96 | (c) When PCRE2_UTF is set, allow non-ASCII letters and decimal digits in |
| 97 | capture group names. |
| 98 | |
| 99 | 5. --disable-percent-zt disables the use of %zu and %td in formatting strings |
| 100 | in pcre2test. They were already automatically disabled for VC and older C |
| 101 | compilers. |
| 102 | |
| 103 | 6. Some changes related to callouts in pcre2grep: |
| 104 | |
| 105 | (a) Support for running an external program under VMS has been added, in |
| 106 | addition to Windows and fork() support. |
| 107 | |
| 108 | (b) --disable-pcre2grep-callout-fork restricts the callout support in |
| 109 | to the inbuilt echo facility. |
| 110 | |
| 111 | |
Elliott Hughes | 653c210 | 2019-01-09 15:41:36 -0800 | [diff] [blame] | 112 | Version 10.32 10-September-2018 |
| 113 | ------------------------------- |
| 114 | |
| 115 | This is another mainly bugfix and tidying release with a few minor |
| 116 | enhancements. These are the main ones: |
| 117 | |
| 118 | 1. pcre2grep now supports the inclusion of binary zeros in patterns that are |
| 119 | read from files via the -f option. |
| 120 | |
| 121 | 2. ./configure now supports --enable-jit=auto, which automatically enables JIT |
| 122 | if the hardware supports it. |
| 123 | |
| 124 | 3. In pcre2_dfa_match(), internal recursive calls no longer use the stack for |
| 125 | local workspace and local ovectors. Instead, an initial block of stack is |
| 126 | reserved, but if this is insufficient, heap memory is used. The heap limit |
| 127 | parameter now applies to pcre2_dfa_match(). |
| 128 | |
| 129 | 4. Updated to Unicode version 11.0.0. |
| 130 | |
| 131 | 5. (*ACCEPT:ARG), (*FAIL:ARG), and (*COMMIT:ARG) are now supported. |
| 132 | |
| 133 | 6. Added support for \N{U+dddd}, but only in Unicode mode. |
| 134 | |
| 135 | 7. Added support for (?^) to unset all imnsx options. |
| 136 | |
| 137 | |
Elliott Hughes | 9bc971b | 2018-07-27 13:23:14 -0700 | [diff] [blame] | 138 | Version 10.31 12-February-2018 |
| 139 | ------------------------------ |
| 140 | |
| 141 | This is mainly a bugfix and tidying release (see ChangeLog for full details). |
| 142 | However, there are some minor enhancements. |
| 143 | |
| 144 | 1. New pcre2_config() options: PCRE2_CONFIG_NEVER_BACKSLASH_C and |
| 145 | PCRE2_CONFIG_COMPILED_WIDTHS. |
| 146 | |
| 147 | 2. New pcre2_pattern_info() option PCRE2_INFO_EXTRAOPTIONS to retrieve the |
| 148 | extra compile time options. |
| 149 | |
| 150 | 3. There are now public names for all the pcre2_compile() error numbers. |
| 151 | |
| 152 | 4. Added PCRE2_CALLOUT_STARTMATCH and PCRE2_CALLOUT_BACKTRACK bits to a new |
| 153 | field callout_flags in callout blocks. |
| 154 | |
| 155 | |
| 156 | Version 10.30 14-August-2017 |
| 157 | ---------------------------- |
| 158 | |
| 159 | The full list of changes that includes bugfixes and tidies is, as always, in |
| 160 | ChangeLog. These are the most important new features: |
| 161 | |
| 162 | 1. The main interpreter, pcre2_match(), has been refactored into a new version |
| 163 | that does not use recursive function calls (and therefore the system stack) for |
| 164 | remembering backtracking positions. This makes --disable-stack-for-recursion a |
| 165 | NOOP. The new implementation allows backtracking into recursive group calls in |
| 166 | patterns, making it more compatible with Perl, and also fixes some other |
| 167 | previously hard-to-do issues. For patterns that have a lot of backtracking, the |
Elliott Hughes | 653c210 | 2019-01-09 15:41:36 -0800 | [diff] [blame] | 168 | heap is now used, and there is an explicit limit on the amount, settable by |
Elliott Hughes | 9bc971b | 2018-07-27 13:23:14 -0700 | [diff] [blame] | 169 | pcre2_set_heap_limit() or (*LIMIT_HEAP=xxx). The "recursion limit" is retained, |
| 170 | but is renamed as "depth limit" (though the old names remain for |
| 171 | compatibility). |
| 172 | |
| 173 | There is also a change in the way callouts from pcre2_match() are handled. The |
| 174 | offset_vector field in the callout block is no longer a pointer to the |
| 175 | actual ovector that was passed to the matching function in the match data |
| 176 | block. Instead it points to an internal ovector of a size large enough to hold |
| 177 | all possible captured substrings in the pattern. |
| 178 | |
| 179 | 2. The new option PCRE2_ENDANCHORED insists that a pattern match must end at |
| 180 | the end of the subject. |
| 181 | |
| 182 | 3. The new option PCRE2_EXTENDED_MORE implements Perl's /xx feature, and |
| 183 | pcre2test is upgraded to support it. Setting within the pattern by (?xx) is |
| 184 | also supported. |
| 185 | |
| 186 | 4. (?n) can be used to set PCRE2_NO_AUTO_CAPTURE, because Perl now has this. |
| 187 | |
| 188 | 5. Additional compile options in the compile context are now available, and the |
| 189 | first two are: PCRE2_EXTRA_ALLOW_SURROGATE_ESCAPES and |
Elliott Hughes | 653c210 | 2019-01-09 15:41:36 -0800 | [diff] [blame] | 190 | PCRE2_EXTRA_BAD_ESCAPE_IS_LITERAL. |
Elliott Hughes | 9bc971b | 2018-07-27 13:23:14 -0700 | [diff] [blame] | 191 | |
| 192 | 6. The newline type PCRE2_NEWLINE_NUL is now available. |
| 193 | |
| 194 | 7. The match limit value now also applies to pcre2_dfa_match() as there are |
| 195 | patterns that can use up a lot of resources without necessarily recursing very |
| 196 | deeply. |
| 197 | |
| 198 | 8. The option REG_PEND (a GNU extension) is now available for the POSIX |
| 199 | wrapper. Also there is a new option PCRE2_LITERAL which is used to support |
| 200 | REG_NOSPEC. |
| 201 | |
| 202 | 9. PCRE2_EXTRA_MATCH_LINE and PCRE2_EXTRA_MATCH_WORD are implemented for the |
| 203 | benefit of pcre2grep, and pcre2grep's -F, -w, and -x options are re-implemented |
| 204 | using PCRE2_LITERAL, PCRE2_EXTRA_MATCH_WORD, and PCRE2_EXTRA_MATCH_LINE. This |
| 205 | is tidier and also fixes some bugs. |
| 206 | |
| 207 | 10. The Unicode tables are upgraded from Unicode 8.0.0 to Unicode 10.0.0. |
| 208 | |
| 209 | 11. There are some experimental functions for converting foreign patterns |
| 210 | (globs and POSIX patterns) into PCRE2 patterns. |
| 211 | |
| 212 | |
| 213 | Version 10.23 14-February-2017 |
| 214 | ------------------------------ |
| 215 | |
| 216 | 1. ChangeLog has the details of a lot of bug fixes and tidies. |
| 217 | |
| 218 | 2. There has been a major re-factoring of the pcre2_compile.c file. Most syntax |
| 219 | checking is now done in the pre-pass that identifies capturing groups. This has |
| 220 | reduced the amount of duplication and made the code tidier. While doing this, |
| 221 | some minor bugs and Perl incompatibilities were fixed (see ChangeLog for |
| 222 | details.) |
| 223 | |
| 224 | 3. Back references are now permitted in lookbehind assertions when there are |
| 225 | no duplicated group numbers (that is, (?| has not been used), and, if the |
| 226 | reference is by name, there is only one group of that name. The referenced |
| 227 | group must, of course be of fixed length. |
| 228 | |
| 229 | 4. \g{+<number>} (e.g. \g{+2} ) is now supported. It is a "forward back |
| 230 | reference" and can be useful in repetitions (compare \g{-<number>} ). Perl does |
| 231 | not recognize this syntax. |
| 232 | |
| 233 | 5. pcre2grep now automatically expands its buffer up to a maximum set by |
| 234 | --max-buffer-size. |
| 235 | |
| 236 | 6. The -t option (grand total) has been added to pcre2grep. |
| 237 | |
| 238 | 7. A new function called pcre2_code_copy_with_tables() exists to copy a |
| 239 | compiled pattern along with a private copy of the character tables that is |
| 240 | uses. |
| 241 | |
| 242 | 8. A user supplied a number of patches to upgrade pcre2grep under Windows and |
| 243 | tidy the code. |
| 244 | |
| 245 | 9. Several updates have been made to pcre2test and test scripts (see |
| 246 | ChangeLog). |
| 247 | |
| 248 | |
Janis Danisevskis | 8b979b2 | 2016-08-15 16:09:16 +0100 | [diff] [blame] | 249 | Version 10.22 29-July-2016 |
| 250 | -------------------------- |
| 251 | |
| 252 | 1. ChangeLog has the details of a number of bug fixes. |
| 253 | |
| 254 | 2. The POSIX wrapper function regcomp() did not used to support back references |
| 255 | and subroutine calls if called with the REG_NOSUB option. It now does. |
| 256 | |
| 257 | 3. A new function, pcre2_code_copy(), is added, to make a copy of a compiled |
| 258 | pattern. |
| 259 | |
| 260 | 4. Support for string callouts is added to pcre2grep. |
| 261 | |
| 262 | 5. Added the PCRE2_NO_JIT option to pcre2_match(). |
| 263 | |
| 264 | 6. The pcre2_get_error_message() function now returns with a negative error |
| 265 | code if the error number it is given is unknown. |
| 266 | |
| 267 | 7. Several updates have been made to pcre2test and test scripts (see |
| 268 | ChangeLog). |
| 269 | |
| 270 | |
Janis Danisevskis | 53e448c | 2016-03-31 13:35:25 +0100 | [diff] [blame] | 271 | Version 10.21 12-January-2016 |
| 272 | ----------------------------- |
| 273 | |
| 274 | 1. Many bugs have been fixed. A large number of them were provoked only by very |
| 275 | strange pattern input, and were discovered by fuzzers. Some others were |
| 276 | discovered by code auditing. See ChangeLog for details. |
| 277 | |
| 278 | 2. The Unicode tables have been updated to Unicode version 8.0.0. |
| 279 | |
| 280 | 3. For Perl compatibility in EBCDIC environments, ranges such as a-z in a |
| 281 | class, where both values are literal letters in the same case, omit the |
| 282 | non-letter EBCDIC code points within the range. |
| 283 | |
| 284 | 4. There have been a number of enhancements to the pcre2_substitute() function, |
| 285 | giving more flexibility to replacement facilities. It is now also possible to |
| 286 | cause the function to return the needed buffer size if the one given is too |
| 287 | small. |
| 288 | |
| 289 | 5. The PCRE2_ALT_VERBNAMES option causes the "name" parts of special verbs such |
| 290 | as (*THEN:name) to be processed for backslashes and to take note of |
| 291 | PCRE2_EXTENDED. |
| 292 | |
| 293 | 6. PCRE2_INFO_HASBACKSLASHC makes it possible for a client to find out if a |
| 294 | pattern uses \C, and --never-backslash-C makes it possible to compile a version |
| 295 | PCRE2 in which the use of \C is always forbidden. |
| 296 | |
| 297 | 7. A limit to the length of pattern that can be handled can now be set by |
| 298 | calling pcre2_set_max_pattern_length(). |
| 299 | |
| 300 | 8. When matching an unanchored pattern, a match can be required to begin within |
| 301 | a given number of code units after the start of the subject by calling |
| 302 | pcre2_set_offset_limit(). |
| 303 | |
| 304 | 9. The pcre2test program has been extended to test new facilities, and it can |
| 305 | now run the tests when LF on its own is not a valid newline sequence. |
| 306 | |
| 307 | 10. The RunTest script has also been updated to enable more tests to be run. |
| 308 | |
| 309 | 11. There have been some minor performance enhancements. |
| 310 | |
| 311 | |
| 312 | Version 10.20 30-June-2015 |
| 313 | -------------------------- |
| 314 | |
| 315 | 1. Callouts with string arguments and the pcre2_callout_enumerate() function |
| 316 | have been implemented. |
| 317 | |
| 318 | 2. The PCRE2_NEVER_BACKSLASH_C option, which locks out the use of \C, is added. |
| 319 | |
| 320 | 3. The PCRE2_ALT_CIRCUMFLEX option lets ^ match after a newline at the end of a |
| 321 | subject in multiline mode. |
| 322 | |
| 323 | 4. The way named subpatterns are handled has been refactored. The previous |
| 324 | approach had several bugs. |
| 325 | |
| 326 | 5. The handling of \c in EBCDIC environments has been changed to conform to the |
| 327 | perlebcdic document. This is an incompatible change. |
| 328 | |
| 329 | 6. Bugs have been mended, many of them discovered by fuzzers. |
| 330 | |
| 331 | |
| 332 | Version 10.10 06-March-2015 |
| 333 | --------------------------- |
| 334 | |
| 335 | 1. Serialization and de-serialization functions have been added to the API, |
| 336 | making it possible to save and restore sets of compiled patterns, though |
| 337 | restoration must be done in the same environment that was used for compilation. |
| 338 | |
| 339 | 2. The (*NO_JIT) feature has been added; this makes it possible for a pattern |
| 340 | creator to specify that JIT is not to be used. |
| 341 | |
| 342 | 3. A number of bugs have been fixed. In particular, bugs that caused building |
| 343 | on Windows using CMake to fail have been mended. |
| 344 | |
| 345 | |
| 346 | Version 10.00 05-January-2015 |
| 347 | ----------------------------- |
| 348 | |
| 349 | Version 10.00 is the first release of PCRE2, a revised API for the PCRE |
| 350 | library. Changes prior to 10.00 are logged in the ChangeLog file for the old |
| 351 | API, up to item 20 for release 8.36. New programs are recommended to use the |
| 352 | new library. Programs that use the original (PCRE1) API will need changing |
| 353 | before linking with the new library. |
| 354 | |
| 355 | **** |