Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 1 | **************************** |
| 2 | What's New In Python 3.4 |
| 3 | **************************** |
| 4 | |
Georg Brandl | 3b80d34 | 2012-10-28 13:37:54 +0100 | [diff] [blame] | 5 | .. :Author: Someone <email> |
| 6 | (uncomment if there is a principal author) |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 7 | |
| 8 | .. Rules for maintenance: |
| 9 | |
Nick Coghlan | 03074fd | 2012-09-30 18:51:53 +0530 | [diff] [blame] | 10 | * Anyone can add text to this document, but the maintainer reserves the |
| 11 | right to rewrite any additions. In particular, for obscure or esoteric |
| 12 | features, the maintainer may reduce any addition to a simple reference to |
| 13 | the new documentation rather than explaining the feature inline. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 14 | |
Nick Coghlan | 03074fd | 2012-09-30 18:51:53 +0530 | [diff] [blame] | 15 | * While the maintainer will periodically go through Misc/NEWS |
| 16 | and add changes, it's best not to rely on this. We know from experience |
| 17 | that any changes that aren't in the What's New documentation around the |
| 18 | time of the original release will remain largely unknown to the community |
| 19 | for years, even if they're added later. We also know from experience that |
| 20 | other priorities can arise, and the maintainer will run out of time to do |
| 21 | updates - in such cases, end users will be much better served by partial |
| 22 | notifications that at least give a hint about new features to |
| 23 | investigate. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 24 | |
| 25 | * This is not a complete list of every single change; completeness |
Nick Coghlan | 03074fd | 2012-09-30 18:51:53 +0530 | [diff] [blame] | 26 | is the purpose of Misc/NEWS. The What's New should focus on changes that |
| 27 | are visible to Python *users* and that *require* a feature release (i.e. |
| 28 | most bug fixes should only be recorded in Misc/NEWS) |
| 29 | |
| 30 | * PEPs should not be marked Final until they have an entry in What's New. |
| 31 | A placeholder entry that is just a section header and a link to the PEP |
| 32 | (e.g ":pep:`397` has been implemented") is acceptable. If a PEP has been |
| 33 | implemented and noted in What's New, don't forget to mark it as Final! |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 34 | |
| 35 | * If you want to draw your new text to the attention of the |
| 36 | maintainer, add 'XXX' to the beginning of the paragraph or |
| 37 | section. |
| 38 | |
Nick Coghlan | 03074fd | 2012-09-30 18:51:53 +0530 | [diff] [blame] | 39 | * It's OK to add just a very brief note about a change. For |
| 40 | example: "The :ref:`~socket.transmogrify()` function was added to the |
| 41 | :mod:`socket` module." The maintainer will research the change and |
| 42 | write the necessary text (if appropriate). The advantage of doing this |
| 43 | is that even if no more descriptive text is ever added, readers will at |
| 44 | least have a notification that the new feature exists and a link to the |
| 45 | relevant documentation. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 46 | |
| 47 | * You can comment out your additions if you like, but it's not |
| 48 | necessary (especially when a final release is some months away). |
| 49 | |
| 50 | * Credit the author of a patch or bugfix. Just the name is |
| 51 | sufficient; the e-mail address isn't necessary. |
| 52 | |
| 53 | * It's helpful to add the bug/patch number as a comment: |
| 54 | |
Nick Coghlan | 03074fd | 2012-09-30 18:51:53 +0530 | [diff] [blame] | 55 | The :ref:`~socket.transmogrify()` function was added to the |
| 56 | :mod:`socket` module. (Contributed by P.Y. Developer in :issue:`12345`.) |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 57 | |
| 58 | This saves the maintainer the effort of going through the Mercurial log |
| 59 | when researching a change. |
| 60 | |
Nick Coghlan | 03074fd | 2012-09-30 18:51:53 +0530 | [diff] [blame] | 61 | * Cross referencing tip: :ref:`mod.attr` will display as ``mod.attr``, |
| 62 | while :ref:`~mod.attr` will display as ``attr``. |
| 63 | |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 64 | This article explains the new features in Python 3.4, compared to 3.3. |
| 65 | |
Nick Coghlan | 03074fd | 2012-09-30 18:51:53 +0530 | [diff] [blame] | 66 | .. Python 3.4 was released on TBD. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 67 | |
Ezio Melotti | 25bbe5e | 2012-11-17 19:30:48 +0200 | [diff] [blame] | 68 | For full details, see the |
| 69 | `changelog <http://docs.python.org/3.4/whatsnew/changelog.html>`_. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 70 | |
| 71 | .. note:: Prerelease users should be aware that this document is currently in |
| 72 | draft form. It will be updated substantially as Python 3.4 moves towards |
| 73 | release, so it's worth checking back even after reading earlier versions. |
| 74 | |
| 75 | |
| 76 | .. seealso:: |
| 77 | |
Nick Coghlan | 03074fd | 2012-09-30 18:51:53 +0530 | [diff] [blame] | 78 | .. :pep:`4XX` - Python 3.4 Release Schedule |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 79 | |
| 80 | |
| 81 | Summary -- Release highlights |
| 82 | ============================= |
| 83 | |
Kristjan Valur Jonsson | a1e8244 | 2013-03-26 13:56:14 +0000 | [diff] [blame] | 84 | .. This section singles out the most important changes in Python 3.4. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 85 | Brevity is key. |
| 86 | |
| 87 | New syntax features: |
| 88 | |
| 89 | * None yet. |
| 90 | |
| 91 | New library modules: |
| 92 | |
Victor Stinner | 84e33c8 | 2013-06-21 00:31:55 +0200 | [diff] [blame] | 93 | * :mod:`enum`: Implementation of the :pep:`435`. |
Victor Stinner | 4aea4a0 | 2013-09-04 20:30:34 +0200 | [diff] [blame] | 94 | * :mod:`selectors`: High-level and efficient I/O multiplexing, built upon the |
| 95 | :mod:`select` module primitives. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 96 | |
| 97 | New built-in features: |
| 98 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 99 | * :ref:`PEP 442: Safe object finalization <pep-442>`. |
| 100 | * :ref:`PEP 445: Configurable memory allocators <pep-445>`. |
Victor Stinner | daf4555 | 2013-08-28 00:53:59 +0200 | [diff] [blame] | 101 | * :ref:`PEP 446: Make newly created file descriptors non-inheritable <pep-446>`. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 102 | |
| 103 | Implementation improvements: |
| 104 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 105 | * A more efficient :mod:`marshal` format (:issue:`16475`). |
| 106 | * Improve finalization of Python modules to avoid setting their globals |
| 107 | to None, in most cases (:issue:`18214`). |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 108 | |
| 109 | Significantly Improved Library Modules: |
| 110 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 111 | * Single-dispatch generic functions (:pep:`443`) |
| 112 | * SHA-3 (Keccak) support for :mod:`hashlib`. |
| 113 | * TLSv1.1 and TLSv1.2 support for :mod:`ssl`. |
Richard Oudkerk | 84ed9a6 | 2013-08-14 15:35:41 +0100 | [diff] [blame] | 114 | * :mod:`multiprocessing` now has option to avoid using :func:`os.fork` |
| 115 | on Unix (:issue:`8713`). |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 116 | |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 117 | Security improvements: |
| 118 | |
Christian Heimes | ad73a9c | 2013-08-10 16:36:18 +0200 | [diff] [blame] | 119 | * command line option for :ref:`isolated mode <using-on-misc-options>`, |
| 120 | :issue:`16499`. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 121 | |
| 122 | Please read on for a comprehensive list of user-facing changes. |
| 123 | |
Victor Stinner | daf4555 | 2013-08-28 00:53:59 +0200 | [diff] [blame] | 124 | .. _pep-446: |
| 125 | |
| 126 | PEP 446: Make newly created file descriptors non-inheritable |
| 127 | ============================================================ |
| 128 | |
Georg Brandl | 5642ff9 | 2013-09-15 10:37:57 +0200 | [diff] [blame] | 129 | The :pep:`446` makes newly created file descriptors :ref:`non-inheritable |
| 130 | <fd_inheritance>`. New functions and methods: |
Victor Stinner | daf4555 | 2013-08-28 00:53:59 +0200 | [diff] [blame] | 131 | |
| 132 | * :func:`os.get_inheritable`, :func:`os.set_inheritable` |
| 133 | * :func:`os.get_handle_inheritable`, :func:`os.set_handle_inheritable` |
| 134 | * :meth:`socket.socket.get_inheritable`, :meth:`socket.socket.set_inheritable` |
| 135 | |
| 136 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 137 | .. _pep-445: |
| 138 | |
| 139 | PEP 445: Add new APIs to customize Python memory allocators |
| 140 | =========================================================== |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 141 | |
Victor Stinner | 0507bf5 | 2013-07-07 02:05:46 +0200 | [diff] [blame] | 142 | The :pep:`445` adds new Application Programming Interfaces (API) to customize |
| 143 | Python memory allocators. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 144 | |
| 145 | |
Antoine Pitrou | 796564c | 2013-07-30 19:59:21 +0200 | [diff] [blame] | 146 | .. _pep-442: |
| 147 | |
| 148 | PEP 442: Safe object finalization |
| 149 | ================================= |
| 150 | |
| 151 | This PEP removes the current limitations and quirks of object finalization. |
| 152 | With it, objects with :meth:`__del__` methods, as well as generators |
| 153 | with :keyword:`finally` clauses, can be finalized when they are part of a |
| 154 | reference cycle. |
| 155 | |
Nick Coghlan | be57ab8 | 2013-09-22 21:26:30 +1000 | [diff] [blame] | 156 | As part of this change, module globals are no longer forcibly set to |
| 157 | :const:`None` during interpreter shutdown, instead relying on the normal |
| 158 | operation of the cyclic garbage collector. |
| 159 | |
Antoine Pitrou | 796564c | 2013-07-30 19:59:21 +0200 | [diff] [blame] | 160 | .. seealso:: |
| 161 | |
| 162 | :pep:`442` - Safe object finalization |
| 163 | PEP written and implemented by Antoine Pitrou |
| 164 | |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 165 | |
| 166 | Other Language Changes |
| 167 | ====================== |
| 168 | |
| 169 | Some smaller changes made to the core Python language are: |
| 170 | |
Ezio Melotti | 34808e2 | 2013-10-12 16:36:13 +0300 | [diff] [blame^] | 171 | * Unicode database updated to UCD version 6.3. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 172 | |
R David Murray | 9a2f139 | 2013-06-28 13:31:19 -0400 | [diff] [blame] | 173 | * :func:`min` and :func:`max` now accept a *default* argument that can be used |
| 174 | to specify the value they return if the iterable they are evaluating has no |
| 175 | elements. Contributed by Julian Berman in :issue:`18111`. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 176 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 177 | * Module objects are now :mod:`weakref`'able. |
| 178 | |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 179 | |
| 180 | New Modules |
| 181 | =========== |
| 182 | |
Charles-François Natali | 243d8d8 | 2013-09-04 19:02:49 +0200 | [diff] [blame] | 183 | selectors |
| 184 | --------- |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 185 | |
Charles-François Natali | 243d8d8 | 2013-09-04 19:02:49 +0200 | [diff] [blame] | 186 | The new :mod:`selectors` module allows high-level and efficient I/O |
| 187 | multiplexing, built upon the :mod:`select` module primitives. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 188 | |
| 189 | |
| 190 | Improved Modules |
| 191 | ================ |
| 192 | |
Antoine Pitrou | d6cbd34 | 2013-08-12 20:48:15 +0200 | [diff] [blame] | 193 | aifc |
| 194 | ---- |
| 195 | |
| 196 | The :meth:`~aifc.getparams` method now returns a namedtuple rather than a |
| 197 | plain tuple. (Contributed by Claudiu Popa in :issue:`17818`.) |
| 198 | |
| 199 | |
| 200 | colorsys |
| 201 | -------- |
| 202 | |
| 203 | The number of digits in the coefficients for the RGB --- YIQ conversions have |
| 204 | been expanded so that they match the FCC NTSC versions. The change in |
| 205 | results should be less than 1% and may better match results found elsewhere. |
| 206 | |
R David Murray | 8e37d5d | 2013-04-13 14:49:48 -0400 | [diff] [blame] | 207 | |
Nick Coghlan | b39fd0c | 2013-05-06 23:59:20 +1000 | [diff] [blame] | 208 | dis |
| 209 | --- |
| 210 | |
| 211 | The :mod:`dis` module is now built around an :class:`Instruction` class that |
| 212 | provides details of individual bytecode operations and a |
| 213 | :func:`get_instructions` iterator that emits the Instruction stream for a |
| 214 | given piece of Python code. The various display tools in the :mod:`dis` |
| 215 | module have been updated to be based on these new components. |
| 216 | |
| 217 | The new :class:`dis.Bytecode` class provides an object-oriented API for |
| 218 | inspecting bytecode, both in human-readable form and for iterating over |
| 219 | instructions. |
| 220 | |
| 221 | (Contributed by Nick Coghlan, Ryan Kelly and Thomas Kluyver in :issue:`11816`) |
| 222 | |
Antoine Pitrou | d6cbd34 | 2013-08-12 20:48:15 +0200 | [diff] [blame] | 223 | |
R David Murray | 5a9d706 | 2012-11-21 15:09:21 -0500 | [diff] [blame] | 224 | doctest |
| 225 | ------- |
| 226 | |
R David Murray | 5707d50 | 2013-06-23 14:24:13 -0400 | [diff] [blame] | 227 | Added :data:`~doctest.FAIL_FAST` flag to halt test running as soon as the first |
| 228 | failure is detected. (Contributed by R. David Murray and Daniel Urban in |
| 229 | :issue:`16522`.) |
| 230 | |
| 231 | Updated the doctest command line interface to use :mod:`argparse`, and added |
| 232 | ``-o`` and ``-f`` options to the interface. ``-o`` allows doctest options to |
| 233 | be specified on the command line, and ``-f`` is a shorthand for ``-o |
| 234 | FAIL_FAST`` (to parallel the similar option supported by the :mod:`unittest` |
| 235 | CLI). (Contributed by R. David Murray in :issue:`11390`.) |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 236 | |
R David Murray | 8e37d5d | 2013-04-13 14:49:48 -0400 | [diff] [blame] | 237 | |
R David Murray | bb17d2b | 2013-08-09 16:15:28 -0400 | [diff] [blame] | 238 | email |
| 239 | ----- |
| 240 | |
| 241 | :meth:`~email.message.Message.as_string` now accepts a *policy* argument to |
| 242 | override the default policy of the message when generating a string |
| 243 | representation of it. This means that ``as_string`` can now be used in more |
| 244 | circumstances, instead of having to create and use a :mod:`~email.generator` in |
| 245 | order to pass formatting parameters to its ``flatten`` method. |
| 246 | |
| 247 | New method :meth:`~email.message.Message.as_bytes` added to produce a bytes |
| 248 | representation of the message in a fashion similar to how ``as_string`` |
| 249 | produces a string representation. It does not accept the *maxheaderlen* |
| 250 | argument, but does accept the *unixfrom* and *policy* arguments. The |
| 251 | :class:`~email.message.Message` :meth:`~email.message.Message.__bytes__` method |
| 252 | calls it, meaning that ``bytes(mymsg)`` will now produce the intuitive |
| 253 | result: a bytes object containing the fully formatted message. |
| 254 | |
| 255 | (Contributed by R. David Murray in :issue:`18600`.) |
| 256 | |
| 257 | |
Victor Stinner | 854ffcb | 2013-06-21 00:36:30 +0200 | [diff] [blame] | 258 | functools |
| 259 | --------- |
| 260 | |
| 261 | New :func:`functools.singledispatch` decorator: see the :pep:`443`. |
| 262 | |
Nick Coghlan | e8c45d6 | 2013-07-28 20:00:01 +1000 | [diff] [blame] | 263 | |
Antoine Pitrou | d6cbd34 | 2013-08-12 20:48:15 +0200 | [diff] [blame] | 264 | inspect |
| 265 | ------- |
| 266 | |
Nick Coghlan | f94a16b | 2013-09-22 22:46:49 +1000 | [diff] [blame] | 267 | |
| 268 | The inspect module now offers a basic command line interface to quickly |
| 269 | display source code and other information for modules, classes and |
| 270 | functions. |
| 271 | |
Antoine Pitrou | d6cbd34 | 2013-08-12 20:48:15 +0200 | [diff] [blame] | 272 | :func:`~inspect.unwrap` makes it easy to unravel wrapper function chains |
| 273 | created by :func:`functools.wraps` (and any other API that sets the |
| 274 | ``__wrapped__`` attribute on a wrapper function). |
| 275 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 276 | mmap |
| 277 | ---- |
| 278 | |
| 279 | mmap objects can now be weakref'ed. |
| 280 | |
| 281 | (Contributed by Valerie Lambert in :issue:`4885`.) |
| 282 | |
| 283 | |
Richard Oudkerk | 84ed9a6 | 2013-08-14 15:35:41 +0100 | [diff] [blame] | 284 | multiprocessing |
| 285 | --------------- |
| 286 | |
| 287 | On Unix two new *start methods* have been added for starting processes |
| 288 | using :mod:`multiprocessing`. These make the mixing of processes with |
| 289 | threads more robust. See :issue:`8713`. |
| 290 | |
| 291 | Also, except when using the old *fork* start method, child processes |
| 292 | will no longer inherit unneeded handles/file descriptors from their parents. |
| 293 | |
| 294 | |
Victor Stinner | daf4555 | 2013-08-28 00:53:59 +0200 | [diff] [blame] | 295 | os |
| 296 | -- |
| 297 | |
Georg Brandl | c6ebbef | 2013-09-16 04:03:12 +0200 | [diff] [blame] | 298 | New functions to get and set the :ref:`inheritable flag <fd_inheritance>` of a file |
Victor Stinner | daf4555 | 2013-08-28 00:53:59 +0200 | [diff] [blame] | 299 | descriptors or a Windows handle: |
| 300 | |
| 301 | * :func:`os.get_inheritable`, :func:`os.set_inheritable` |
| 302 | * :func:`os.get_handle_inheritable`, :func:`os.set_handle_inheritable` |
| 303 | |
| 304 | |
R David Murray | 78d692f | 2013-10-10 17:23:26 -0400 | [diff] [blame] | 305 | pdb |
| 306 | --- |
| 307 | |
| 308 | The ``print`` command has been removed from :mod:`pdb`, restoring access to the |
| 309 | ``print`` function. |
| 310 | |
| 311 | Rationale: Python2's ``pdb`` did not have a ``print`` command; instead, |
| 312 | entering ``print`` executed the ``print`` statement. In Python3 ``print`` was |
| 313 | mistakenly made an alias for the pdb :pdbcmd:`p` command. ``p``, however, |
| 314 | prints the ``repr`` of its argument, not the ``str`` like the Python2 ``print`` |
| 315 | command did. Worse, the Python3 ``pdb print`` command shadowed the Python3 |
| 316 | ``print`` function, making it inaccessible at the ``pdb`` prompt. |
| 317 | |
| 318 | (Contributed by Connor Osborn in :issue:`18764`.) |
| 319 | |
| 320 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 321 | poplib |
| 322 | ------ |
| 323 | |
| 324 | New :meth:`~poplib.POP3.stls` method to switch a clear-text POP3 session into |
| 325 | an encrypted POP3 session. |
| 326 | |
| 327 | New :meth:`~poplib.POP3.capa` method to query the capabilities advertised by the |
| 328 | POP3 server. |
| 329 | |
| 330 | (Contributed by Lorenzo Catucci in :issue:`4473`.) |
| 331 | |
| 332 | |
Serhiy Storchaka | 7c411a4 | 2013-10-02 11:56:18 +0300 | [diff] [blame] | 333 | pprint |
| 334 | ------ |
| 335 | |
| 336 | The :mod::`pprint` module now supports *compact* mode for formatting long |
| 337 | sequences (:issue:`19132`). |
| 338 | |
| 339 | |
R David Murray | 8e37d5d | 2013-04-13 14:49:48 -0400 | [diff] [blame] | 340 | smtplib |
| 341 | ------- |
| 342 | |
R David Murray | 8a34596 | 2013-04-14 06:46:35 -0400 | [diff] [blame] | 343 | :exc:`~smtplib.SMTPException` is now a subclass of :exc:`OSError`, which allows |
R David Murray | 8e37d5d | 2013-04-13 14:49:48 -0400 | [diff] [blame] | 344 | both socket level errors and SMTP protocol level errors to be caught in one |
| 345 | try/except statement by code that only cares whether or not an error occurred. |
| 346 | (:issue:`2118`). |
| 347 | |
Antoine Pitrou | d6cbd34 | 2013-08-12 20:48:15 +0200 | [diff] [blame] | 348 | |
Victor Stinner | daf4555 | 2013-08-28 00:53:59 +0200 | [diff] [blame] | 349 | socket |
| 350 | ------ |
| 351 | |
Georg Brandl | 5642ff9 | 2013-09-15 10:37:57 +0200 | [diff] [blame] | 352 | Socket objects have new methods to get or set their :ref:`inheritable flag |
| 353 | <fd_inheritance>`: |
Victor Stinner | daf4555 | 2013-08-28 00:53:59 +0200 | [diff] [blame] | 354 | |
| 355 | * :meth:`socket.socket.get_inheritable`, :meth:`socket.socket.set_inheritable` |
| 356 | |
Eli Bendersky | 34567ec | 2013-08-31 15:18:48 -0700 | [diff] [blame] | 357 | The ``socket.AF_*`` and ``socket.SOCK_*`` constants are enumeration values, |
| 358 | using the new :mod:`enum` module. This allows descriptive reporting during |
| 359 | debugging, instead of seeing integer "magic numbers". |
Victor Stinner | daf4555 | 2013-08-28 00:53:59 +0200 | [diff] [blame] | 360 | |
Christian Heimes | 24cd4cf | 2013-06-22 19:31:58 +0200 | [diff] [blame] | 361 | ssl |
| 362 | --- |
| 363 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 364 | TLSv1.1 and TLSv1.2 support. |
Christian Heimes | 70833a8 | 2013-06-22 19:34:17 +0200 | [diff] [blame] | 365 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 366 | (Contributed by Michele Orrù and Antoine Pitrou in :issue:`16692`) |
Christian Heimes | 24cd4cf | 2013-06-22 19:31:58 +0200 | [diff] [blame] | 367 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 368 | * New diagnostic functions :func:`~ssl.get_default_verify_paths`, |
| 369 | :meth:`~ssl.SSLContext.cert_store_stats` and |
| 370 | :meth:`~ssl.SSLContext.get_ca_certs` |
| 371 | |
| 372 | * Add :func:`ssl.enum_cert_store` to retrieve certificates and CRL from Windows' |
| 373 | cert store. |
Christian Heimes | 24cd4cf | 2013-06-22 19:31:58 +0200 | [diff] [blame] | 374 | |
| 375 | (Contributed by Christian Heimes in :issue:`18143`, :issue:`18147` and |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 376 | :issue:`17134`.) |
| 377 | |
| 378 | Support for server-side SNI using the new |
| 379 | :meth:`ssl.SSLContext.set_servername_callback` method. |
| 380 | |
| 381 | (Contributed by Daniel Black in :issue:`8109`.) |
| 382 | |
| 383 | |
Antoine Pitrou | d6cbd34 | 2013-08-12 20:48:15 +0200 | [diff] [blame] | 384 | stat |
| 385 | ---- |
| 386 | |
| 387 | The :mod:`stat` module is now backed by a C implementation in :mod:`_stat`. A C |
| 388 | implementation is required as most of the values aren't standardized and |
| 389 | platform-dependent. (Contributed by Christian Heimes in :issue:`11016`.) |
| 390 | |
| 391 | The module supports new file types: door, event port and whiteout. |
| 392 | |
| 393 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 394 | struct |
| 395 | ------ |
| 396 | |
| 397 | Streaming struct unpacking using :func:`struct.iter_unpack`. |
| 398 | |
| 399 | (Contributed by Antoine Pitrou in :issue:`17804`.) |
| 400 | |
| 401 | |
Serhiy Storchaka | e06a896 | 2013-09-04 00:43:03 +0300 | [diff] [blame] | 402 | sunau |
| 403 | ----- |
| 404 | |
| 405 | The :meth:`~sunau.getparams` method now returns a namedtuple rather than a |
| 406 | plain tuple. (Contributed by Claudiu Popa in :issue:`18901`.) |
| 407 | |
Serhiy Storchaka | 34d2013 | 2013-09-05 17:01:53 +0300 | [diff] [blame] | 408 | :meth:`sunau.open` now supports the context manager protocol (:issue:`18878`). |
| 409 | |
Serhiy Storchaka | e06a896 | 2013-09-04 00:43:03 +0300 | [diff] [blame] | 410 | |
Andrew Kuchling | 173a157 | 2013-09-15 18:15:56 -0400 | [diff] [blame] | 411 | traceback |
| 412 | --------- |
| 413 | |
| 414 | A new :func:`traceback.clear_frames` function takes a traceback object |
| 415 | and clears the local variables in all of the frames it references, |
| 416 | reducing the amount of memory consumed (:issue:`1565525`). |
| 417 | |
| 418 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 419 | urllib |
| 420 | ------ |
| 421 | |
| 422 | Add support.for ``data:`` URLs in :mod:`urllib.request`. |
| 423 | |
| 424 | (Contributed by Mathias Panzenböck in :issue:`16423`.) |
| 425 | |
| 426 | |
| 427 | unittest |
| 428 | -------- |
| 429 | |
| 430 | Support for easy dynamically-generated subtests using the |
| 431 | :meth:`~unittest.TestCase.subTest` context manager. |
| 432 | |
| 433 | (Contributed by Antoine Pitrou in :issue:`16997`.) |
| 434 | |
R David Murray | 8e37d5d | 2013-04-13 14:49:48 -0400 | [diff] [blame] | 435 | |
R David Murray | 671cd32 | 2013-04-10 12:31:43 -0400 | [diff] [blame] | 436 | wave |
| 437 | ---- |
| 438 | |
| 439 | The :meth:`~wave.getparams` method now returns a namedtuple rather than a |
| 440 | plain tuple. (Contributed by Claudiu Popa in :issue:`17487`.) |
| 441 | |
R David Murray | c91d5ee | 2013-07-31 13:46:08 -0400 | [diff] [blame] | 442 | :meth:`wave.open` now supports the context manager protocol. (Contributed |
| 443 | by Claudiu Popa in :issue:`17616`.) |
| 444 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 445 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 446 | weakref |
| 447 | ------- |
| 448 | |
| 449 | New :class:`~weakref.WeakMethod` class simulates weak references to bound |
Nick Coghlan | be57ab8 | 2013-09-22 21:26:30 +1000 | [diff] [blame] | 450 | methods. (Contributed by Antoine Pitrou in :issue:`14631`.) |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 451 | |
Nick Coghlan | be57ab8 | 2013-09-22 21:26:30 +1000 | [diff] [blame] | 452 | New :class:`~weakref.finalize` class makes it possible to register a callback |
| 453 | to be invoked when an object is garbage collected, without needing to |
| 454 | carefully manage the lifecycle of the weak reference itself. (Contributed by |
| 455 | Richard Oudkerk in :issue:`15528`) |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 456 | |
| 457 | |
| 458 | xml.etree |
| 459 | --------- |
| 460 | |
| 461 | Add an event-driven parser for non-blocking applications, |
Eli Bendersky | b586934 | 2013-08-30 05:51:20 -0700 | [diff] [blame] | 462 | :class:`~xml.etree.ElementTree.XMLPullParser`. |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 463 | |
Eli Bendersky | b586934 | 2013-08-30 05:51:20 -0700 | [diff] [blame] | 464 | (Contributed by Antoine Pitrou in :issue:`17741`.) |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 465 | |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 466 | Other improvements |
| 467 | ================== |
| 468 | |
| 469 | Tab-completion is now enabled by default in the interactive interpreter. |
| 470 | |
| 471 | (Contributed by Antoine Pitrou and Éric Araujo in :issue:`5845`.) |
| 472 | |
Eli Bendersky | 96d848a | 2013-09-06 06:55:58 -0700 | [diff] [blame] | 473 | Python invocation changes |
| 474 | ========================= |
| 475 | |
| 476 | Invoking the Python interpreter with ``--version`` now outputs the version to |
| 477 | standard output instead of standard error (:issue:`18338`). Similar changes |
| 478 | were made to :mod:`argparse` (:issue:`18920`) and other modules that have |
| 479 | script-like invocation capabilities (:issue:`18922`). |
Antoine Pitrou | f89aa9a | 2013-08-12 20:46:47 +0200 | [diff] [blame] | 480 | |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 481 | Optimizations |
| 482 | ============= |
| 483 | |
| 484 | Major performance enhancements have been added: |
| 485 | |
Victor Stinner | e64322e | 2012-10-30 23:12:47 +0100 | [diff] [blame] | 486 | * The UTF-32 decoder is now 3x to 4x faster. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 487 | |
Raymond Hettinger | c301b55 | 2013-08-19 09:12:20 -0700 | [diff] [blame] | 488 | * The cost of hash collisions for sets is now reduced. Each hash table |
Raymond Hettinger | 8408dc5 | 2013-09-15 14:57:15 -0700 | [diff] [blame] | 489 | probe now checks a series of consecutive, adjacent key/hash pairs before |
| 490 | continuing to make random probes through the hash table. This exploits |
| 491 | cache locality to make collision resolution less expensive. |
| 492 | |
| 493 | The collision resolution scheme can be described as a hybrid of linear |
| 494 | probing and open addressing. The number of additional linear probes |
| 495 | defaults to nine. This can be changed at compile-time by defining |
| 496 | LINEAR_PROBES to be any value. Set LINEAR_PROBES=0 to turn-off |
| 497 | linear probing entirely. |
Raymond Hettinger | c301b55 | 2013-08-19 09:12:20 -0700 | [diff] [blame] | 498 | |
Andrew Kuchling | 13aa781 | 2013-08-19 13:07:18 -0400 | [diff] [blame] | 499 | (Contributed by Raymond Hettinger in :issue"`18771`.) |
Raymond Hettinger | c301b55 | 2013-08-19 09:12:20 -0700 | [diff] [blame] | 500 | |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 501 | |
| 502 | Build and C API Changes |
| 503 | ======================= |
| 504 | |
| 505 | Changes to Python's build process and to the C API include: |
| 506 | |
| 507 | * None yet. |
| 508 | |
| 509 | |
| 510 | Deprecated |
| 511 | ========== |
| 512 | |
| 513 | Unsupported Operating Systems |
| 514 | ----------------------------- |
| 515 | |
Victor Stinner | f3fd13b | 2013-08-04 10:30:57 +0200 | [diff] [blame] | 516 | * OS/2 |
Victor Stinner | f3fd13b | 2013-08-04 10:30:57 +0200 | [diff] [blame] | 517 | * Windows 2000 |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 518 | |
| 519 | |
| 520 | Deprecated Python modules, functions and methods |
| 521 | ------------------------------------------------ |
| 522 | |
Terry Jan Reedy | 2b6c26e | 2013-03-21 19:36:26 -0400 | [diff] [blame] | 523 | * :meth:`difflib.SequenceMatcher.isbjunk` and |
Andrew Kuchling | 0d0813a | 2013-06-15 13:29:09 -0400 | [diff] [blame] | 524 | :meth:`difflib.SequenceMatcher.isbpopular` were removed: use ``x in sm.bjunk`` and |
| 525 | ``x in sm.bpopular``, where *sm* is a :class:`~difflib.SequenceMatcher` object. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 526 | |
Brett Cannon | 82b3d6a | 2013-06-14 22:37:11 -0400 | [diff] [blame] | 527 | * :func:`importlib.util.module_for_loader` is pending deprecation. Using |
| 528 | :func:`importlib.util.module_to_load` and |
| 529 | :meth:`importlib.abc.Loader.init_module_attrs` allows subclasses of a loader |
| 530 | to more easily customize module loading. |
| 531 | |
Brett Cannon | e4f41de | 2013-06-16 13:13:40 -0400 | [diff] [blame] | 532 | * The :mod:`imp` module is pending deprecation. To keep compatibility with |
| 533 | Python 2/3 code bases, the module's removal is currently not scheduled. |
| 534 | |
Brett Cannon | 1448ecf | 2013-10-04 11:38:59 -0400 | [diff] [blame] | 535 | * The :mod:`formatter` module is pending deprecation and is slated for removal |
| 536 | in Python 3.6. |
| 537 | |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 538 | |
| 539 | Deprecated functions and types of the C API |
| 540 | ------------------------------------------- |
| 541 | |
Victor Stinner | 8d19767 | 2013-10-09 14:53:01 +0200 | [diff] [blame] | 542 | * The ``PyThreadState.tick_counter`` field has been value: its value was meaningless |
| 543 | since Python 3.2 ("new GIL"). |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 544 | |
| 545 | |
| 546 | Deprecated features |
| 547 | ------------------- |
| 548 | |
Brett Cannon | 82b3d6a | 2013-06-14 22:37:11 -0400 | [diff] [blame] | 549 | * None yet. |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 550 | |
| 551 | |
Benjamin Peterson | 88f3b23 | 2012-10-04 12:45:10 -0400 | [diff] [blame] | 552 | Porting to Python 3.4 |
Georg Brandl | b80f511 | 2012-09-30 09:11:58 +0200 | [diff] [blame] | 553 | ===================== |
| 554 | |
| 555 | This section lists previously described changes and other bugfixes |
| 556 | that may require changes to your code. |
| 557 | |
Brett Cannon | 777622b | 2013-04-09 17:03:10 -0400 | [diff] [blame] | 558 | * The ABCs defined in :mod:`importlib.abc` now either raise the appropriate |
| 559 | exception or return a default value instead of raising |
| 560 | :exc:`NotImplementedError` blindly. This will only affect code calling |
| 561 | :func:`super` and falling through all the way to the ABCs. For compatibility, |
| 562 | catch both :exc:`NotImplementedError` or the appropriate exception as needed. |
Brett Cannon | 4c14b5d | 2013-05-04 13:56:58 -0400 | [diff] [blame] | 563 | |
| 564 | * The module type now initializes the :attr:`__package__` and :attr:`__loader__` |
| 565 | attributes to ``None`` by default. To determine if these attributes were set |
| 566 | in a backwards-compatible fashion, use e.g. |
Brett Cannon | 3dc48d6 | 2013-05-28 18:35:54 -0400 | [diff] [blame] | 567 | ``getattr(module, '__loader__', None) is not None``. |
| 568 | |
| 569 | * :meth:`importlib.util.module_for_loader` now sets ``__loader__`` and |
| 570 | ``__package__`` unconditionally to properly support reloading. If this is not |
| 571 | desired then you will need to set these attributes manually. You can use |
Brett Cannon | 028d512 | 2013-05-31 18:02:11 -0400 | [diff] [blame] | 572 | :func:`importlib.util.module_to_load` for module management. |
Brett Cannon | 3e0651b | 2013-05-31 23:18:39 -0400 | [diff] [blame] | 573 | |
| 574 | * Import now resets relevant attributes (e.g. ``__name__``, ``__loader__``, |
| 575 | ``__package__``, ``__file__``, ``__cached__``) unconditionally when reloading. |
| 576 | |
Brett Cannon | 1448ecf | 2013-10-04 11:38:59 -0400 | [diff] [blame] | 577 | * Frozen packages no longer set ``__path__`` to a list containing the package |
| 578 | name but an empty list instead. Determing if a module is a package should be |
| 579 | done using ``hasattr(module, '__path__')``. |
Brett Cannon | 8f5ac51 | 2013-06-12 23:29:18 -0400 | [diff] [blame] | 580 | |
| 581 | * :c:func:`PyErr_SetImportError` now sets :exc:`TypeError` when its **msg** |
Brett Cannon | 82da888 | 2013-07-04 17:48:16 -0400 | [diff] [blame] | 582 | argument is not set. Previously only ``NULL`` was returned with no exception |
| 583 | set. |
Brett Cannon | 33915eb | 2013-06-14 18:33:00 -0400 | [diff] [blame] | 584 | |
| 585 | * :func:`py_compile.compile` now raises :exc:`FileExistsError` if the file path |
| 586 | it would write to is a symlink or a non-regular file. This is to act as a |
| 587 | warning that import will overwrite those files with a regular file regardless |
| 588 | of what type of file path they were originally. |
Brett Cannon | f4375ef | 2013-06-16 18:05:54 -0400 | [diff] [blame] | 589 | |
| 590 | * :meth:`importlib.abc.SourceLoader.get_source` no longer raises |
| 591 | :exc:`ImportError` when the source code being loaded triggers a |
| 592 | :exc:`SyntaxError` or :exc:`UnicodeDecodeError`. As :exc:`ImportError` is |
| 593 | meant to be raised only when source code cannot be found but it should, it was |
| 594 | felt to be over-reaching/overloading of that meaning when the source code is |
| 595 | found but improperly structured. If you were catching ImportError before and |
| 596 | wish to continue to ignore syntax or decoding issues, catch all three |
Victor Stinner | 84e33c8 | 2013-06-21 00:31:55 +0200 | [diff] [blame] | 597 | exceptions now. |
Nick Coghlan | 24c05bc | 2013-07-15 21:13:08 +1000 | [diff] [blame] | 598 | |
| 599 | * :func:`functools.update_wrapper` and :func:`functools.wraps` now correctly |
| 600 | set the ``__wrapped__`` attribute even if the wrapped function had a |
| 601 | wrapped attribute set. This means ``__wrapped__`` attributes now correctly |
| 602 | link a stack of decorated functions rather than every ``__wrapped__`` |
| 603 | attribute in the chain referring to the innermost function. Introspection |
Nick Coghlan | e8c45d6 | 2013-07-28 20:00:01 +1000 | [diff] [blame] | 604 | libraries that assumed the previous behaviour was intentional can use |
| 605 | :func:`inspect.unwrap` to gain equivalent behaviour. |
Victor Stinner | 2fe9bac | 2013-10-10 16:18:20 +0200 | [diff] [blame] | 606 | |
Georg Brandl | c2228c8 | 2013-10-12 13:24:55 +0200 | [diff] [blame] | 607 | * (C API) The result of the :c:data:`PyOS_ReadlineFunctionPointer` callback must |
Victor Stinner | 2fe9bac | 2013-10-10 16:18:20 +0200 | [diff] [blame] | 608 | now be a string allocated by :c:func:`PyMem_RawMalloc` or |
| 609 | :c:func:`PyMem_RawRealloc`, or *NULL* if an error occurred, instead of a |
| 610 | string allocated by :c:func:`PyMem_Malloc` or :c:func:`PyMem_Realloc`. |
| 611 | |