blob: a6f9b0b1754d29dbed582e16ad0ff0eeb7c5b2d2 [file] [log] [blame]
Pablo Galindod4fe0982020-05-19 03:33:01 +01001****************************
2 What's New In Python 3.10
3****************************
4
5:Release: |release|
6:Date: |today|
7
8.. Rules for maintenance:
9
10 * Anyone can add text to this document. Do not spend very much time
11 on the wording of your changes, because your text will probably
12 get rewritten to some degree.
13
14 * The maintainer will go through Misc/NEWS periodically and add
15 changes; it's therefore more important to add your changes to
16 Misc/NEWS than to this file.
17
18 * This is not a complete list of every single change; completeness
19 is the purpose of Misc/NEWS. Some changes I consider too small
20 or esoteric to include. If such a change is added to the text,
21 I'll just remove it. (This is another reason you shouldn't spend
22 too much time on writing your addition.)
23
24 * If you want to draw your new text to the attention of the
25 maintainer, add 'XXX' to the beginning of the paragraph or
26 section.
27
28 * It's OK to just add a fragmentary note about a change. For
29 example: "XXX Describe the transmogrify() function added to the
30 socket module." The maintainer will research the change and
31 write the necessary text.
32
33 * You can comment out your additions if you like, but it's not
34 necessary (especially when a final release is some months away).
35
36 * Credit the author of a patch or bugfix. Just the name is
37 sufficient; the e-mail address isn't necessary.
38
39 * It's helpful to add the bug/patch number as a comment:
40
41 XXX Describe the transmogrify() function added to the socket
42 module.
43 (Contributed by P.Y. Developer in :issue:`12345`.)
44
45 This saves the maintainer the effort of going through the Mercurial log
46 when researching a change.
47
48This article explains the new features in Python 3.10, compared to 3.9.
49
Ned Deily29251b72020-05-19 07:39:29 -040050For full details, see the :ref:`changelog <changelog>`.
Pablo Galindod4fe0982020-05-19 03:33:01 +010051
52.. note::
53
54 Prerelease users should be aware that this document is currently in draft
55 form. It will be updated substantially as Python 3.10 moves towards release,
56 so it's worth checking back even after reading earlier versions.
57
58
59Summary -- Release highlights
60=============================
61
62.. This section singles out the most important changes in Python 3.10.
63 Brevity is key.
64
65
66.. PEP-sized items next.
67
68
69
70New Features
71============
72
Batuhan Taskaya044a1042020-10-06 23:03:02 +030073.. _whatsnew310-pep563:
74
75PEP 563: Postponed Evaluation of Annotations Becomes Default
76------------------------------------------------------------
77
78In Python 3.7, postponed evaluation of annotations was added,
79to be enabled with a ``from __future__ import annotations``
80directive. In 3.10 this became the default behavior, even
81without that future directive. With this being default, all
82annotations stored in :attr:`__annotations__` will be strings.
83If needed, annotations can be resolved at runtime using
84:func:`typing.get_type_hints`. See :pep:`563` for a full
85description. Also, the :func:`inspect.signature` will try to
86resolve types from now on, and when it fails it will fall back to
87showing the string annotations. (Contributed by Batuhan Taskaya
88in :issue:`38605`.)
89
Niklas Fiekas8bd216d2020-05-29 18:28:02 +020090* The :class:`int` type has a new method :meth:`int.bit_count`, returning the
91 number of ones in the binary expansion of a given integer, also known
92 as the population count. (Contributed by Niklas Fiekas in :issue:`29882`.)
Pablo Galindod4fe0982020-05-19 03:33:01 +010093
Dennis Sweeney3ee0e482020-06-12 13:19:25 -040094* The views returned by :meth:`dict.keys`, :meth:`dict.values` and
95 :meth:`dict.items` now all have a ``mapping`` attribute that gives a
96 :class:`types.MappingProxyType` object wrapping the original
97 dictionary. (Contributed by Dennis Sweeney in :issue:`40890`.)
98
Ram Rachum59cf8532020-06-19 23:39:22 +030099* :pep:`618`: The :func:`zip` function now has an optional ``strict`` flag, used
100 to require that all the iterables have an equal length.
101
Mikhail Golubev4f3c2502020-10-08 00:44:31 +0300102PEP 613: TypeAlias Annotation
103-----------------------------
104
105:pep:`484` introduced the concept of type aliases, only requiring them to be
106top-level unannotated assignments. This simplicity sometimes made it difficult
107for type checkers to distinguish between type aliases and ordinary assignments,
108especially when forward references or invalid types were involved. Compare::
109
110 StrCache = 'Cache[str]' # a type alias
111 LOG_PREFIX = 'LOG[DEBUG]' # a module constant
112
113Now the :mod:`typing` module has a special annotation :data:`TypeAlias` to
114declare type aliases more explicitly::
115
116 StrCache: TypeAlias = 'Cache[str]' # a type alias
117 LOG_PREFIX = 'LOG[DEBUG]' # a module constant
118
119See :pep:`613` for more details.
120
121(Contributed by Mikhail Golubev in :issue:`41923`.)
122
kj8d17d2b2020-11-25 11:59:59 +0700123PEP 604: New Type Union Operator
124--------------------------------
Fidget-Spinner8e1dd552020-10-05 12:40:52 +0800125
126A new type union operator was introduced which enables the syntax ``X | Y``.
127This provides a cleaner way of expressing 'either type X or type Y' instead of
128using :data:`typing.Union`, especially in type hints (annotations).
129
130In previous versions of Python, to apply a type hint for functions accepting
131arguments of multiple types, :data:`typing.Union` was used::
132
133 def square(number: Union[int, float]) -> Union[int, float]:
134 return number ** 2
135
136
kjd21cb2d2020-10-31 23:08:17 +0800137Type hints can now be written in a more succinct manner::
Fidget-Spinner8e1dd552020-10-05 12:40:52 +0800138
139 def square(number: int | float) -> int | float:
140 return number ** 2
141
142
143See :pep:`604` for more details.
144
145(Contributed by Maggie Moss and Philippe Prados in :issue:`41428`.)
Pablo Galindod4fe0982020-05-19 03:33:01 +0100146
147Other Language Changes
148======================
149
Serhiy Storchaka578c3952020-05-26 18:43:38 +0300150* Builtin and extension functions that take integer arguments no longer accept
151 :class:`~decimal.Decimal`\ s, :class:`~fractions.Fraction`\ s and other
152 objects that can be converted to integers only with a loss (e.g. that have
153 the :meth:`~object.__int__` method but do not have the
154 :meth:`~object.__index__` method).
155 (Contributed by Serhiy Storchaka in :issue:`37999`.)
Pablo Galindod4fe0982020-05-19 03:33:01 +0100156
Lysandros Nikolaoua85fefe2020-11-19 01:49:28 +0200157* Assignment expressions can now be used unparenthesized within set literals
158 and set comprehensions, as well as in sequence indexes (but not slices).
159
Pablo Galindod4fe0982020-05-19 03:33:01 +0100160
161New Modules
162===========
163
164* None yet.
165
166
167Improved Modules
168================
169
Filipe LaĆ­ns4ce6faa2020-08-10 15:48:20 +0100170base64
171------
172
173Add :func:`base64.b32hexencode` and :func:`base64.b32hexdecode` to support the
174Base32 Encoding with Extended Hex Alphabet.
175
Hai Shid332e7b2020-09-29 05:41:11 +0800176codecs
177------
178
179Add a :func:`codecs.unregister` function to unregister a codec search function.
180(Contributed by Hai Shi in :issue:`41842`.)
181
kjd75f6f72020-12-19 01:39:26 +0800182collections.abc
183---------------
184
185The ``__args__`` of the :ref:`parameterized generic <types-genericalias>` for
186:class:`collections.abc.Callable` are now consistent with :data:`typing.Callable`.
187:class:`collections.abc.Callable` generic now flattens type parameters, similar
188to what :data:`typing.Callable` currently does. This means that
189``collections.abc.Callable[[int, str], str]`` will have ``__args__`` of
190``(int, str, str)``; previously this was ``([int, str], str)``. To allow this
191change, :class:`types.GenericAlias` can now be subclassed, and a subclass will
192be returned when subscripting the :class:`collections.abc.Callable` type. Note
193that a :exc:`TypeError` may be raised for invalid forms of parameterizing
194:class:`collections.abc.Callable` which may have passed silently in Python 3.9.
195(Contributed by Ken Jin in :issue:`42195`.)
196
Joongi Kim3eb28462020-11-11 00:19:11 +0900197contextlib
198----------
199
200Add a :func:`contextlib.aclosing` context manager to safely close async generators
201and objects representing asynchronously released resources.
202(Contributed by Joongi Kim and John Belmonte in :issue:`41229`.)
203
Tom Gringauz9c98e8c2020-11-18 00:58:35 +0200204Add asynchronous context manager support to :func:`contextlib.nullcontext`.
205(Contributed by Tom Gringauz in :issue:`41543`.)
206
Hans Petter Janssonda4e09f2020-08-03 22:51:33 -0500207curses
208------
209
210The extended color functions added in ncurses 6.1 will be used transparently
211by :func:`curses.color_content`, :func:`curses.init_color`,
212:func:`curses.init_pair`, and :func:`curses.pair_content`. A new function,
213:func:`curses.has_extended_color_support`, indicates whether extended color
214support is provided by the underlying ncurses library.
215(Contributed by Jeffrey Kintscher and Hans Petter Jansson in :issue:`36982`.)
216
Brett Cannon825ac382020-11-06 18:45:56 -0800217doctest
218-------
219
220When a module does not define ``__loader__``, fall back to ``__spec__.loader``.
221(Contributed by Brett Cannon in :issue:`42133`.)
222
Hai Shic5b049b2020-10-14 23:43:31 +0800223encodings
224---------
225:func:`encodings.normalize_encoding` now ignores non-ASCII characters.
226(Contributed by Hai Shi in :issue:`39337`.)
227
Serhiy Storchaka8a64cea2020-06-18 22:08:27 +0300228glob
229----
230
231Added the *root_dir* and *dir_fd* parameters in :func:`~glob.glob` and
232:func:`~glob.iglob` which allow to specify the root directory for searching.
233(Contributed by Serhiy Storchaka in :issue:`38144`.)
234
Brett Cannon825ac382020-11-06 18:45:56 -0800235inspect
236-------
237
238When a module does not define ``__loader__``, fall back to ``__spec__.loader``.
239(Contributed by Brett Cannon in :issue:`42133`.)
240
241linecache
242---------
243
244When a module does not define ``__loader__``, fall back to ``__spec__.loader``.
245(Contributed by Brett Cannon in :issue:`42133`.)
246
pxinwr3405e052020-08-07 13:21:52 +0800247os
248--
249
250Added :func:`os.cpu_count()` support for VxWorks RTOS.
251(Contributed by Peixing Xin in :issue:`41440`.)
252
Christian Heimescd9fed62020-11-13 19:48:52 +0100253Added a new function :func:`os.eventfd` and related helpers to wrap the
254``eventfd2`` syscall on Linux.
255(Contributed by Christian Heimes in :issue:`41001`.)
256
Pablo Galindoa57b3d32020-11-17 00:00:38 +0000257Added :func:`os.splice()` that allows to move data between two file
258descriptors without copying between kernel address space and user
259address space, where one of the file descriptors must refer to a
260pipe. (Contributed by Pablo Galindo in :issue:`41625`.)
261
Joshua Cannon45205842020-11-20 09:40:39 -0600262pathlib
263-------
264
Yaroslav Pankovych79d2e622020-11-23 22:06:22 +0200265Added slice support to :attr:`PurePath.parents <pathlib.PurePath.parents>`.
Joshua Cannon45205842020-11-20 09:40:39 -0600266(Contributed by Joshua Cannon in :issue:`35498`)
267
Yaroslav Pankovych79d2e622020-11-23 22:06:22 +0200268Added negative indexing support to :attr:`PurePath.parents
269<pathlib.PurePath.parents>`.
270(Contributed by Yaroslav Pankovych in :issue:`21041`)
271
Christian Heimes5c73afc2020-11-30 22:34:45 +0100272platform
273--------
274
275Added :func:`platform.freedesktop_os_release()` to retrieve operation system
276identification from `freedesktop.org os-release
277<https://www.freedesktop.org/software/systemd/man/os-release.html>`_ standard file.
278(Contributed by Christian Heimes in :issue:`28468`)
279
Gregory Schevchenkodaff3902020-07-25 22:58:45 +0300280py_compile
281----------
282
283Added ``--quiet`` option to command-line interface of :mod:`py_compile`.
284(Contributed by Gregory Schevchenko in :issue:`38731`.)
285
Zackery Spytzdf592732020-10-29 03:44:35 -0600286shelve
287------
288
289The :mod:`shelve` module now uses :data:`pickle.DEFAULT_PROTOCOL` by default
290instead of :mod:`pickle` protocol ``3`` when creating shelves.
291(Contributed by Zackery Spytz in :issue:`34204`.)
292
Brett Cannon825ac382020-11-06 18:45:56 -0800293site
294----
295
296When a module does not define ``__loader__``, fall back to ``__spec__.loader``.
297(Contributed by Brett Cannon in :issue:`42133`.)
298
Christian Heimes03c8ddd2020-11-20 09:26:07 +0100299socket
300------
301
302The exception :exc:`socket.timeout` is now an alias of :exc:`TimeoutError`.
303(Contributed by Christian Heimes in :issue:`42413`.)
304
Victor Stinnerdd8a93e2020-06-30 00:49:03 +0200305sys
306---
307
308Add :data:`sys.orig_argv` attribute: the list of the original command line
309arguments passed to the Python executable.
310(Contributed by Victor Stinner in :issue:`23427`.)
311
Mario Corchero0001a1b2020-11-04 10:27:43 +0100312threading
313---------
314
315Added :func:`threading.gettrace` and :func:`threading.getprofile` to
316retrieve the functions set by :func:`threading.settrace` and
317:func:`threading.setprofile` respectively.
318(Contributed by Mario Corchero in :issue:`42251`.)
319
Mario Corchero750c5ab2020-11-12 18:27:44 +0100320Add :data:`threading.__excepthook__` to allow retrieving the original value
321of :func:`threading.excepthook` in case it is set to a broken or a different
322value.
323(Contributed by Mario Corchero in :issue:`42308`.)
324
Zackery Spytz91e93792020-11-05 15:18:44 -0700325traceback
326---------
327
328The :func:`~traceback.format_exception`,
329:func:`~traceback.format_exception_only`, and
330:func:`~traceback.print_exception` functions can now take an exception object
331as a positional-only argument.
332(Contributed by Zackery Spytz and Matthias Bussonnier in :issue:`26389`.)
333
Bas van Beek0d0e9fe2020-09-22 17:55:34 +0200334types
335-----
336
337Reintroduced the :data:`types.EllipsisType`, :data:`types.NoneType`
338and :data:`types.NotImplementedType` classes, providing a new set
339of types readily interpretable by type checkers.
340(Contributed by Bas van Beek in :issue:`41810`.)
341
kj46873382020-11-19 11:44:24 +0700342typing
343------
344
345The behavior of :class:`typing.Literal` was changed to conform with :pep:`586`
346and to match the behavior of static type checkers specified in the PEP.
347
3481. ``Literal`` now de-duplicates parameters.
3492. Equality comparisons between ``Literal`` objects are now order independent.
3503. ``Literal`` comparisons now respects types. For example,
351 ``Literal[0] == Literal[False]`` previously evaluated to ``True``. It is
352 now ``False``. To support this change, the internally used type cache now
353 supports differentiating types.
3544. ``Literal`` objects will now raise a :exc:`TypeError` exception during
355 equality comparisons if one of their parameters are not :term:`immutable`.
356 Note that declaring ``Literal`` with mutable parameters will not throw
357 an error::
358
359 >>> from typing import Literal
360 >>> Literal[{0}]
361 >>> Literal[{0}] == Literal[{False}]
362 Traceback (most recent call last):
363 File "<stdin>", line 1, in <module>
364 TypeError: unhashable type: 'set'
365
366(Contributed by Yurii Karabas in :issue:`42345`.)
367
Mark Dickinsonc8c70e72020-09-19 21:38:11 +0100368unittest
369--------
370
371Add new method :meth:`~unittest.TestCase.assertNoLogs` to complement the
372existing :meth:`~unittest.TestCase.assertLogs`. (Contributed by Kit Yan Choi
373in :issue:`39385`.)
374
Zackery Spytze28b8c92020-08-09 04:50:53 -0600375xml
376---
377
378Add a :class:`~xml.sax.handler.LexicalHandler` class to the
379:mod:`xml.sax.handler` module.
380(Contributed by Jonathan Gossage and Zackery Spytz in :issue:`35018`.)
381
Brett Cannond2e94bb2020-11-13 15:14:58 -0800382zipimport
383---------
384Add methods related to :pep:`451`: :meth:`~zipimport.zipimporter.find_spec`,
385:meth:`zipimport.zipimporter.create_module`, and
386:meth:`zipimport.zipimporter.exec_module`.
387(Contributed by Brett Cannon in :issue:`42131`.
388
Serhiy Storchaka8a64cea2020-06-18 22:08:27 +0300389
Pablo Galindod4fe0982020-05-19 03:33:01 +0100390Optimizations
391=============
392
Serhiy Storchaka12f43342020-07-20 15:53:55 +0300393* Constructors :func:`str`, :func:`bytes` and :func:`bytearray` are now faster
394 (around 30--40% for small objects).
395 (Contributed by Serhiy Storchaka in :issue:`41334`.)
396
Victor Stinner2c2a4f32020-06-18 01:20:51 +0200397* The :mod:`runpy` module now imports fewer modules.
Victor Stinner4c18fc82020-06-17 23:58:58 +0200398 The ``python3 -m module-name`` command startup time is 1.3x faster in
399 average.
400 (Contributed by Victor Stinner in :issue:`41006`.)
401
Pablo Galindo109826c2020-10-20 06:22:44 +0100402* The ``LOAD_ATTR`` instruction now uses new "per opcode cache" mechanism.
403 It is about 36% faster now. (Contributed by Pablo Galindo and Yury Selivanov
Matti Picus99608c72020-10-30 16:52:39 +0200404 in :issue:`42093`, based on ideas implemented originally in PyPy and MicroPython.)
Pablo Galindod4fe0982020-05-19 03:33:01 +0100405
Pablo Galindob451b0e2020-10-21 22:46:52 +0100406* When building Python with ``--enable-optimizations`` now
407 ``-fno-semantic-interposition`` is added to both the compile and link line.
408 This speeds builds of the Python interpreter created with ``--enable-shared``
409 with ``gcc`` by up to 30%. See `this article
410 <https://developers.redhat.com/blog/2020/06/25/red-hat-enterprise-linux-8-2-brings-faster-python-3-8-run-speeds/>`_
411 for more details. (Contributed by Victor Stinner and Pablo Galindo in
Brett Cannon2de50972020-12-04 15:39:21 -0800412 :issue:`38980`.)
413
Pablo Galindob451b0e2020-10-21 22:46:52 +0100414
Yurii Karabas73019792020-11-25 12:43:18 +0200415* Function parameters and their annotations are no longer computed at runtime,
416 but rather at compilation time. They are stored as a tuple of strings at the
417 bytecode level. It is now around 100% faster to create a function with parameter
418 annotations. (Contributed by Yurii Karabas and Inada Naoki in :issue:`42202`)
419
Pablo Galindod4fe0982020-05-19 03:33:01 +0100420Deprecated
421==========
422
Brett Cannon04523c52020-10-23 18:10:54 -0700423* Starting in this release, there will be a concerted effort to begin
424 cleaning up old import semantics that were kept for Python 2.7
425 compatibility. Specifically,
426 :meth:`~importlib.abc.PathEntryFinder.find_loader`/:meth:`~importlib.abc.Finder.find_module`
427 (superseded by :meth:`~importlib.abc.Finder.find_spec`),
428 :meth:`~importlib.abc.Loader.load_module`
429 (superseded by :meth:`~importlib.abc.Loader.exec_module`),
430 :meth:`~importlib.abc.Loader.module_repr` (which the import system
431 takes care of for you), the ``__package__`` attribute
432 (superseded by ``__spec__.parent``), the ``__loader__`` attribute
433 (superseded by ``__spec__.loader``), and the ``__cached__`` attribute
434 (superseded by ``__spec__.cached``) will slowly be removed (as well
435 as other classes and methods in :mod:`importlib`).
436 :exc:`ImportWarning` and/or :exc:`DeprecationWarning` will be raised
437 as appropriate to help identify code which needs updating during
438 this transition.
439
Brett Cannon2de50972020-12-04 15:39:21 -0800440* The various ``load_module()`` methods of :mod:`importlib` have been
441 documented as deprecated since Python 3.6, but will now also trigger
442 a :exc:`DeprecationWarning`. Use
443 :meth:`~importlib.abc.Loader.exec_module` instead.
444 (Contributed by Brett Cannon in :issue:`26131`.)
445
446* :meth:`zimport.zipimporter.load_module` has been deprecated in
447 preference for :meth:`~zipimport.zipimporter.exec_module`.
448 (Contributed by Brett Cannon in :issue:`26131`.)
449
450* The use of :meth:`~importlib.abc.Loader.load_module` by the import
451 system now triggers an :exc:`ImportWarning` as
452 :meth:`~importlib.abc.Loader.exec_module` is preferred.
453 (Contributed by Brett Cannon in :issue:`26131`.)
454
Erlend Egeberg Aaslanda1f401a2020-11-17 16:55:12 +0100455* ``sqlite3.OptimizedUnicode`` has been undocumented and obsolete since Python
456 3.3, when it was made an alias to :class:`str`. It is now deprecated,
457 scheduled for removal in Python 3.12.
458 (Contributed by Erlend E. Aasland in :issue:`42264`.)
459
Pablo Galindod4fe0982020-05-19 03:33:01 +0100460
Pablo Galindod4fe0982020-05-19 03:33:01 +0100461Removed
462=======
463
Serhiy Storchakae2ec0b22020-10-09 14:14:37 +0300464* Removed special methods ``__int__``, ``__float__``, ``__floordiv__``,
465 ``__mod__``, ``__divmod__``, ``__rfloordiv__``, ``__rmod__`` and
466 ``__rdivmod__`` of the :class:`complex` class. They always raised
467 a :exc:`TypeError`.
468 (Contributed by Serhiy Storchaka in :issue:`41974`.)
469
Berker Peksagd4d127f2020-07-16 09:38:58 +0300470* The ``ParserBase.error()`` method from the private and undocumented ``_markupbase``
471 module has been removed. :class:`html.parser.HTMLParser` is the only subclass of
472 ``ParserBase`` and its ``error()`` implementation has already been removed in
473 Python 3.5.
474 (Contributed by Berker Peksag in :issue:`31844`.)
475
Victor Stinner84f73822020-10-27 04:36:22 +0100476* Removed the ``unicodedata.ucnhash_CAPI`` attribute which was an internal
477 PyCapsule object. The related private ``_PyUnicode_Name_CAPI`` structure was
478 moved to the internal C API.
479 (Contributed by Victor Stinner in :issue:`42157`.)
480
Lysandros Nikolaouc26d5912020-11-16 20:46:37 +0200481* Removed the ``parser`` module, which was deprecated in 3.9 due to the
482 switch to the new PEG parser, as well as all the C source and header files
483 that were only being used by the old parser, including ``node.h``, ``parser.h``,
484 ``graminit.h`` and ``grammar.h``.
485
486* Removed the Public C API functions :c:func:`PyParser_SimpleParseStringFlags`,
487 :c:func:`PyParser_SimpleParseStringFlagsFilename`,
488 :c:func:`PyParser_SimpleParseFileFlags` and :c:func:`PyNode_Compile`
489 that were deprecated in 3.9 due to the switch to the new PEG parser.
490
Dong-hee Nabe319c02020-11-25 22:17:30 +0900491* Removed the ``formatter`` module, which was deprecated in Python 3.4.
492 It is somewhat obsolete, little used, and not tested. It was originally
493 scheduled to be removed in Python 3.6, but such removals were delayed until
494 after Python 2.7 EOL. Existing users should copy whatever classes they use
495 into their code.
496 (Contributed by Dong-hee Na and Terry J. Reedy in :issue:`42299`.)
Pablo Galindod4fe0982020-05-19 03:33:01 +0100497
Hai Shi0f91f582020-12-08 22:42:42 +0800498* Removed the :c:func:`PyModule_GetWarningsModule` function that was useless
499 now due to the _warnings module was converted to a builtin module in 2.6.
500 (Contributed by Hai Shi in :issue:`42599`.)
501
502
Pablo Galindod4fe0982020-05-19 03:33:01 +0100503Porting to Python 3.10
504======================
505
506This section lists previously described changes and other bugfixes
507that may require changes to your code.
508
509
Zackery Spytz91e93792020-11-05 15:18:44 -0700510Changes in the Python API
511-------------------------
512
513* The *etype* parameters of the :func:`~traceback.format_exception`,
514 :func:`~traceback.format_exception_only`, and
515 :func:`~traceback.print_exception` functions in the :mod:`traceback` module
516 have been renamed to *exc*.
517 (Contributed by Zackery Spytz and Matthias Bussonnier in :issue:`26389`.)
518
Victor Stinner357704c2020-12-14 23:07:54 +0100519* :mod:`atexit`: At Python exit, if a callback registered with
520 :func:`atexit.register` fails, its exception is now logged. Previously, only
521 some exceptions were logged, and the last exception was always silently
522 ignored.
523 (Contributed by Victor Stinner in :issue:`42639`.)
524
kjd75f6f72020-12-19 01:39:26 +0800525* :class:`collections.abc.Callable` generic now flattens type parameters, similar
526 to what :data:`typing.Callable` currently does. This means that
527 ``collections.abc.Callable[[int, str], str]`` will have ``__args__`` of
528 ``(int, str, str)``; previously this was ``([int, str], str)``. Code which
529 accesses the arguments via :func:`typing.get_args` or ``__args__`` need to account
530 for this change. Furthermore, :exc:`TypeError` may be raised for invalid forms
531 of parameterizing :class:`collections.abc.Callable` which may have passed
532 silently in Python 3.9.
533 (Contributed by Ken Jin in :issue:`42195`.)
Victor Stinner357704c2020-12-14 23:07:54 +0100534
Yurii Karabas73019792020-11-25 12:43:18 +0200535CPython bytecode changes
536========================
537
538* The ``MAKE_FUNCTION`` instruction accepts tuple of strings as annotations
539 instead of dictionary.
540 (Contributed by Yurii Karabas and Inada Naoki in :issue:`42202`)
Dong-hee Naad3252b2020-05-26 01:52:54 +0900541
542Build Changes
543=============
544
Erlend Egeberg Aasland207c3212020-09-07 23:26:54 +0200545
Victor Stinner7ab92d52020-06-16 00:54:44 +0200546* The C99 functions :c:func:`snprintf` and :c:func:`vsnprintf` are now required
547 to build Python.
548 (Contributed by Victor Stinner in :issue:`36020`.)
549
Erlend Egeberg Aasland207c3212020-09-07 23:26:54 +0200550* :mod:`sqlite3` requires SQLite 3.7.3 or higher.
551 (Contributed by Sergey Fedoseev and Erlend E. Aasland :issue:`40744`.)
552
Victor Stinner357704c2020-12-14 23:07:54 +0100553* The :mod:`atexit` module must now always be built as a built-in module.
554 (Contributed by Victor Stinner in :issue:`42639`.)
Erlend Egeberg Aasland207c3212020-09-07 23:26:54 +0200555
Dong-hee Naad3252b2020-05-26 01:52:54 +0900556
557C API Changes
558=============
559
560New Features
561------------
562
Victor Stinnerdd8a93e2020-06-30 00:49:03 +0200563* The result of :c:func:`PyNumber_Index` now always has exact type :class:`int`.
Serhiy Storchaka5f4b229d2020-05-28 10:33:45 +0300564 Previously, the result could have been an instance of a subclass of ``int``.
565 (Contributed by Serhiy Storchaka in :issue:`40792`.)
566
Victor Stinnerdd8a93e2020-06-30 00:49:03 +0200567* Add a new :c:member:`~PyConfig.orig_argv` member to the :c:type:`PyConfig`
568 structure: the list of the original command line arguments passed to the
569 Python executable.
570 (Contributed by Victor Stinner in :issue:`23427`.)
Dong-hee Naad3252b2020-05-26 01:52:54 +0900571
Zackery Spytz2e4dd332020-09-23 12:43:45 -0600572* The :c:func:`PyDateTime_DATE_GET_TZINFO` and
573 :c:func:`PyDateTime_TIME_GET_TZINFO` macros have been added for accessing
574 the ``tzinfo`` attributes of :class:`datetime.datetime` and
575 :class:`datetime.time` objects.
576 (Contributed by Zackery Spytz in :issue:`30155`.)
577
Hai Shid332e7b2020-09-29 05:41:11 +0800578* Add a :c:func:`PyCodec_Unregister` function to unregister a codec
579 search function.
580 (Contributed by Hai Shi in :issue:`41842`.)
581
Vladimir Matveev24a54c02020-10-12 12:10:42 -0700582* The :c:func:`PyIter_Send` function was added to allow
Vladimir Matveev037245c2020-10-09 17:15:15 -0700583 sending value into iterator without raising ``StopIteration`` exception.
584 (Contributed by Vladimir Matveev in :issue:`41756`.)
585
Alex Gaynor3a8fdb22020-10-19 18:17:50 -0400586* Added :c:func:`PyUnicode_AsUTF8AndSize` to the limited C API.
587 (Contributed by Alex Gaynor in :issue:`41784`.)
588
Victor Stinner80218752020-11-04 13:59:15 +0100589* Added :c:func:`PyModule_AddObjectRef` function: similar to
Victor Stinner95ce7cd2020-11-11 01:52:26 +0100590 :c:func:`PyModule_AddObject` but don't steal a reference to the value on
Victor Stinner80218752020-11-04 13:59:15 +0100591 success.
592 (Contributed by Victor Stinner in :issue:`1635741`.)
593
Victor Stinner53a03aa2020-11-05 15:02:12 +0100594* Added :c:func:`Py_NewRef` and :c:func:`Py_XNewRef` functions to increment the
595 reference count of an object and return the object.
596 (Contributed by Victor Stinner in :issue:`42262`.)
597
Serhiy Storchaka686c2032020-11-22 13:25:02 +0200598* The :c:func:`PyType_FromSpecWithBases` and :c:func:`PyType_FromModuleAndSpec`
599 functions now accept a single class as the *bases* argument.
600 (Contributed by Serhiy Storchaka in :issue:`42423`.)
601
Hai Shi88c2cfd2020-11-07 00:04:47 +0800602* The :c:func:`PyType_FromModuleAndSpec` function now accepts NULL ``tp_doc``
603 slot.
604 (Contributed by Hai Shi in :issue:`41832`.)
605
Hai Shia13b26c2020-11-11 04:53:46 +0800606* The :c:func:`PyType_GetSlot` function can accept static types.
607 (Contributed by Hai Shi and Petr Viktorin in :issue:`41073`.)
608
Alex Gaynor3a8fdb22020-10-19 18:17:50 -0400609
Dong-hee Naad3252b2020-05-26 01:52:54 +0900610Porting to Python 3.10
611----------------------
612
Victor Stinner37bb2892020-06-19 11:45:31 +0200613* The ``PY_SSIZE_T_CLEAN`` macro must now be defined to use
614 :c:func:`PyArg_ParseTuple` and :c:func:`Py_BuildValue` formats which use
615 ``#``: ``es#``, ``et#``, ``s#``, ``u#``, ``y#``, ``z#``, ``U#`` and ``Z#``.
616 See :ref:`Parsing arguments and building values
617 <arg-parsing>` and the :pep:`353`.
618 (Contributed by Victor Stinner in :issue:`40943`.)
619
Victor Stinnerfe2978b2020-05-27 14:55:10 +0200620* Since :c:func:`Py_REFCNT()` is changed to the inline static function,
621 ``Py_REFCNT(obj) = new_refcnt`` must be replaced with ``Py_SET_REFCNT(obj, new_refcnt)``:
Victor Stinnerdc24b8a2020-06-04 22:10:43 +0200622 see :c:func:`Py_SET_REFCNT()` (available since Python 3.9). For backward
623 compatibility, this macro can be used::
624
625 #if PY_VERSION_HEX < 0x030900A4
626 # define Py_SET_REFCNT(obj, refcnt) ((Py_REFCNT(obj) = (refcnt)), (void)0)
627 #endif
628
Victor Stinnerfe2978b2020-05-27 14:55:10 +0200629 (Contributed by Victor Stinner in :issue:`39573`.)
630
Victor Stinner59d3dce2020-06-02 14:03:25 +0200631* Calling :c:func:`PyDict_GetItem` without :term:`GIL` held had been allowed
632 for historical reason. It is no longer allowed.
633 (Contributed by Victor Stinner in :issue:`40839`.)
634
Inada Naoki038dd0f2020-06-30 15:26:56 +0900635* ``PyUnicode_FromUnicode(NULL, size)`` and ``PyUnicode_FromStringAndSize(NULL, size)``
636 raise ``DeprecationWarning`` now. Use :c:func:`PyUnicode_New` to allocate
637 Unicode object without initial data.
638 (Contributed by Inada Naoki in :issue:`36346`.)
639
Victor Stinner47e1afd2020-10-26 16:43:47 +0100640* The private ``_PyUnicode_Name_CAPI`` structure of the PyCapsule API
Victor Stinner84f73822020-10-27 04:36:22 +0100641 ``unicodedata.ucnhash_CAPI`` has been moved to the internal C API.
Victor Stinner920cb642020-10-26 19:19:36 +0100642 (Contributed by Victor Stinner in :issue:`42157`.)
Victor Stinner47e1afd2020-10-26 16:43:47 +0100643
Victor Stinnerace3f9a2020-11-10 21:10:22 +0100644* :c:func:`Py_GetPath`, :c:func:`Py_GetPrefix`, :c:func:`Py_GetExecPrefix`,
645 :c:func:`Py_GetProgramFullPath`, :c:func:`Py_GetPythonHome` and
646 :c:func:`Py_GetProgramName` functions now return ``NULL`` if called before
647 :c:func:`Py_Initialize` (before Python is initialized). Use the new
648 :ref:`Python Initialization Configuration API <init-config>` to get the
649 :ref:`Python Path Configuration. <init-path-config>`.
650 (Contributed by Victor Stinner in :issue:`42260`.)
651
Victor Stinner0ef96c22020-12-07 11:56:20 +0100652* :c:func:`PyList_SET_ITEM`, :c:func:`PyTuple_SET_ITEM` and
653 :c:func:`PyCell_SET` macros can no longer be used as l-value or r-value.
654 For example, ``x = PyList_SET_ITEM(a, b, c)`` and
655 ``PyList_SET_ITEM(a, b, c) = x`` now fail with a compiler error. It prevents
656 bugs like ``if (PyList_SET_ITEM (a, b, c) < 0) ...`` test.
657 (Contributed by Zackery Spytz and Victor Stinner in :issue:`30459`.)
658
Victor Stinner583ee5a2020-10-02 14:49:00 +0200659Deprecated
660----------
661
662* The ``PyUnicode_InternImmortal()`` function is now deprecated
663 and will be removed in Python 3.12: use :c:func:`PyUnicode_InternInPlace`
664 instead.
665 (Contributed by Victor Stinner in :issue:`41692`.)
666
Dong-hee Naad3252b2020-05-26 01:52:54 +0900667Removed
668-------
Inada Naoki6f8a6ee2020-06-26 08:07:22 +0900669
670* ``PyObject_AsCharBuffer()``, ``PyObject_AsReadBuffer()``, ``PyObject_CheckReadBuffer()``,
671 and ``PyObject_AsWriteBuffer()`` are removed. Please migrate to new buffer protocol;
672 :c:func:`PyObject_GetBuffer` and :c:func:`PyBuffer_Release`.
Inada Naoki20a79022020-06-27 18:22:09 +0900673 (Contributed by Inada Naoki in :issue:`41103`.)
674
675* Removed ``Py_UNICODE_str*`` functions manipulating ``Py_UNICODE*`` strings.
676 (Contributed by Inada Naoki in :issue:`41123`.)
677
678 * ``Py_UNICODE_strlen``: use :c:func:`PyUnicode_GetLength` or
679 :c:macro:`PyUnicode_GET_LENGTH`
680 * ``Py_UNICODE_strcat``: use :c:func:`PyUnicode_CopyCharacters` or
681 :c:func:`PyUnicode_FromFormat`
682 * ``Py_UNICODE_strcpy``, ``Py_UNICODE_strncpy``: use
683 :c:func:`PyUnicode_CopyCharacters` or :c:func:`PyUnicode_Substring`
684 * ``Py_UNICODE_strcmp``: use :c:func:`PyUnicode_Compare`
685 * ``Py_UNICODE_strncmp``: use :c:func:`PyUnicode_Tailmatch`
686 * ``Py_UNICODE_strchr``, ``Py_UNICODE_strrchr``: use
687 :c:func:`PyUnicode_FindChar`
Inada Naokid9f2a132020-06-29 10:46:51 +0900688
689* Removed ``PyUnicode_GetMax()``. Please migrate to new (:pep:`393`) APIs.
690 (Contributed by Inada Naoki in :issue:`41103`.)
Inada Naokie4f1fe62020-06-29 13:00:43 +0900691
692* Removed ``PyLong_FromUnicode()``. Please migrate to :c:func:`PyLong_FromUnicodeObject`.
693 (Contributed by Inada Naoki in :issue:`41103`.)
Inada Naokib3332662020-06-30 12:23:07 +0900694
695* Removed ``PyUnicode_AsUnicodeCopy()``. Please use :c:func:`PyUnicode_AsUCS4Copy` or
696 :c:func:`PyUnicode_AsWideCharString`
697 (Contributed by Inada Naoki in :issue:`41103`.)
Victor Stinner19c3ac92020-09-23 14:04:57 +0200698
699* Removed ``_Py_CheckRecursionLimit`` variable: it has been replaced by
700 ``ceval.recursion_limit`` of the :c:type:`PyInterpreterState` structure.
701 (Contributed by Victor Stinner in :issue:`41834`.)
Serhiy Storchakadcc54212020-10-05 12:32:00 +0300702
703* Removed undocumented macros ``Py_ALLOW_RECURSION`` and
704 ``Py_END_ALLOW_RECURSION`` and the ``recursion_critical`` field of the
705 :c:type:`PyInterpreterState` structure.
706 (Contributed by Serhiy Storchaka in :issue:`41936`.)
Victor Stinner296a7962020-11-17 16:22:23 +0100707
708* Removed the undocumented ``PyOS_InitInterrupts()`` function. Initializing
709 Python already implicitly installs signal handlers: see
710 :c:member:`PyConfig.install_signal_handlers`.
711 (Contributed by Victor Stinner in :issue:`41713`.)