blob: 7b54f441b6a4a0442b5eb3a453a97d5d4041c565 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001
2.. _datamodel:
3
4**********
5Data model
6**********
7
8
9.. _objects:
10
11Objects, values and types
12=========================
13
14.. index::
15 single: object
16 single: data
17
18:dfn:`Objects` are Python's abstraction for data. All data in a Python program
19is represented by objects or by relations between objects. (In a sense, and in
Mathieu Dupuyc49016e2020-03-30 23:28:25 +020020conformance to Von Neumann's model of a "stored program computer", code is also
Georg Brandl116aa622007-08-15 14:28:22 +000021represented by objects.)
22
23.. index::
24 builtin: id
25 builtin: type
26 single: identity of an object
27 single: value of an object
28 single: type of an object
29 single: mutable object
30 single: immutable object
31
Georg Brandl85eb8c12007-08-31 16:33:38 +000032.. XXX it *is* now possible in some cases to change an object's
33 type, under certain controlled conditions
34
Georg Brandl116aa622007-08-15 14:28:22 +000035Every object has an identity, a type and a value. An object's *identity* never
36changes once it has been created; you may think of it as the object's address in
37memory. The ':keyword:`is`' operator compares the identity of two objects; the
Nick Coghlan337b2bf2012-05-20 18:30:49 +100038:func:`id` function returns an integer representing its identity.
39
40.. impl-detail::
41
42 For CPython, ``id(x)`` is the memory address where ``x`` is stored.
43
Georg Brandl116aa622007-08-15 14:28:22 +000044An object's type determines the operations that the object supports (e.g., "does
45it have a length?") and also defines the possible values for objects of that
46type. The :func:`type` function returns an object's type (which is an object
Nick Coghlan337b2bf2012-05-20 18:30:49 +100047itself). Like its identity, an object's :dfn:`type` is also unchangeable.
48[#]_
49
50The *value* of some objects can change. Objects whose value can
Georg Brandl116aa622007-08-15 14:28:22 +000051change are said to be *mutable*; objects whose value is unchangeable once they
52are created are called *immutable*. (The value of an immutable container object
53that contains a reference to a mutable object can change when the latter's value
54is changed; however the container is still considered immutable, because the
55collection of objects it contains cannot be changed. So, immutability is not
56strictly the same as having an unchangeable value, it is more subtle.) An
57object's mutability is determined by its type; for instance, numbers, strings
58and tuples are immutable, while dictionaries and lists are mutable.
59
60.. index::
61 single: garbage collection
62 single: reference counting
63 single: unreachable object
64
65Objects are never explicitly destroyed; however, when they become unreachable
66they may be garbage-collected. An implementation is allowed to postpone garbage
67collection or omit it altogether --- it is a matter of implementation quality
68how garbage collection is implemented, as long as no objects are collected that
Georg Brandl495f7b52009-10-27 15:28:25 +000069are still reachable.
70
71.. impl-detail::
72
73 CPython currently uses a reference-counting scheme with (optional) delayed
74 detection of cyclically linked garbage, which collects most objects as soon
75 as they become unreachable, but is not guaranteed to collect garbage
76 containing circular references. See the documentation of the :mod:`gc`
77 module for information on controlling the collection of cyclic garbage.
78 Other implementations act differently and CPython may change.
Gregory P. Smithc5425472011-03-10 11:28:50 -080079 Do not depend on immediate finalization of objects when they become
Raymond Hettingeraa7886d2014-05-26 22:20:37 -070080 unreachable (so you should always close files explicitly).
Georg Brandl116aa622007-08-15 14:28:22 +000081
82Note that the use of the implementation's tracing or debugging facilities may
83keep objects alive that would normally be collectable. Also note that catching
84an exception with a ':keyword:`try`...\ :keyword:`except`' statement may keep
85objects alive.
86
87Some objects contain references to "external" resources such as open files or
88windows. It is understood that these resources are freed when the object is
89garbage-collected, but since garbage collection is not guaranteed to happen,
90such objects also provide an explicit way to release the external resource,
91usually a :meth:`close` method. Programs are strongly recommended to explicitly
92close such objects. The ':keyword:`try`...\ :keyword:`finally`' statement
Nick Coghlan3a5d7e32008-08-31 12:40:14 +000093and the ':keyword:`with`' statement provide convenient ways to do this.
Georg Brandl116aa622007-08-15 14:28:22 +000094
95.. index:: single: container
96
97Some objects contain references to other objects; these are called *containers*.
98Examples of containers are tuples, lists and dictionaries. The references are
99part of a container's value. In most cases, when we talk about the value of a
100container, we imply the values, not the identities of the contained objects;
101however, when we talk about the mutability of a container, only the identities
102of the immediately contained objects are implied. So, if an immutable container
103(like a tuple) contains a reference to a mutable object, its value changes if
104that mutable object is changed.
105
106Types affect almost all aspects of object behavior. Even the importance of
107object identity is affected in some sense: for immutable types, operations that
108compute new values may actually return a reference to any existing object with
109the same type and value, while for mutable objects this is not allowed. E.g.,
110after ``a = 1; b = 1``, ``a`` and ``b`` may or may not refer to the same object
111with the value one, depending on the implementation, but after ``c = []; d =
112[]``, ``c`` and ``d`` are guaranteed to refer to two different, unique, newly
113created empty lists. (Note that ``c = d = []`` assigns the same object to both
114``c`` and ``d``.)
115
116
117.. _types:
118
119The standard type hierarchy
120===========================
121
122.. index::
123 single: type
124 pair: data; type
125 pair: type; hierarchy
126 pair: extension; module
127 pair: C; language
128
129Below is a list of the types that are built into Python. Extension modules
130(written in C, Java, or other languages, depending on the implementation) can
131define additional types. Future versions of Python may add types to the type
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000132hierarchy (e.g., rational numbers, efficiently stored arrays of integers, etc.),
133although such additions will often be provided via the standard library instead.
Georg Brandl116aa622007-08-15 14:28:22 +0000134
135.. index::
136 single: attribute
137 pair: special; attribute
138 triple: generic; special; attribute
139
140Some of the type descriptions below contain a paragraph listing 'special
141attributes.' These are attributes that provide access to the implementation and
142are not intended for general use. Their definition may change in the future.
143
144None
145 .. index:: object: None
146
147 This type has a single value. There is a single object with this value. This
148 object is accessed through the built-in name ``None``. It is used to signify the
149 absence of a value in many situations, e.g., it is returned from functions that
150 don't explicitly return anything. Its truth value is false.
151
152NotImplemented
153 .. index:: object: NotImplemented
154
155 This type has a single value. There is a single object with this value. This
156 object is accessed through the built-in name ``NotImplemented``. Numeric methods
Ethan Furmanb0049432014-11-26 21:15:35 -0800157 and rich comparison methods should return this value if they do not implement the
Georg Brandl116aa622007-08-15 14:28:22 +0000158 operation for the operands provided. (The interpreter will then try the
MojoVampire469325c2020-03-03 18:50:17 +0000159 reflected operation, or some other fallback, depending on the operator.) It
160 should not be evaluated in a boolean context.
Georg Brandl116aa622007-08-15 14:28:22 +0000161
Ethan Furmanb0049432014-11-26 21:15:35 -0800162 See
163 :ref:`implementing-the-arithmetic-operations`
164 for more details.
165
MojoVampire469325c2020-03-03 18:50:17 +0000166 .. versionchanged:: 3.9
167 Evaluating ``NotImplemented`` in a boolean context is deprecated. While
168 it currently evaluates as true, it will emit a :exc:`DeprecationWarning`.
169 It will raise a :exc:`TypeError` in a future version of Python.
170
Ethan Furmanb0049432014-11-26 21:15:35 -0800171
Georg Brandl116aa622007-08-15 14:28:22 +0000172Ellipsis
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300173 .. index::
174 object: Ellipsis
175 single: ...; ellipsis literal
Georg Brandl116aa622007-08-15 14:28:22 +0000176
177 This type has a single value. There is a single object with this value. This
178 object is accessed through the literal ``...`` or the built-in name
179 ``Ellipsis``. Its truth value is true.
180
Christian Heimes072c0f12008-01-03 23:01:04 +0000181:class:`numbers.Number`
Georg Brandl116aa622007-08-15 14:28:22 +0000182 .. index:: object: numeric
183
184 These are created by numeric literals and returned as results by arithmetic
185 operators and arithmetic built-in functions. Numeric objects are immutable;
186 once created their value never changes. Python numbers are of course strongly
187 related to mathematical numbers, but subject to the limitations of numerical
188 representation in computers.
189
kpincf8b1ccd2020-10-21 15:34:15 -0500190 The string representations of the numeric classes, computed by
kpincc60394c2020-10-21 12:13:50 -0500191 :meth:`__repr__` and :meth:`__str__`, have the following
192 properties:
193
194 * They are valid numeric literals which, when passed to their
195 class constructor, produce an object having the value of the
196 original numeric.
197
198 * The representation is in base 10, when possible.
199
200 * Leading zeros, possibly excepting a single zero before a
201 decimal point, are not shown.
202
203 * Trailing zeros, possibly excepting a single zero after a
204 decimal point, are not shown.
205
206 * A sign is shown only when the number is negative.
207
Georg Brandl116aa622007-08-15 14:28:22 +0000208 Python distinguishes between integers, floating point numbers, and complex
209 numbers:
210
Christian Heimes072c0f12008-01-03 23:01:04 +0000211 :class:`numbers.Integral`
Georg Brandl116aa622007-08-15 14:28:22 +0000212 .. index:: object: integer
213
214 These represent elements from the mathematical set of integers (positive and
215 negative).
216
Georg Brandl59d69162008-01-07 09:27:36 +0000217 There are two types of integers:
Georg Brandl116aa622007-08-15 14:28:22 +0000218
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000219 Integers (:class:`int`)
Georg Brandl116aa622007-08-15 14:28:22 +0000220 These represent numbers in an unlimited range, subject to available (virtual)
221 memory only. For the purpose of shift and mask operations, a binary
222 representation is assumed, and negative numbers are represented in a variant of
223 2's complement which gives the illusion of an infinite string of sign bits
224 extending to the left.
225
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000226 Booleans (:class:`bool`)
Georg Brandl116aa622007-08-15 14:28:22 +0000227 .. index::
228 object: Boolean
229 single: False
230 single: True
231
232 These represent the truth values False and True. The two objects representing
Serhiy Storchakafbc1c262013-11-29 12:17:13 +0200233 the values ``False`` and ``True`` are the only Boolean objects. The Boolean type is a
Georg Brandl95817b32008-05-11 14:30:18 +0000234 subtype of the integer type, and Boolean values behave like the values 0 and 1,
Georg Brandl116aa622007-08-15 14:28:22 +0000235 respectively, in almost all contexts, the exception being that when converted to
236 a string, the strings ``"False"`` or ``"True"`` are returned, respectively.
237
238 .. index:: pair: integer; representation
239
240 The rules for integer representation are intended to give the most meaningful
Georg Brandlbb74a782008-05-11 10:53:16 +0000241 interpretation of shift and mask operations involving negative integers.
Georg Brandl116aa622007-08-15 14:28:22 +0000242
Christian Heimes072c0f12008-01-03 23:01:04 +0000243 :class:`numbers.Real` (:class:`float`)
Georg Brandl116aa622007-08-15 14:28:22 +0000244 .. index::
245 object: floating point
246 pair: floating point; number
247 pair: C; language
248 pair: Java; language
249
250 These represent machine-level double precision floating point numbers. You are
251 at the mercy of the underlying machine architecture (and C or Java
252 implementation) for the accepted range and handling of overflow. Python does not
253 support single-precision floating point numbers; the savings in processor and
Terry Jan Reedyb6271f22014-09-30 19:07:49 -0400254 memory usage that are usually the reason for using these are dwarfed by the
Georg Brandl116aa622007-08-15 14:28:22 +0000255 overhead of using objects in Python, so there is no reason to complicate the
256 language with two kinds of floating point numbers.
257
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000258 :class:`numbers.Complex` (:class:`complex`)
Georg Brandl116aa622007-08-15 14:28:22 +0000259 .. index::
260 object: complex
261 pair: complex; number
262
263 These represent complex numbers as a pair of machine-level double precision
264 floating point numbers. The same caveats apply as for floating point numbers.
265 The real and imaginary parts of a complex number ``z`` can be retrieved through
266 the read-only attributes ``z.real`` and ``z.imag``.
267
Georg Brandl116aa622007-08-15 14:28:22 +0000268Sequences
269 .. index::
270 builtin: len
271 object: sequence
272 single: index operation
273 single: item selection
274 single: subscription
275
276 These represent finite ordered sets indexed by non-negative numbers. The
277 built-in function :func:`len` returns the number of items of a sequence. When
278 the length of a sequence is *n*, the index set contains the numbers 0, 1,
279 ..., *n*-1. Item *i* of sequence *a* is selected by ``a[i]``.
280
281 .. index:: single: slicing
282
283 Sequences also support slicing: ``a[i:j]`` selects all items with index *k* such
284 that *i* ``<=`` *k* ``<`` *j*. When used as an expression, a slice is a
285 sequence of the same type. This implies that the index set is renumbered so
286 that it starts at 0.
287
Georg Brandl116aa622007-08-15 14:28:22 +0000288 Some sequences also support "extended slicing" with a third "step" parameter:
289 ``a[i:j:k]`` selects all items of *a* with index *x* where ``x = i + n*k``, *n*
290 ``>=`` ``0`` and *i* ``<=`` *x* ``<`` *j*.
291
292 Sequences are distinguished according to their mutability:
293
294 Immutable sequences
295 .. index::
296 object: immutable sequence
297 object: immutable
298
299 An object of an immutable sequence type cannot change once it is created. (If
300 the object contains references to other objects, these other objects may be
301 mutable and may be changed; however, the collection of objects directly
302 referenced by an immutable object cannot change.)
303
304 The following types are immutable sequences:
305
Chris Jerdonekbb4e9412012-11-28 01:38:40 -0800306 .. index::
307 single: string; immutable sequences
308
Georg Brandl116aa622007-08-15 14:28:22 +0000309 Strings
310 .. index::
311 builtin: chr
312 builtin: ord
Georg Brandl116aa622007-08-15 14:28:22 +0000313 single: character
314 single: integer
315 single: Unicode
316
Nick Coghlan14627862014-06-07 23:21:14 +1000317 A string is a sequence of values that represent Unicode code points.
318 All the code points in the range ``U+0000 - U+10FFFF`` can be
319 represented in a string. Python doesn't have a :c:type:`char` type;
320 instead, every code point in the string is represented as a string
321 object with length ``1``. The built-in function :func:`ord`
322 converts a code point from its string form to an integer in the
323 range ``0 - 10FFFF``; :func:`chr` converts an integer in the range
324 ``0 - 10FFFF`` to the corresponding length ``1`` string object.
Ezio Melottif4d76e62011-10-25 09:23:42 +0300325 :meth:`str.encode` can be used to convert a :class:`str` to
Nick Coghlan14627862014-06-07 23:21:14 +1000326 :class:`bytes` using the given text encoding, and
327 :meth:`bytes.decode` can be used to achieve the opposite.
Georg Brandl116aa622007-08-15 14:28:22 +0000328
329 Tuples
330 .. index::
331 object: tuple
332 pair: singleton; tuple
333 pair: empty; tuple
334
Georg Brandldcc56f82007-08-31 16:41:12 +0000335 The items of a tuple are arbitrary Python objects. Tuples of two or
336 more items are formed by comma-separated lists of expressions. A tuple
337 of one item (a 'singleton') can be formed by affixing a comma to an
338 expression (an expression by itself does not create a tuple, since
339 parentheses must be usable for grouping of expressions). An empty
340 tuple can be formed by an empty pair of parentheses.
Georg Brandl116aa622007-08-15 14:28:22 +0000341
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000342 Bytes
343 .. index:: bytes, byte
344
345 A bytes object is an immutable array. The items are 8-bit bytes,
346 represented by integers in the range 0 <= x < 256. Bytes literals
csabellac6db4812017-04-26 01:47:01 -0400347 (like ``b'abc'``) and the built-in :func:`bytes()` constructor
348 can be used to create bytes objects. Also, bytes objects can be
349 decoded to strings via the :meth:`~bytes.decode` method.
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000350
Georg Brandl116aa622007-08-15 14:28:22 +0000351 Mutable sequences
352 .. index::
353 object: mutable sequence
354 object: mutable
355 pair: assignment; statement
Georg Brandl116aa622007-08-15 14:28:22 +0000356 single: subscription
357 single: slicing
358
359 Mutable sequences can be changed after they are created. The subscription and
360 slicing notations can be used as the target of assignment and :keyword:`del`
361 (delete) statements.
362
Benjamin Petersonb58dda72009-01-18 22:27:04 +0000363 There are currently two intrinsic mutable sequence types:
Georg Brandl116aa622007-08-15 14:28:22 +0000364
365 Lists
366 .. index:: object: list
367
Georg Brandldcc56f82007-08-31 16:41:12 +0000368 The items of a list are arbitrary Python objects. Lists are formed by
369 placing a comma-separated list of expressions in square brackets. (Note
370 that there are no special cases needed to form lists of length 0 or 1.)
371
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000372 Byte Arrays
373 .. index:: bytearray
Georg Brandldcc56f82007-08-31 16:41:12 +0000374
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000375 A bytearray object is a mutable array. They are created by the built-in
csabellac6db4812017-04-26 01:47:01 -0400376 :func:`bytearray` constructor. Aside from being mutable
377 (and hence unhashable), byte arrays otherwise provide the same interface
378 and functionality as immutable :class:`bytes` objects.
Georg Brandl116aa622007-08-15 14:28:22 +0000379
380 .. index:: module: array
381
Georg Brandldcc56f82007-08-31 16:41:12 +0000382 The extension module :mod:`array` provides an additional example of a
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000383 mutable sequence type, as does the :mod:`collections` module.
Georg Brandl116aa622007-08-15 14:28:22 +0000384
Georg Brandl116aa622007-08-15 14:28:22 +0000385Set types
386 .. index::
387 builtin: len
388 object: set type
389
390 These represent unordered, finite sets of unique, immutable objects. As such,
391 they cannot be indexed by any subscript. However, they can be iterated over, and
392 the built-in function :func:`len` returns the number of items in a set. Common
393 uses for sets are fast membership testing, removing duplicates from a sequence,
394 and computing mathematical operations such as intersection, union, difference,
395 and symmetric difference.
396
397 For set elements, the same immutability rules apply as for dictionary keys. Note
398 that numeric types obey the normal rules for numeric comparison: if two numbers
399 compare equal (e.g., ``1`` and ``1.0``), only one of them can be contained in a
400 set.
401
402 There are currently two intrinsic set types:
403
404 Sets
405 .. index:: object: set
406
407 These represent a mutable set. They are created by the built-in :func:`set`
408 constructor and can be modified afterwards by several methods, such as
Serhiy Storchaka0d196ed2013-10-09 14:02:31 +0300409 :meth:`~set.add`.
Georg Brandl116aa622007-08-15 14:28:22 +0000410
411 Frozen sets
412 .. index:: object: frozenset
413
Guido van Rossum2cc30da2007-11-02 23:46:40 +0000414 These represent an immutable set. They are created by the built-in
415 :func:`frozenset` constructor. As a frozenset is immutable and
416 :term:`hashable`, it can be used again as an element of another set, or as
417 a dictionary key.
Georg Brandl116aa622007-08-15 14:28:22 +0000418
Georg Brandl116aa622007-08-15 14:28:22 +0000419Mappings
420 .. index::
421 builtin: len
422 single: subscription
423 object: mapping
424
425 These represent finite sets of objects indexed by arbitrary index sets. The
426 subscript notation ``a[k]`` selects the item indexed by ``k`` from the mapping
427 ``a``; this can be used in expressions and as the target of assignments or
428 :keyword:`del` statements. The built-in function :func:`len` returns the number
429 of items in a mapping.
430
431 There is currently a single intrinsic mapping type:
432
433 Dictionaries
434 .. index:: object: dictionary
435
436 These represent finite sets of objects indexed by nearly arbitrary values. The
437 only types of values not acceptable as keys are values containing lists or
438 dictionaries or other mutable types that are compared by value rather than by
439 object identity, the reason being that the efficient implementation of
440 dictionaries requires a key's hash value to remain constant. Numeric types used
441 for keys obey the normal rules for numeric comparison: if two numbers compare
442 equal (e.g., ``1`` and ``1.0``) then they can be used interchangeably to index
443 the same dictionary entry.
444
Lahfa Samy59c644e2020-03-26 15:54:04 +0100445 Dictionaries preserve insertion order, meaning that keys will be produced
446 in the same order they were added sequentially over the dictionary.
447 Replacing an existing key does not change the order, however removing a key
448 and re-inserting it will add it to the end instead of keeping its old place.
449
Georg Brandl116aa622007-08-15 14:28:22 +0000450 Dictionaries are mutable; they can be created by the ``{...}`` notation (see
451 section :ref:`dict`).
452
453 .. index::
Georg Brandl0a7ac7d2008-05-26 10:29:35 +0000454 module: dbm.ndbm
455 module: dbm.gnu
Georg Brandl116aa622007-08-15 14:28:22 +0000456
Benjamin Peterson9a46cab2008-09-08 02:49:30 +0000457 The extension modules :mod:`dbm.ndbm` and :mod:`dbm.gnu` provide
458 additional examples of mapping types, as does the :mod:`collections`
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000459 module.
Georg Brandl116aa622007-08-15 14:28:22 +0000460
Lahfa Samy59c644e2020-03-26 15:54:04 +0100461 .. versionchanged:: 3.7
462 Dictionaries did not preserve insertion order in versions of Python before 3.6.
463 In CPython 3.6, insertion order was preserved, but it was considered
464 an implementation detail at that time rather than a language guarantee.
465
Georg Brandl116aa622007-08-15 14:28:22 +0000466Callable types
467 .. index::
468 object: callable
469 pair: function; call
470 single: invocation
471 pair: function; argument
472
473 These are the types to which the function call operation (see section
474 :ref:`calls`) can be applied:
475
476 User-defined functions
477 .. index::
478 pair: user-defined; function
479 object: function
480 object: user-defined function
481
482 A user-defined function object is created by a function definition (see
483 section :ref:`function`). It should be called with an argument list
484 containing the same number of items as the function's formal parameter
485 list.
486
487 Special attributes:
488
Georg Brandl44ea77b2013-03-28 13:28:44 +0100489 .. tabularcolumns:: |l|L|l|
490
Martin Panterbae5d812016-06-18 03:57:31 +0000491 .. index::
492 single: __doc__ (function attribute)
493 single: __name__ (function attribute)
494 single: __module__ (function attribute)
495 single: __dict__ (function attribute)
496 single: __defaults__ (function attribute)
497 single: __closure__ (function attribute)
498 single: __code__ (function attribute)
499 single: __globals__ (function attribute)
500 single: __annotations__ (function attribute)
501 single: __kwdefaults__ (function attribute)
502 pair: global; namespace
503
Georg Brandl116aa622007-08-15 14:28:22 +0000504 +-------------------------+-------------------------------+-----------+
505 | Attribute | Meaning | |
506 +=========================+===============================+===========+
507 | :attr:`__doc__` | The function's documentation | Writable |
508 | | string, or ``None`` if | |
Ethan Furmanf87f5152014-10-17 22:25:22 -0700509 | | unavailable; not inherited by | |
Jules Lasne (jlasne)1fc5bf22019-03-27 11:10:33 +0100510 | | subclasses. | |
Georg Brandl116aa622007-08-15 14:28:22 +0000511 +-------------------------+-------------------------------+-----------+
Jules Lasne (jlasne)1fc5bf22019-03-27 11:10:33 +0100512 | :attr:`~definition.\ | The function's name. | Writable |
Martin Panterbae5d812016-06-18 03:57:31 +0000513 | __name__` | | |
Georg Brandl116aa622007-08-15 14:28:22 +0000514 +-------------------------+-------------------------------+-----------+
Martin Panterbae5d812016-06-18 03:57:31 +0000515 | :attr:`~definition.\ | The function's | Writable |
Jules Lasne (jlasne)1fc5bf22019-03-27 11:10:33 +0100516 | __qualname__` | :term:`qualified name`. | |
Antoine Pitrou86a36b52011-11-25 18:56:07 +0100517 | | | |
518 | | .. versionadded:: 3.3 | |
519 +-------------------------+-------------------------------+-----------+
Georg Brandl116aa622007-08-15 14:28:22 +0000520 | :attr:`__module__` | The name of the module the | Writable |
521 | | function was defined in, or | |
522 | | ``None`` if unavailable. | |
523 +-------------------------+-------------------------------+-----------+
524 | :attr:`__defaults__` | A tuple containing default | Writable |
525 | | argument values for those | |
526 | | arguments that have defaults, | |
527 | | or ``None`` if no arguments | |
Jules Lasne (jlasne)1fc5bf22019-03-27 11:10:33 +0100528 | | have a default value. | |
Georg Brandl116aa622007-08-15 14:28:22 +0000529 +-------------------------+-------------------------------+-----------+
530 | :attr:`__code__` | The code object representing | Writable |
531 | | the compiled function body. | |
532 +-------------------------+-------------------------------+-----------+
533 | :attr:`__globals__` | A reference to the dictionary | Read-only |
534 | | that holds the function's | |
535 | | global variables --- the | |
536 | | global namespace of the | |
537 | | module in which the function | |
538 | | was defined. | |
539 +-------------------------+-------------------------------+-----------+
Martin Panterbae5d812016-06-18 03:57:31 +0000540 | :attr:`~object.__dict__`| The namespace supporting | Writable |
Georg Brandl116aa622007-08-15 14:28:22 +0000541 | | arbitrary function | |
542 | | attributes. | |
543 +-------------------------+-------------------------------+-----------+
544 | :attr:`__closure__` | ``None`` or a tuple of cells | Read-only |
545 | | that contain bindings for the | |
546 | | function's free variables. | |
Lisa Roach64505a12017-06-08 04:43:26 -0700547 | | See below for information on | |
548 | | the ``cell_contents`` | |
549 | | attribute. | |
Georg Brandl116aa622007-08-15 14:28:22 +0000550 +-------------------------+-------------------------------+-----------+
551 | :attr:`__annotations__` | A dict containing annotations | Writable |
552 | | of parameters. The keys of | |
553 | | the dict are the parameter | |
Benjamin Peterson002033e2014-01-02 16:47:50 -0600554 | | names, and ``'return'`` for | |
Georg Brandl116aa622007-08-15 14:28:22 +0000555 | | the return annotation, if | |
larryhastings49b26fa2021-05-01 21:19:24 -0700556 | | provided. For more | |
557 | | information on working with | |
558 | | this attribute, see | |
559 | | :ref:`annotations-howto`. | |
Georg Brandl116aa622007-08-15 14:28:22 +0000560 +-------------------------+-------------------------------+-----------+
561 | :attr:`__kwdefaults__` | A dict containing defaults | Writable |
562 | | for keyword-only parameters. | |
563 +-------------------------+-------------------------------+-----------+
564
565 Most of the attributes labelled "Writable" check the type of the assigned value.
566
Georg Brandl116aa622007-08-15 14:28:22 +0000567 Function objects also support getting and setting arbitrary attributes, which
568 can be used, for example, to attach metadata to functions. Regular attribute
569 dot-notation is used to get and set such attributes. *Note that the current
570 implementation only supports function attributes on user-defined functions.
571 Function attributes on built-in functions may be supported in the future.*
572
Lisa Roach64505a12017-06-08 04:43:26 -0700573 A cell object has the attribute ``cell_contents``. This can be used to get
574 the value of the cell, as well as set the value.
575
Georg Brandl116aa622007-08-15 14:28:22 +0000576 Additional information about a function's definition can be retrieved from its
Pierre Glaserdf8d2cd2019-02-07 20:36:48 +0100577 code object; see the description of internal types below. The
578 :data:`cell <types.CellType>` type can be accessed in the :mod:`types`
579 module.
Georg Brandl116aa622007-08-15 14:28:22 +0000580
Georg Brandl2e0b7552007-11-27 12:43:08 +0000581 Instance methods
Georg Brandl116aa622007-08-15 14:28:22 +0000582 .. index::
583 object: method
584 object: user-defined method
585 pair: user-defined; method
586
Georg Brandl2e0b7552007-11-27 12:43:08 +0000587 An instance method object combines a class, a class instance and any
588 callable object (normally a user-defined function).
589
590 .. index::
591 single: __func__ (method attribute)
592 single: __self__ (method attribute)
593 single: __doc__ (method attribute)
594 single: __name__ (method attribute)
595 single: __module__ (method attribute)
Georg Brandl116aa622007-08-15 14:28:22 +0000596
Christian Heimesff737952007-11-27 10:40:20 +0000597 Special read-only attributes: :attr:`__self__` is the class instance object,
598 :attr:`__func__` is the function object; :attr:`__doc__` is the method's
Martin Panterbae5d812016-06-18 03:57:31 +0000599 documentation (same as ``__func__.__doc__``); :attr:`~definition.__name__` is the
Christian Heimesff737952007-11-27 10:40:20 +0000600 method name (same as ``__func__.__name__``); :attr:`__module__` is the
601 name of the module the method was defined in, or ``None`` if unavailable.
Georg Brandl116aa622007-08-15 14:28:22 +0000602
Georg Brandl116aa622007-08-15 14:28:22 +0000603 Methods also support accessing (but not setting) the arbitrary function
604 attributes on the underlying function object.
605
Georg Brandl2e0b7552007-11-27 12:43:08 +0000606 User-defined method objects may be created when getting an attribute of a
607 class (perhaps via an instance of that class), if that attribute is a
608 user-defined function object or a class method object.
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000609
Georg Brandl2e0b7552007-11-27 12:43:08 +0000610 When an instance method object is created by retrieving a user-defined
611 function object from a class via one of its instances, its
612 :attr:`__self__` attribute is the instance, and the method object is said
613 to be bound. The new method's :attr:`__func__` attribute is the original
614 function object.
Georg Brandl116aa622007-08-15 14:28:22 +0000615
Georg Brandl2e0b7552007-11-27 12:43:08 +0000616 When an instance method object is created by retrieving a class method
617 object from a class or instance, its :attr:`__self__` attribute is the
618 class itself, and its :attr:`__func__` attribute is the function object
619 underlying the class method.
Georg Brandl116aa622007-08-15 14:28:22 +0000620
Georg Brandl2e0b7552007-11-27 12:43:08 +0000621 When an instance method object is called, the underlying function
622 (:attr:`__func__`) is called, inserting the class instance
623 (:attr:`__self__`) in front of the argument list. For instance, when
624 :class:`C` is a class which contains a definition for a function
625 :meth:`f`, and ``x`` is an instance of :class:`C`, calling ``x.f(1)`` is
626 equivalent to calling ``C.f(x, 1)``.
Georg Brandl116aa622007-08-15 14:28:22 +0000627
Georg Brandl2e0b7552007-11-27 12:43:08 +0000628 When an instance method object is derived from a class method object, the
629 "class instance" stored in :attr:`__self__` will actually be the class
630 itself, so that calling either ``x.f(1)`` or ``C.f(1)`` is equivalent to
631 calling ``f(C,1)`` where ``f`` is the underlying function.
Georg Brandl116aa622007-08-15 14:28:22 +0000632
Georg Brandl2e0b7552007-11-27 12:43:08 +0000633 Note that the transformation from function object to instance method
634 object happens each time the attribute is retrieved from the instance. In
635 some cases, a fruitful optimization is to assign the attribute to a local
636 variable and call that local variable. Also notice that this
637 transformation only happens for user-defined functions; other callable
638 objects (and all non-callable objects) are retrieved without
639 transformation. It is also important to note that user-defined functions
640 which are attributes of a class instance are not converted to bound
641 methods; this *only* happens when the function is an attribute of the
642 class.
Georg Brandl116aa622007-08-15 14:28:22 +0000643
644 Generator functions
645 .. index::
646 single: generator; function
647 single: generator; iterator
648
649 A function or method which uses the :keyword:`yield` statement (see section
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000650 :ref:`yield`) is called a :dfn:`generator function`. Such a function, when
651 called, always returns an iterator object which can be used to execute the
Serhiy Storchaka0d196ed2013-10-09 14:02:31 +0300652 body of the function: calling the iterator's :meth:`iterator.__next__`
Ezio Melotti7fa82222012-10-12 13:42:08 +0300653 method will cause the function to execute until it provides a value
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200654 using the :keyword:`!yield` statement. When the function executes a
Georg Brandl116aa622007-08-15 14:28:22 +0000655 :keyword:`return` statement or falls off the end, a :exc:`StopIteration`
656 exception is raised and the iterator will have reached the end of the set of
657 values to be returned.
658
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400659 Coroutine functions
660 .. index::
661 single: coroutine; function
662
663 A function or method which is defined using :keyword:`async def` is called
664 a :dfn:`coroutine function`. Such a function, when called, returns a
665 :term:`coroutine` object. It may contain :keyword:`await` expressions,
666 as well as :keyword:`async with` and :keyword:`async for` statements. See
Yury Selivanov66f88282015-06-24 11:04:15 -0400667 also the :ref:`coroutine-objects` section.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400668
Yury Selivanov03660042016-12-15 17:36:05 -0500669 Asynchronous generator functions
670 .. index::
671 single: asynchronous generator; function
672 single: asynchronous generator; asynchronous iterator
673
674 A function or method which is defined using :keyword:`async def` and
675 which uses the :keyword:`yield` statement is called a
676 :dfn:`asynchronous generator function`. Such a function, when called,
677 returns an asynchronous iterator object which can be used in an
678 :keyword:`async for` statement to execute the body of the function.
679
680 Calling the asynchronous iterator's :meth:`aiterator.__anext__` method
681 will return an :term:`awaitable` which when awaited
682 will execute until it provides a value using the :keyword:`yield`
683 expression. When the function executes an empty :keyword:`return`
684 statement or falls off the end, a :exc:`StopAsyncIteration` exception
685 is raised and the asynchronous iterator will have reached the end of
686 the set of values to be yielded.
687
Georg Brandl116aa622007-08-15 14:28:22 +0000688 Built-in functions
689 .. index::
690 object: built-in function
691 object: function
692 pair: C; language
693
694 A built-in function object is a wrapper around a C function. Examples of
695 built-in functions are :func:`len` and :func:`math.sin` (:mod:`math` is a
696 standard built-in module). The number and type of the arguments are
697 determined by the C function. Special read-only attributes:
698 :attr:`__doc__` is the function's documentation string, or ``None`` if
Martin Panterbae5d812016-06-18 03:57:31 +0000699 unavailable; :attr:`~definition.__name__` is the function's name; :attr:`__self__` is
Georg Brandl116aa622007-08-15 14:28:22 +0000700 set to ``None`` (but see the next item); :attr:`__module__` is the name of
701 the module the function was defined in or ``None`` if unavailable.
702
703 Built-in methods
704 .. index::
705 object: built-in method
706 object: method
707 pair: built-in; method
708
709 This is really a different disguise of a built-in function, this time containing
710 an object passed to the C function as an implicit extra argument. An example of
711 a built-in method is ``alist.append()``, assuming *alist* is a list object. In
712 this case, the special read-only attribute :attr:`__self__` is set to the object
Éric Araujoc9562f32010-12-26 02:18:49 +0000713 denoted by *alist*.
Georg Brandl116aa622007-08-15 14:28:22 +0000714
Georg Brandl85eb8c12007-08-31 16:33:38 +0000715 Classes
716 Classes are callable. These objects normally act as factories for new
717 instances of themselves, but variations are possible for class types that
718 override :meth:`__new__`. The arguments of the call are passed to
719 :meth:`__new__` and, in the typical case, to :meth:`__init__` to
720 initialize the new instance.
Georg Brandl116aa622007-08-15 14:28:22 +0000721
Georg Brandl85eb8c12007-08-31 16:33:38 +0000722 Class Instances
723 Instances of arbitrary classes can be made callable by defining a
724 :meth:`__call__` method in their class.
Georg Brandl116aa622007-08-15 14:28:22 +0000725
Georg Brandl116aa622007-08-15 14:28:22 +0000726
727Modules
728 .. index::
729 statement: import
730 object: module
731
Barry Warsawd7d21942012-07-29 16:36:17 -0400732 Modules are a basic organizational unit of Python code, and are created by
Barry Warsawdadebab2012-07-31 16:03:09 -0400733 the :ref:`import system <importsystem>` as invoked either by the
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200734 :keyword:`import` statement, or by calling
Barry Warsawdadebab2012-07-31 16:03:09 -0400735 functions such as :func:`importlib.import_module` and built-in
736 :func:`__import__`. A module object has a namespace implemented by a
737 dictionary object (this is the dictionary referenced by the ``__globals__``
738 attribute of functions defined in the module). Attribute references are
739 translated to lookups in this dictionary, e.g., ``m.x`` is equivalent to
740 ``m.__dict__["x"]``. A module object does not contain the code object used
741 to initialize the module (since it isn't needed once the initialization is
742 done).
Georg Brandl116aa622007-08-15 14:28:22 +0000743
Barry Warsawd7d21942012-07-29 16:36:17 -0400744 Attribute assignment updates the module's namespace dictionary, e.g.,
745 ``m.x = 1`` is equivalent to ``m.__dict__["x"] = 1``.
Georg Brandl116aa622007-08-15 14:28:22 +0000746
Yury Selivanovf8cb8a12016-09-08 20:50:03 -0700747 .. index::
748 single: __name__ (module attribute)
749 single: __doc__ (module attribute)
750 single: __file__ (module attribute)
751 single: __annotations__ (module attribute)
752 pair: module; namespace
753
larryhastings49b26fa2021-05-01 21:19:24 -0700754 Predefined (writable) attributes:
755
756 :attr:`__name__`
757 The module's name.
758
759 :attr:`__doc__`
760 The module's documentation string, or ``None`` if
761 unavailable.
762
763 :attr:`__file__`
764 The pathname of the file from which the
765 module was loaded, if it was loaded from a file.
766 The :attr:`__file__`
767 attribute may be missing for certain types of modules, such as C modules
768 that are statically linked into the interpreter. For extension modules
769 loaded dynamically from a shared library, it's the pathname of the shared
770 library file.
771
772 :attr:`__annotations__`
773 A dictionary containing
774 :term:`variable annotations <variable annotation>` collected during
775 module body execution. For best practices on working
776 with :attr:`__annotations__`, please see :ref:`annotations-howto`.
Yury Selivanovf8cb8a12016-09-08 20:50:03 -0700777
Georg Brandl116aa622007-08-15 14:28:22 +0000778 .. index:: single: __dict__ (module attribute)
779
Yury Selivanovf8cb8a12016-09-08 20:50:03 -0700780 Special read-only attribute: :attr:`~object.__dict__` is the module's
781 namespace as a dictionary object.
Georg Brandl116aa622007-08-15 14:28:22 +0000782
Benjamin Peterson5c4bfc42010-10-12 22:57:59 +0000783 .. impl-detail::
784
785 Because of the way CPython clears module dictionaries, the module
786 dictionary will be cleared when the module falls out of scope even if the
787 dictionary still has live references. To avoid this, copy the dictionary
788 or keep the module around while using its dictionary directly.
789
Georg Brandl85eb8c12007-08-31 16:33:38 +0000790Custom classes
Georg Brandl5dbb84a2009-09-02 20:31:26 +0000791 Custom class types are typically created by class definitions (see section
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000792 :ref:`class`). A class has a namespace implemented by a dictionary object.
793 Class attribute references are translated to lookups in this dictionary, e.g.,
794 ``C.x`` is translated to ``C.__dict__["x"]`` (although there are a number of
795 hooks which allow for other means of locating attributes). When the attribute
796 name is not found there, the attribute search continues in the base classes.
797 This search of the base classes uses the C3 method resolution order which
798 behaves correctly even in the presence of 'diamond' inheritance structures
799 where there are multiple inheritance paths leading back to a common ancestor.
800 Additional details on the C3 MRO used by Python can be found in the
801 documentation accompanying the 2.3 release at
Georg Brandle73778c2014-10-29 08:36:35 +0100802 https://www.python.org/download/releases/2.3/mro/.
Georg Brandl116aa622007-08-15 14:28:22 +0000803
Nick Coghlan3a5d7e32008-08-31 12:40:14 +0000804 .. XXX: Could we add that MRO doc as an appendix to the language ref?
Georg Brandl85eb8c12007-08-31 16:33:38 +0000805
Georg Brandl116aa622007-08-15 14:28:22 +0000806 .. index::
807 object: class
808 object: class instance
809 object: instance
810 pair: class object; call
811 single: container
812 object: dictionary
813 pair: class; attribute
814
815 When a class attribute reference (for class :class:`C`, say) would yield a
Georg Brandl2e0b7552007-11-27 12:43:08 +0000816 class method object, it is transformed into an instance method object whose
Zach Mitchell00818c82018-06-02 10:29:47 -0400817 :attr:`__self__` attribute is :class:`C`. When it would yield a static
Georg Brandl2e0b7552007-11-27 12:43:08 +0000818 method object, it is transformed into the object wrapped by the static method
819 object. See section :ref:`descriptors` for another way in which attributes
820 retrieved from a class may differ from those actually contained in its
Martin Panterbae5d812016-06-18 03:57:31 +0000821 :attr:`~object.__dict__`.
Georg Brandl116aa622007-08-15 14:28:22 +0000822
823 .. index:: triple: class; attribute; assignment
824
825 Class attribute assignments update the class's dictionary, never the dictionary
826 of a base class.
827
828 .. index:: pair: class object; call
829
830 A class object can be called (see above) to yield a class instance (see below).
831
832 .. index::
833 single: __name__ (class attribute)
834 single: __module__ (class attribute)
835 single: __dict__ (class attribute)
836 single: __bases__ (class attribute)
837 single: __doc__ (class attribute)
Yury Selivanovf8cb8a12016-09-08 20:50:03 -0700838 single: __annotations__ (class attribute)
Georg Brandl116aa622007-08-15 14:28:22 +0000839
larryhastings49b26fa2021-05-01 21:19:24 -0700840 Special attributes:
841
842 :attr:`~definition.__name__`
843 The class name.
844
845 :attr:`__module__`
846 The name of the module in which the class was defined.
847
848 :attr:`~object.__dict__`
849 The dictionary containing the class's namespace.
850
851 :attr:`~class.__bases__`
852 A tuple containing the base classes, in the order of
853 their occurrence in the base class list.
854
855 :attr:`__doc__`
856 The class's documentation string, or ``None`` if undefined.
857
858 :attr:`__annotations__`
859 A dictionary containing
860 :term:`variable annotations <variable annotation>`
861 collected during class body execution. For best practices on
862 working with :attr:`__annotations__`, please see
863 :ref:`annotations-howto`.
Georg Brandl116aa622007-08-15 14:28:22 +0000864
865Class instances
866 .. index::
867 object: class instance
868 object: instance
869 pair: class; instance
870 pair: class instance; attribute
871
Georg Brandl2e0b7552007-11-27 12:43:08 +0000872 A class instance is created by calling a class object (see above). A class
873 instance has a namespace implemented as a dictionary which is the first place
874 in which attribute references are searched. When an attribute is not found
875 there, and the instance's class has an attribute by that name, the search
876 continues with the class attributes. If a class attribute is found that is a
877 user-defined function object, it is transformed into an instance method
878 object whose :attr:`__self__` attribute is the instance. Static method and
879 class method objects are also transformed; see above under "Classes". See
880 section :ref:`descriptors` for another way in which attributes of a class
881 retrieved via its instances may differ from the objects actually stored in
Martin Panterbae5d812016-06-18 03:57:31 +0000882 the class's :attr:`~object.__dict__`. If no class attribute is found, and the
Georg Brandl2e0b7552007-11-27 12:43:08 +0000883 object's class has a :meth:`__getattr__` method, that is called to satisfy
884 the lookup.
Georg Brandl116aa622007-08-15 14:28:22 +0000885
886 .. index:: triple: class instance; attribute; assignment
887
888 Attribute assignments and deletions update the instance's dictionary, never a
889 class's dictionary. If the class has a :meth:`__setattr__` or
890 :meth:`__delattr__` method, this is called instead of updating the instance
891 dictionary directly.
892
893 .. index::
894 object: numeric
895 object: sequence
896 object: mapping
897
898 Class instances can pretend to be numbers, sequences, or mappings if they have
899 methods with certain special names. See section :ref:`specialnames`.
900
901 .. index::
902 single: __dict__ (instance attribute)
903 single: __class__ (instance attribute)
904
Serhiy Storchaka0d196ed2013-10-09 14:02:31 +0300905 Special attributes: :attr:`~object.__dict__` is the attribute dictionary;
906 :attr:`~instance.__class__` is the instance's class.
Georg Brandl116aa622007-08-15 14:28:22 +0000907
Antoine Pitrou4adb2882010-01-04 18:50:53 +0000908I/O objects (also known as file objects)
Georg Brandl116aa622007-08-15 14:28:22 +0000909 .. index::
Georg Brandl116aa622007-08-15 14:28:22 +0000910 builtin: open
Antoine Pitrou4adb2882010-01-04 18:50:53 +0000911 module: io
Georg Brandl116aa622007-08-15 14:28:22 +0000912 single: popen() (in module os)
913 single: makefile() (socket method)
914 single: sys.stdin
915 single: sys.stdout
916 single: sys.stderr
917 single: stdio
918 single: stdin (in module sys)
919 single: stdout (in module sys)
920 single: stderr (in module sys)
921
Antoine Pitrou0b65b0f2010-09-15 09:58:26 +0000922 A :term:`file object` represents an open file. Various shortcuts are
923 available to create file objects: the :func:`open` built-in function, and
Serhiy Storchaka0d196ed2013-10-09 14:02:31 +0300924 also :func:`os.popen`, :func:`os.fdopen`, and the
925 :meth:`~socket.socket.makefile` method of socket objects (and perhaps by
926 other functions or methods provided by extension modules).
Antoine Pitrou4adb2882010-01-04 18:50:53 +0000927
928 The objects ``sys.stdin``, ``sys.stdout`` and ``sys.stderr`` are
929 initialized to file objects corresponding to the interpreter's standard
930 input, output and error streams; they are all open in text mode and
931 therefore follow the interface defined by the :class:`io.TextIOBase`
932 abstract class.
Georg Brandl116aa622007-08-15 14:28:22 +0000933
934Internal types
935 .. index::
936 single: internal type
937 single: types, internal
938
939 A few types used internally by the interpreter are exposed to the user. Their
940 definitions may change with future versions of the interpreter, but they are
941 mentioned here for completeness.
942
Tommy Beadlee9b84032016-06-02 19:26:51 -0400943 .. index:: bytecode, object; code, code object
Georg Brandl116aa622007-08-15 14:28:22 +0000944
Tommy Beadlee9b84032016-06-02 19:26:51 -0400945 Code objects
Georg Brandl9afde1c2007-11-01 20:32:30 +0000946 Code objects represent *byte-compiled* executable Python code, or :term:`bytecode`.
Georg Brandl116aa622007-08-15 14:28:22 +0000947 The difference between a code object and a function object is that the function
948 object contains an explicit reference to the function's globals (the module in
949 which it was defined), while a code object contains no context; also the default
950 argument values are stored in the function object, not in the code object
951 (because they represent values calculated at run-time). Unlike function
952 objects, code objects are immutable and contain no references (directly or
953 indirectly) to mutable objects.
954
Senthil Kumaran7cafd262010-10-02 03:16:04 +0000955 .. index::
956 single: co_argcount (code object attribute)
Pablo Galindoed222a72019-05-31 12:13:04 +0100957 single: co_posonlyargcount (code object attribute)
958 single: co_kwonlyargcount (code object attribute)
Senthil Kumaran7cafd262010-10-02 03:16:04 +0000959 single: co_code (code object attribute)
960 single: co_consts (code object attribute)
961 single: co_filename (code object attribute)
962 single: co_firstlineno (code object attribute)
963 single: co_flags (code object attribute)
964 single: co_lnotab (code object attribute)
965 single: co_name (code object attribute)
966 single: co_names (code object attribute)
967 single: co_nlocals (code object attribute)
968 single: co_stacksize (code object attribute)
969 single: co_varnames (code object attribute)
970 single: co_cellvars (code object attribute)
971 single: co_freevars (code object attribute)
972
Georg Brandl116aa622007-08-15 14:28:22 +0000973 Special read-only attributes: :attr:`co_name` gives the function name;
Pablo Galindocd74e662019-06-01 18:08:04 +0100974 :attr:`co_argcount` is the total number of positional arguments
975 (including positional-only arguments and arguments with default values);
976 :attr:`co_posonlyargcount` is the number of positional-only arguments
977 (including arguments with default values); :attr:`co_kwonlyargcount` is
978 the number of keyword-only arguments (including arguments with default
979 values); :attr:`co_nlocals` is the number of local variables used by the
980 function (including arguments); :attr:`co_varnames` is a tuple containing
981 the names of the local variables (starting with the argument names);
982 :attr:`co_cellvars` is a tuple containing the names of local variables
Pablo Galindoed222a72019-05-31 12:13:04 +0100983 that are referenced by nested functions; :attr:`co_freevars` is a tuple
Pablo Galindocd74e662019-06-01 18:08:04 +0100984 containing the names of free variables; :attr:`co_code` is a string
985 representing the sequence of bytecode instructions; :attr:`co_consts` is
986 a tuple containing the literals used by the bytecode; :attr:`co_names` is
987 a tuple containing the names used by the bytecode; :attr:`co_filename` is
988 the filename from which the code was compiled; :attr:`co_firstlineno` is
989 the first line number of the function; :attr:`co_lnotab` is a string
990 encoding the mapping from bytecode offsets to line numbers (for details
991 see the source code of the interpreter); :attr:`co_stacksize` is the
Batuhan TaÅŸkayad5872722019-12-16 01:02:47 +0300992 required stack size; :attr:`co_flags` is an integer encoding a number
993 of flags for the interpreter.
Georg Brandl116aa622007-08-15 14:28:22 +0000994
Georg Brandl116aa622007-08-15 14:28:22 +0000995 .. index:: object: generator
996
997 The following flag bits are defined for :attr:`co_flags`: bit ``0x04`` is set if
998 the function uses the ``*arguments`` syntax to accept an arbitrary number of
999 positional arguments; bit ``0x08`` is set if the function uses the
1000 ``**keywords`` syntax to accept arbitrary keyword arguments; bit ``0x20`` is set
1001 if the function is a generator.
1002
1003 Future feature declarations (``from __future__ import division``) also use bits
1004 in :attr:`co_flags` to indicate whether a code object was compiled with a
1005 particular feature enabled: bit ``0x2000`` is set if the function was compiled
1006 with future division enabled; bits ``0x10`` and ``0x1000`` were used in earlier
1007 versions of Python.
1008
1009 Other bits in :attr:`co_flags` are reserved for internal use.
1010
1011 .. index:: single: documentation string
1012
1013 If a code object represents a function, the first item in :attr:`co_consts` is
1014 the documentation string of the function, or ``None`` if undefined.
1015
Georg Brandla6053b42009-09-01 08:11:14 +00001016 .. _frame-objects:
1017
Georg Brandl116aa622007-08-15 14:28:22 +00001018 Frame objects
1019 .. index:: object: frame
1020
1021 Frame objects represent execution frames. They may occur in traceback objects
Nick Coghlanaec75322018-02-13 18:10:58 +10001022 (see below), and are also passed to registered trace functions.
Georg Brandl116aa622007-08-15 14:28:22 +00001023
1024 .. index::
1025 single: f_back (frame attribute)
1026 single: f_code (frame attribute)
1027 single: f_globals (frame attribute)
1028 single: f_locals (frame attribute)
1029 single: f_lasti (frame attribute)
1030 single: f_builtins (frame attribute)
1031
1032 Special read-only attributes: :attr:`f_back` is to the previous stack frame
1033 (towards the caller), or ``None`` if this is the bottom stack frame;
1034 :attr:`f_code` is the code object being executed in this frame; :attr:`f_locals`
1035 is the dictionary used to look up local variables; :attr:`f_globals` is used for
1036 global variables; :attr:`f_builtins` is used for built-in (intrinsic) names;
Miss Islington (bot)fc840732021-09-07 04:36:43 -07001037 :attr:`f_lasti` gives the precise instruction (it represents a wordcode index, which
1038 means that to get an index into the bytecode string of the code object it needs to be
1039 multiplied by 2).
Georg Brandl116aa622007-08-15 14:28:22 +00001040
Ryan Hileman9a2c2a92021-04-29 16:15:55 -07001041 Accessing ``f_code`` raises an :ref:`auditing event <auditing>`
1042 ``object.__getattr__`` with arguments ``obj`` and ``"f_code"``.
1043
Georg Brandl116aa622007-08-15 14:28:22 +00001044 .. index::
1045 single: f_trace (frame attribute)
Nick Coghlan5a851672017-09-08 10:14:16 +10001046 single: f_trace_lines (frame attribute)
1047 single: f_trace_opcodes (frame attribute)
Georg Brandl116aa622007-08-15 14:28:22 +00001048 single: f_lineno (frame attribute)
1049
1050 Special writable attributes: :attr:`f_trace`, if not ``None``, is a function
Nick Coghlan5a851672017-09-08 10:14:16 +10001051 called for various events during code execution (this is used by the debugger).
1052 Normally an event is triggered for each new source line - this can be
1053 disabled by setting :attr:`f_trace_lines` to :const:`False`.
1054
1055 Implementations *may* allow per-opcode events to be requested by setting
1056 :attr:`f_trace_opcodes` to :const:`True`. Note that this may lead to
1057 undefined interpreter behaviour if exceptions raised by the trace
1058 function escape to the function being traced.
1059
Benjamin Petersoneec3d712008-06-11 15:59:43 +00001060 :attr:`f_lineno` is the current line number of the frame --- writing to this
1061 from within a trace function jumps to the given line (only for the bottom-most
1062 frame). A debugger can implement a Jump command (aka Set Next Statement)
1063 by writing to f_lineno.
Georg Brandl116aa622007-08-15 14:28:22 +00001064
Antoine Pitrou58720d62013-08-05 23:26:40 +02001065 Frame objects support one method:
1066
1067 .. method:: frame.clear()
1068
1069 This method clears all references to local variables held by the
1070 frame. Also, if the frame belonged to a generator, the generator
1071 is finalized. This helps break reference cycles involving frame
1072 objects (for example when catching an exception and storing its
1073 traceback for later use).
1074
1075 :exc:`RuntimeError` is raised if the frame is currently executing.
1076
1077 .. versionadded:: 3.4
1078
Nick Coghlanaec75322018-02-13 18:10:58 +10001079 .. _traceback-objects:
1080
Georg Brandl116aa622007-08-15 14:28:22 +00001081 Traceback objects
1082 .. index::
1083 object: traceback
1084 pair: stack; trace
1085 pair: exception; handler
1086 pair: execution; stack
1087 single: exc_info (in module sys)
Georg Brandl116aa622007-08-15 14:28:22 +00001088 single: last_traceback (in module sys)
1089 single: sys.exc_info
1090 single: sys.last_traceback
1091
1092 Traceback objects represent a stack trace of an exception. A traceback object
Nick Coghlanaec75322018-02-13 18:10:58 +10001093 is implicitly created when an exception occurs, and may also be explicitly
1094 created by calling :class:`types.TracebackType`.
1095
1096 For implicitly created tracebacks, when the search for an exception handler
Georg Brandl116aa622007-08-15 14:28:22 +00001097 unwinds the execution stack, at each unwound level a traceback object is
1098 inserted in front of the current traceback. When an exception handler is
1099 entered, the stack trace is made available to the program. (See section
1100 :ref:`try`.) It is accessible as the third item of the
Nick Coghlanaec75322018-02-13 18:10:58 +10001101 tuple returned by ``sys.exc_info()``, and as the ``__traceback__`` attribute
1102 of the caught exception.
1103
1104 When the program contains no suitable
Georg Brandl116aa622007-08-15 14:28:22 +00001105 handler, the stack trace is written (nicely formatted) to the standard error
1106 stream; if the interpreter is interactive, it is also made available to the user
1107 as ``sys.last_traceback``.
1108
Nick Coghlanaec75322018-02-13 18:10:58 +10001109 For explicitly created tracebacks, it is up to the creator of the traceback
1110 to determine how the ``tb_next`` attributes should be linked to form a
1111 full stack trace.
1112
Georg Brandl116aa622007-08-15 14:28:22 +00001113 .. index::
Georg Brandl116aa622007-08-15 14:28:22 +00001114 single: tb_frame (traceback attribute)
1115 single: tb_lineno (traceback attribute)
1116 single: tb_lasti (traceback attribute)
1117 statement: try
1118
Nick Coghlanaec75322018-02-13 18:10:58 +10001119 Special read-only attributes:
1120 :attr:`tb_frame` points to the execution frame of the current level;
1121 :attr:`tb_lineno` gives the line number where the exception occurred;
1122 :attr:`tb_lasti` indicates the precise instruction.
1123 The line number and last instruction in the traceback may differ from the
1124 line number of its frame object if the exception occurred in a
1125 :keyword:`try` statement with no matching except clause or with a
1126 finally clause.
1127
Ryan Hileman9a2c2a92021-04-29 16:15:55 -07001128 Accessing ``tb_frame`` raises an :ref:`auditing event <auditing>`
1129 ``object.__getattr__`` with arguments ``obj`` and ``"tb_frame"``.
1130
Nick Coghlanaec75322018-02-13 18:10:58 +10001131 .. index::
1132 single: tb_next (traceback attribute)
1133
1134 Special writable attribute: :attr:`tb_next` is the next level in the stack
1135 trace (towards the frame where the exception occurred), or ``None`` if
1136 there is no next level.
1137
Berker Peksag3c1b5902018-08-06 23:52:49 +03001138 .. versionchanged:: 3.7
1139 Traceback objects can now be explicitly instantiated from Python code,
1140 and the ``tb_next`` attribute of existing instances can be updated.
Georg Brandl116aa622007-08-15 14:28:22 +00001141
1142 Slice objects
1143 .. index:: builtin: slice
1144
Georg Brandlcb8ecb12007-09-04 06:35:14 +00001145 Slice objects are used to represent slices for :meth:`__getitem__`
1146 methods. They are also created by the built-in :func:`slice` function.
Georg Brandl116aa622007-08-15 14:28:22 +00001147
1148 .. index::
1149 single: start (slice object attribute)
1150 single: stop (slice object attribute)
1151 single: step (slice object attribute)
1152
Serhiy Storchaka0d196ed2013-10-09 14:02:31 +03001153 Special read-only attributes: :attr:`~slice.start` is the lower bound;
1154 :attr:`~slice.stop` is the upper bound; :attr:`~slice.step` is the step
1155 value; each is ``None`` if omitted. These attributes can have any type.
Georg Brandl116aa622007-08-15 14:28:22 +00001156
1157 Slice objects support one method:
1158
Georg Brandl116aa622007-08-15 14:28:22 +00001159 .. method:: slice.indices(self, length)
1160
Georg Brandlcb8ecb12007-09-04 06:35:14 +00001161 This method takes a single integer argument *length* and computes
1162 information about the slice that the slice object would describe if
1163 applied to a sequence of *length* items. It returns a tuple of three
1164 integers; respectively these are the *start* and *stop* indices and the
1165 *step* or stride length of the slice. Missing or out-of-bounds indices
1166 are handled in a manner consistent with regular slices.
Georg Brandl116aa622007-08-15 14:28:22 +00001167
Georg Brandl116aa622007-08-15 14:28:22 +00001168 Static method objects
1169 Static method objects provide a way of defeating the transformation of function
1170 objects to method objects described above. A static method object is a wrapper
1171 around any other object, usually a user-defined method object. When a static
1172 method object is retrieved from a class or a class instance, the object actually
1173 returned is the wrapped object, which is not subject to any further
Victor Stinner553ee272021-04-12 00:21:22 +02001174 transformation. Static method objects are also callable. Static method
1175 objects are created by the built-in :func:`staticmethod` constructor.
Georg Brandl116aa622007-08-15 14:28:22 +00001176
1177 Class method objects
1178 A class method object, like a static method object, is a wrapper around another
1179 object that alters the way in which that object is retrieved from classes and
1180 class instances. The behaviour of class method objects upon such retrieval is
1181 described above, under "User-defined methods". Class method objects are created
1182 by the built-in :func:`classmethod` constructor.
1183
Georg Brandl116aa622007-08-15 14:28:22 +00001184
Georg Brandl116aa622007-08-15 14:28:22 +00001185.. _specialnames:
1186
1187Special method names
1188====================
1189
1190.. index::
1191 pair: operator; overloading
1192 single: __getitem__() (mapping object method)
1193
1194A class can implement certain operations that are invoked by special syntax
1195(such as arithmetic operations or subscripting and slicing) by defining methods
1196with special names. This is Python's approach to :dfn:`operator overloading`,
1197allowing classes to define their own behavior with respect to language
1198operators. For instance, if a class defines a method named :meth:`__getitem__`,
Nick Coghlan3a5d7e32008-08-31 12:40:14 +00001199and ``x`` is an instance of this class, then ``x[i]`` is roughly equivalent
1200to ``type(x).__getitem__(x, i)``. Except where mentioned, attempts to execute an
1201operation raise an exception when no appropriate method is defined (typically
1202:exc:`AttributeError` or :exc:`TypeError`).
Georg Brandl65ea9bd2007-09-05 13:36:27 +00001203
Guido van Rossum97c1adf2016-08-18 09:22:23 -07001204Setting a special method to ``None`` indicates that the corresponding
1205operation is not available. For example, if a class sets
1206:meth:`__iter__` to ``None``, the class is not iterable, so calling
1207:func:`iter` on its instances will raise a :exc:`TypeError` (without
1208falling back to :meth:`__getitem__`). [#]_
1209
Georg Brandl116aa622007-08-15 14:28:22 +00001210When implementing a class that emulates any built-in type, it is important that
1211the emulation only be implemented to the degree that it makes sense for the
1212object being modelled. For example, some sequences may work well with retrieval
1213of individual elements, but extracting a slice may not make sense. (One example
Serhiy Storchaka0d196ed2013-10-09 14:02:31 +03001214of this is the :class:`~xml.dom.NodeList` interface in the W3C's Document
1215Object Model.)
Georg Brandl116aa622007-08-15 14:28:22 +00001216
1217
1218.. _customization:
1219
1220Basic customization
1221-------------------
1222
Georg Brandl116aa622007-08-15 14:28:22 +00001223.. method:: object.__new__(cls[, ...])
1224
Georg Brandlaf265f42008-12-07 15:06:20 +00001225 .. index:: pair: subclassing; immutable types
1226
Georg Brandl116aa622007-08-15 14:28:22 +00001227 Called to create a new instance of class *cls*. :meth:`__new__` is a static
1228 method (special-cased so you need not declare it as such) that takes the class
1229 of which an instance was requested as its first argument. The remaining
1230 arguments are those passed to the object constructor expression (the call to the
1231 class). The return value of :meth:`__new__` should be the new object instance
1232 (usually an instance of *cls*).
1233
1234 Typical implementations create a new instance of the class by invoking the
csabella12b1c182017-05-14 20:42:00 -07001235 superclass's :meth:`__new__` method using ``super().__new__(cls[, ...])``
1236 with appropriate arguments and then modifying the newly-created instance
1237 as necessary before returning it.
Georg Brandl116aa622007-08-15 14:28:22 +00001238
Joannah Nanjekye6b16d932019-08-26 03:53:11 -03001239 If :meth:`__new__` is invoked during object construction and it returns an
Miss Islington (bot)ef704132021-09-07 09:26:35 -07001240 instance of *cls*, then the new instance’s :meth:`__init__` method
Joannah Nanjekye6b16d932019-08-26 03:53:11 -03001241 will be invoked like ``__init__(self[, ...])``, where *self* is the new instance
1242 and the remaining arguments are the same as were passed to the object constructor.
Georg Brandl116aa622007-08-15 14:28:22 +00001243
1244 If :meth:`__new__` does not return an instance of *cls*, then the new instance's
1245 :meth:`__init__` method will not be invoked.
1246
1247 :meth:`__new__` is intended mainly to allow subclasses of immutable types (like
Christian Heimes790c8232008-01-07 21:14:23 +00001248 int, str, or tuple) to customize instance creation. It is also commonly
1249 overridden in custom metaclasses in order to customize class creation.
Georg Brandl116aa622007-08-15 14:28:22 +00001250
1251
1252.. method:: object.__init__(self[, ...])
1253
1254 .. index:: pair: class; constructor
1255
Ethan Furman119479f2015-01-14 21:56:10 -08001256 Called after the instance has been created (by :meth:`__new__`), but before
1257 it is returned to the caller. The arguments are those passed to the
1258 class constructor expression. If a base class has an :meth:`__init__`
1259 method, the derived class's :meth:`__init__` method, if any, must explicitly
1260 call it to ensure proper initialization of the base class part of the
csabella12b1c182017-05-14 20:42:00 -07001261 instance; for example: ``super().__init__([args...])``.
Ethan Furman119479f2015-01-14 21:56:10 -08001262
1263 Because :meth:`__new__` and :meth:`__init__` work together in constructing
Raymond Hettinger7ea386e2016-08-25 21:11:50 -07001264 objects (:meth:`__new__` to create it, and :meth:`__init__` to customize it),
Ethan Furman119479f2015-01-14 21:56:10 -08001265 no non-``None`` value may be returned by :meth:`__init__`; doing so will
1266 cause a :exc:`TypeError` to be raised at runtime.
Georg Brandl116aa622007-08-15 14:28:22 +00001267
1268
1269.. method:: object.__del__(self)
1270
1271 .. index::
1272 single: destructor
Antoine Pitrou4b965932017-12-19 19:48:45 +01001273 single: finalizer
Georg Brandl116aa622007-08-15 14:28:22 +00001274 statement: del
1275
1276 Called when the instance is about to be destroyed. This is also called a
Antoine Pitrou4b965932017-12-19 19:48:45 +01001277 finalizer or (improperly) a destructor. If a base class has a
1278 :meth:`__del__` method, the derived class's :meth:`__del__` method,
1279 if any, must explicitly call it to ensure proper deletion of the base
1280 class part of the instance.
1281
1282 It is possible (though not recommended!) for the :meth:`__del__` method
1283 to postpone destruction of the instance by creating a new reference to
1284 it. This is called object *resurrection*. It is implementation-dependent
1285 whether :meth:`__del__` is called a second time when a resurrected object
1286 is about to be destroyed; the current :term:`CPython` implementation
1287 only calls it once.
1288
1289 It is not guaranteed that :meth:`__del__` methods are called for objects
1290 that still exist when the interpreter exits.
Georg Brandl116aa622007-08-15 14:28:22 +00001291
1292 .. note::
1293
1294 ``del x`` doesn't directly call ``x.__del__()`` --- the former decrements
1295 the reference count for ``x`` by one, and the latter is only called when
Antoine Pitrou4b965932017-12-19 19:48:45 +01001296 ``x``'s reference count reaches zero.
1297
1298 .. impl-detail::
1299 It is possible for a reference cycle to prevent the reference count
1300 of an object from going to zero. In this case, the cycle will be
1301 later detected and deleted by the :term:`cyclic garbage collector
1302 <garbage collection>`. A common cause of reference cycles is when
1303 an exception has been caught in a local variable. The frame's
1304 locals then reference the exception, which references its own
1305 traceback, which references the locals of all frames caught in the
1306 traceback.
1307
1308 .. seealso::
1309 Documentation for the :mod:`gc` module.
Georg Brandl116aa622007-08-15 14:28:22 +00001310
1311 .. warning::
1312
1313 Due to the precarious circumstances under which :meth:`__del__` methods are
1314 invoked, exceptions that occur during their execution are ignored, and a warning
Antoine Pitrou4b965932017-12-19 19:48:45 +01001315 is printed to ``sys.stderr`` instead. In particular:
Georg Brandl116aa622007-08-15 14:28:22 +00001316
Antoine Pitrou4b965932017-12-19 19:48:45 +01001317 * :meth:`__del__` can be invoked when arbitrary code is being executed,
1318 including from any arbitrary thread. If :meth:`__del__` needs to take
1319 a lock or invoke any other blocking resource, it may deadlock as
1320 the resource may already be taken by the code that gets interrupted
1321 to execute :meth:`__del__`.
Chris Jerdonek5fae0e52012-11-20 17:45:51 -08001322
Antoine Pitrou4b965932017-12-19 19:48:45 +01001323 * :meth:`__del__` can be executed during interpreter shutdown. As a
1324 consequence, the global variables it needs to access (including other
1325 modules) may already have been deleted or set to ``None``. Python
1326 guarantees that globals whose name begins with a single underscore
1327 are deleted from their module before other globals are deleted; if
1328 no other references to such globals exist, this may help in assuring
1329 that imported modules are still available at the time when the
1330 :meth:`__del__` method is called.
1331
1332
1333 .. index::
1334 single: repr() (built-in function); __repr__() (object method)
Georg Brandl116aa622007-08-15 14:28:22 +00001335
1336.. method:: object.__repr__(self)
1337
Benjamin Peterson1c9313f2008-10-12 12:51:12 +00001338 Called by the :func:`repr` built-in function to compute the "official" string
1339 representation of an object. If at all possible, this should look like a
1340 valid Python expression that could be used to recreate an object with the
1341 same value (given an appropriate environment). If this is not possible, a
1342 string of the form ``<...some useful description...>`` should be returned.
1343 The return value must be a string object. If a class defines :meth:`__repr__`
1344 but not :meth:`__str__`, then :meth:`__repr__` is also used when an
1345 "informal" string representation of instances of that class is required.
Georg Brandl116aa622007-08-15 14:28:22 +00001346
Georg Brandl116aa622007-08-15 14:28:22 +00001347 This is typically used for debugging, so it is important that the representation
1348 is information-rich and unambiguous.
1349
Chris Jerdonek5fae0e52012-11-20 17:45:51 -08001350 .. index::
1351 single: string; __str__() (object method)
1352 single: format() (built-in function); __str__() (object method)
1353 single: print() (built-in function); __str__() (object method)
1354
Georg Brandl116aa622007-08-15 14:28:22 +00001355
1356.. method:: object.__str__(self)
1357
Chris Jerdonek5fae0e52012-11-20 17:45:51 -08001358 Called by :func:`str(object) <str>` and the built-in functions
1359 :func:`format` and :func:`print` to compute the "informal" or nicely
1360 printable string representation of an object. The return value must be a
1361 :ref:`string <textseq>` object.
Georg Brandl116aa622007-08-15 14:28:22 +00001362
Chris Jerdonek5fae0e52012-11-20 17:45:51 -08001363 This method differs from :meth:`object.__repr__` in that there is no
1364 expectation that :meth:`__str__` return a valid Python expression: a more
1365 convenient or concise representation can be used.
1366
1367 The default implementation defined by the built-in type :class:`object`
1368 calls :meth:`object.__repr__`.
Georg Brandl116aa622007-08-15 14:28:22 +00001369
Georg Brandldcc56f82007-08-31 16:41:12 +00001370 .. XXX what about subclasses of string?
1371
Georg Brandl116aa622007-08-15 14:28:22 +00001372
Benjamin Peterson1fafc1a2011-10-25 00:03:51 -04001373.. method:: object.__bytes__(self)
1374
1375 .. index:: builtin: bytes
1376
csabellac6db4812017-04-26 01:47:01 -04001377 Called by :ref:`bytes <func-bytes>` to compute a byte-string representation
1378 of an object. This should return a :class:`bytes` object.
Benjamin Peterson1fafc1a2011-10-25 00:03:51 -04001379
Chris Jerdonekbb4e9412012-11-28 01:38:40 -08001380 .. index::
1381 single: string; __format__() (object method)
1382 pair: string; conversion
1383 builtin: print
1384
Benjamin Peterson1fafc1a2011-10-25 00:03:51 -04001385
Georg Brandl4b491312007-08-31 09:22:56 +00001386.. method:: object.__format__(self, format_spec)
1387
Martin Panterbc1ee462016-02-13 00:41:37 +00001388 Called by the :func:`format` built-in function,
1389 and by extension, evaluation of :ref:`formatted string literals
1390 <f-strings>` and the :meth:`str.format` method, to produce a "formatted"
Catherine Alvarado5e98f052019-05-04 17:54:35 -04001391 string representation of an object. The *format_spec* argument is
Georg Brandl4b491312007-08-31 09:22:56 +00001392 a string that contains a description of the formatting options desired.
Catherine Alvarado5e98f052019-05-04 17:54:35 -04001393 The interpretation of the *format_spec* argument is up to the type
Georg Brandl4b491312007-08-31 09:22:56 +00001394 implementing :meth:`__format__`, however most classes will either
1395 delegate formatting to one of the built-in types, or use a similar
1396 formatting option syntax.
Georg Brandl48310cd2009-01-03 21:18:54 +00001397
Georg Brandl4b491312007-08-31 09:22:56 +00001398 See :ref:`formatspec` for a description of the standard formatting syntax.
1399
1400 The return value must be a string object.
1401
R David Murrayd630e792014-02-11 18:34:22 -05001402 .. versionchanged:: 3.4
1403 The __format__ method of ``object`` itself raises a :exc:`TypeError`
1404 if passed any non-empty string.
1405
Serhiy Storchaka7e19dbc2017-05-13 12:40:52 +03001406 .. versionchanged:: 3.7
1407 ``object.__format__(x, '')`` is now equivalent to ``str(x)`` rather
Heshy Roskesef337122020-04-25 21:57:09 -04001408 than ``format(str(x), '')``.
Serhiy Storchaka7e19dbc2017-05-13 12:40:52 +03001409
Georg Brandl4b491312007-08-31 09:22:56 +00001410
Georg Brandl33413cb2009-03-31 19:06:37 +00001411.. _richcmpfuncs:
Georg Brandl116aa622007-08-15 14:28:22 +00001412.. method:: object.__lt__(self, other)
1413 object.__le__(self, other)
1414 object.__eq__(self, other)
1415 object.__ne__(self, other)
1416 object.__gt__(self, other)
1417 object.__ge__(self, other)
1418
Guido van Rossum2cc30da2007-11-02 23:46:40 +00001419 .. index::
1420 single: comparisons
1421
Georg Brandl05f5ab72008-09-24 09:11:47 +00001422 These are the so-called "rich comparison" methods. The correspondence between
Georg Brandl116aa622007-08-15 14:28:22 +00001423 operator symbols and method names is as follows: ``x<y`` calls ``x.__lt__(y)``,
1424 ``x<=y`` calls ``x.__le__(y)``, ``x==y`` calls ``x.__eq__(y)``, ``x!=y`` calls
1425 ``x.__ne__(y)``, ``x>y`` calls ``x.__gt__(y)``, and ``x>=y`` calls
1426 ``x.__ge__(y)``.
1427
1428 A rich comparison method may return the singleton ``NotImplemented`` if it does
1429 not implement the operation for a given pair of arguments. By convention,
1430 ``False`` and ``True`` are returned for a successful comparison. However, these
1431 methods can return any value, so if the comparison operator is used in a Boolean
1432 context (e.g., in the condition of an ``if`` statement), Python will call
1433 :func:`bool` on the value to determine if the result is true or false.
1434
Brett Cannon3c69f0c2020-10-21 16:24:38 -07001435 By default, ``object`` implements :meth:`__eq__` by using ``is``, returning
1436 ``NotImplemented`` in the case of a false comparison:
1437 ``True if x is y else NotImplemented``. For :meth:`__ne__`, by default it
1438 delegates to :meth:`__eq__` and inverts the result unless it is
1439 ``NotImplemented``. There are no other implied relationships among the
1440 comparison operators or default implementations; for example, the truth of
1441 ``(x<y or x==y)`` does not imply ``x<=y``. To automatically generate ordering
1442 operations from a single root operation, see :func:`functools.total_ordering`.
Robert Collinsd84b29f2015-08-07 10:22:54 +12001443
1444 See the paragraph on :meth:`__hash__` for
Guido van Rossum2cc30da2007-11-02 23:46:40 +00001445 some important notes on creating :term:`hashable` objects which support
1446 custom comparison operations and are usable as dictionary keys.
Georg Brandl116aa622007-08-15 14:28:22 +00001447
Guido van Rossum2cc30da2007-11-02 23:46:40 +00001448 There are no swapped-argument versions of these methods (to be used when the
1449 left argument does not support the operation but the right argument does);
1450 rather, :meth:`__lt__` and :meth:`__gt__` are each other's reflection,
Georg Brandl116aa622007-08-15 14:28:22 +00001451 :meth:`__le__` and :meth:`__ge__` are each other's reflection, and
1452 :meth:`__eq__` and :meth:`__ne__` are their own reflection.
Robert Collinsd84b29f2015-08-07 10:22:54 +12001453 If the operands are of different types, and right operand's type is
1454 a direct or indirect subclass of the left operand's type,
1455 the reflected method of the right operand has priority, otherwise
1456 the left operand's method has priority. Virtual subclassing is
1457 not considered.
Georg Brandl116aa622007-08-15 14:28:22 +00001458
Georg Brandl116aa622007-08-15 14:28:22 +00001459.. method:: object.__hash__(self)
1460
1461 .. index::
1462 object: dictionary
1463 builtin: hash
1464
Benjamin Peterson6cadba72008-11-19 22:38:29 +00001465 Called by built-in function :func:`hash` and for operations on members of
1466 hashed collections including :class:`set`, :class:`frozenset`, and
Victor Stinner509476b2016-12-19 13:09:28 +01001467 :class:`dict`. :meth:`__hash__` should return an integer. The only required
1468 property is that objects which compare equal have the same hash value; it is
1469 advised to mix together the hash values of the components of the object that
1470 also play a part in comparison of objects by packing them into a tuple and
1471 hashing the tuple. Example::
1472
1473 def __hash__(self):
1474 return hash((self.name, self.nick, self.color))
Barry Warsaw224a5992013-07-15 14:47:29 -04001475
1476 .. note::
1477
1478 :func:`hash` truncates the value returned from an object's custom
1479 :meth:`__hash__` method to the size of a :c:type:`Py_ssize_t`. This is
1480 typically 8 bytes on 64-bit builds and 4 bytes on 32-bit builds. If an
1481 object's :meth:`__hash__` must interoperate on builds of different bit
1482 sizes, be sure to check the width on all supported builds. An easy way
1483 to do this is with
Martin Panterd21e0b52015-10-10 10:36:22 +00001484 ``python -c "import sys; print(sys.hash_info.width)"``.
Georg Brandl116aa622007-08-15 14:28:22 +00001485
Georg Brandl05f5ab72008-09-24 09:11:47 +00001486 If a class does not define an :meth:`__eq__` method it should not define a
1487 :meth:`__hash__` operation either; if it defines :meth:`__eq__` but not
Benjamin Peterson6cadba72008-11-19 22:38:29 +00001488 :meth:`__hash__`, its instances will not be usable as items in hashable
1489 collections. If a class defines mutable objects and implements an
1490 :meth:`__eq__` method, it should not implement :meth:`__hash__`, since the
1491 implementation of hashable collections requires that a key's hash value is
1492 immutable (if the object's hash value changes, it will be in the wrong hash
1493 bucket).
1494
Georg Brandl05f5ab72008-09-24 09:11:47 +00001495 User-defined classes have :meth:`__eq__` and :meth:`__hash__` methods
Nick Coghlan73c96db2008-08-31 13:21:24 +00001496 by default; with them, all objects compare unequal (except with themselves)
Nick Coghlan337b2bf2012-05-20 18:30:49 +10001497 and ``x.__hash__()`` returns an appropriate value such that ``x == y``
1498 implies both that ``x is y`` and ``hash(x) == hash(y)``.
1499
R David Murrayd8bbde32012-09-11 13:01:43 -04001500 A class that overrides :meth:`__eq__` and does not define :meth:`__hash__`
1501 will have its :meth:`__hash__` implicitly set to ``None``. When the
1502 :meth:`__hash__` method of a class is ``None``, instances of the class will
1503 raise an appropriate :exc:`TypeError` when a program attempts to retrieve
1504 their hash value, and will also be correctly identified as unhashable when
Serhiy Storchaka2e576f52017-04-24 09:05:00 +03001505 checking ``isinstance(obj, collections.abc.Hashable)``.
Nick Coghlan73c96db2008-08-31 13:21:24 +00001506
Georg Brandlae2dbe22009-03-13 19:04:40 +00001507 If a class that overrides :meth:`__eq__` needs to retain the implementation
Georg Brandl05f5ab72008-09-24 09:11:47 +00001508 of :meth:`__hash__` from a parent class, the interpreter must be told this
R David Murrayd8bbde32012-09-11 13:01:43 -04001509 explicitly by setting ``__hash__ = <ParentClass>.__hash__``.
1510
1511 If a class that does not override :meth:`__eq__` wishes to suppress hash
1512 support, it should include ``__hash__ = None`` in the class definition.
1513 A class which defines its own :meth:`__hash__` that explicitly raises
1514 a :exc:`TypeError` would be incorrectly identified as hashable by
Serhiy Storchaka2e576f52017-04-24 09:05:00 +03001515 an ``isinstance(obj, collections.abc.Hashable)`` call.
Georg Brandl05f5ab72008-09-24 09:11:47 +00001516
Benjamin Petersonc9f54cf2012-02-21 16:08:05 -05001517
1518 .. note::
1519
Serhiy Storchakae9c90aa2019-08-24 12:49:27 +03001520 By default, the :meth:`__hash__` values of str and bytes objects are
1521 "salted" with an unpredictable random value. Although they
Benjamin Petersonc9f54cf2012-02-21 16:08:05 -05001522 remain constant within an individual Python process, they are not
1523 predictable between repeated invocations of Python.
1524
1525 This is intended to provide protection against a denial-of-service caused
1526 by carefully-chosen inputs that exploit the worst case performance of a
1527 dict insertion, O(n^2) complexity. See
1528 http://www.ocert.org/advisories/ocert-2011-003.html for details.
1529
wim glenna48e0eb2018-11-16 05:58:19 -06001530 Changing hash values affects the iteration order of sets.
1531 Python has never made guarantees about this ordering
Antoine Pitrouc86e8d92012-08-01 14:53:22 +02001532 (and it typically varies between 32-bit and 64-bit builds).
Benjamin Petersonc9f54cf2012-02-21 16:08:05 -05001533
1534 See also :envvar:`PYTHONHASHSEED`.
1535
1536 .. versionchanged:: 3.3
1537 Hash randomization is enabled by default.
Georg Brandl2daf6ae2012-02-20 19:54:16 +01001538
Georg Brandl116aa622007-08-15 14:28:22 +00001539
1540.. method:: object.__bool__(self)
Georg Brandl1aeaadd2008-09-06 17:42:52 +00001541
Georg Brandl116aa622007-08-15 14:28:22 +00001542 .. index:: single: __len__() (mapping object method)
1543
Benjamin Petersonf07d0022009-03-21 17:31:58 +00001544 Called to implement truth value testing and the built-in operation
Amaury Forgeot d'Arc097cd072009-07-07 00:43:08 +00001545 ``bool()``; should return ``False`` or ``True``. When this method is not
1546 defined, :meth:`__len__` is called, if it is defined, and the object is
1547 considered true if its result is nonzero. If a class defines neither
1548 :meth:`__len__` nor :meth:`__bool__`, all its instances are considered
1549 true.
Georg Brandl116aa622007-08-15 14:28:22 +00001550
1551
Georg Brandl116aa622007-08-15 14:28:22 +00001552.. _attribute-access:
1553
1554Customizing attribute access
1555----------------------------
1556
1557The following methods can be defined to customize the meaning of attribute
1558access (use of, assignment to, or deletion of ``x.name``) for class instances.
1559
Georg Brandl85eb8c12007-08-31 16:33:38 +00001560.. XXX explain how descriptors interfere here!
1561
Georg Brandl116aa622007-08-15 14:28:22 +00001562
1563.. method:: object.__getattr__(self, name)
1564
Cheryl Sabellad1f31812018-02-04 21:03:22 -05001565 Called when the default attribute access fails with an :exc:`AttributeError`
1566 (either :meth:`__getattribute__` raises an :exc:`AttributeError` because
1567 *name* is not an instance attribute or an attribute in the class tree
1568 for ``self``; or :meth:`__get__` of a *name* property raises
1569 :exc:`AttributeError`). This method should either return the (computed)
1570 attribute value or raise an :exc:`AttributeError` exception.
Georg Brandl116aa622007-08-15 14:28:22 +00001571
Georg Brandl116aa622007-08-15 14:28:22 +00001572 Note that if the attribute is found through the normal mechanism,
1573 :meth:`__getattr__` is not called. (This is an intentional asymmetry between
1574 :meth:`__getattr__` and :meth:`__setattr__`.) This is done both for efficiency
Nick Coghlan3a5d7e32008-08-31 12:40:14 +00001575 reasons and because otherwise :meth:`__getattr__` would have no way to access
Georg Brandl116aa622007-08-15 14:28:22 +00001576 other attributes of the instance. Note that at least for instance variables,
1577 you can fake total control by not inserting any values in the instance attribute
1578 dictionary (but instead inserting them in another object). See the
Georg Brandl85eb8c12007-08-31 16:33:38 +00001579 :meth:`__getattribute__` method below for a way to actually get total control
1580 over attribute access.
Georg Brandl116aa622007-08-15 14:28:22 +00001581
1582
1583.. method:: object.__getattribute__(self, name)
1584
1585 Called unconditionally to implement attribute accesses for instances of the
1586 class. If the class also defines :meth:`__getattr__`, the latter will not be
1587 called unless :meth:`__getattribute__` either calls it explicitly or raises an
1588 :exc:`AttributeError`. This method should return the (computed) attribute value
1589 or raise an :exc:`AttributeError` exception. In order to avoid infinite
1590 recursion in this method, its implementation should always call the base class
1591 method with the same name to access any attributes it needs, for example,
1592 ``object.__getattribute__(self, name)``.
1593
Nick Coghlan3a5d7e32008-08-31 12:40:14 +00001594 .. note::
1595
1596 This method may still be bypassed when looking up special methods as the
Georg Brandl22b34312009-07-26 14:54:51 +00001597 result of implicit invocation via language syntax or built-in functions.
Nick Coghlan3a5d7e32008-08-31 12:40:14 +00001598 See :ref:`special-lookup`.
1599
Saiyang Gou3f7e9902020-10-20 12:23:15 -07001600 .. audit-event:: object.__getattr__ obj,name object.__getattribute__
1601
1602 For certain sensitive attribute accesses, raises an
1603 :ref:`auditing event <auditing>` ``object.__getattr__`` with arguments
1604 ``obj`` and ``name``.
1605
Georg Brandl116aa622007-08-15 14:28:22 +00001606
Georg Brandl85eb8c12007-08-31 16:33:38 +00001607.. method:: object.__setattr__(self, name, value)
1608
1609 Called when an attribute assignment is attempted. This is called instead of
1610 the normal mechanism (i.e. store the value in the instance dictionary).
1611 *name* is the attribute name, *value* is the value to be assigned to it.
1612
1613 If :meth:`__setattr__` wants to assign to an instance attribute, it should
1614 call the base class method with the same name, for example,
1615 ``object.__setattr__(self, name, value)``.
1616
Saiyang Gou3f7e9902020-10-20 12:23:15 -07001617 .. audit-event:: object.__setattr__ obj,name,value object.__setattr__
1618
1619 For certain sensitive attribute assignments, raises an
1620 :ref:`auditing event <auditing>` ``object.__setattr__`` with arguments
1621 ``obj``, ``name``, ``value``.
1622
Georg Brandl85eb8c12007-08-31 16:33:38 +00001623
1624.. method:: object.__delattr__(self, name)
1625
1626 Like :meth:`__setattr__` but for attribute deletion instead of assignment. This
1627 should only be implemented if ``del obj.name`` is meaningful for the object.
1628
Saiyang Gou3f7e9902020-10-20 12:23:15 -07001629 .. audit-event:: object.__delattr__ obj,name object.__delattr__
1630
1631 For certain sensitive attribute deletions, raises an
1632 :ref:`auditing event <auditing>` ``object.__delattr__`` with arguments
1633 ``obj`` and ``name``.
1634
Georg Brandl85eb8c12007-08-31 16:33:38 +00001635
Benjamin Peterson1cef37c2008-07-02 14:44:54 +00001636.. method:: object.__dir__(self)
1637
Benjamin Peterson3bbb7222011-06-11 16:12:08 -05001638 Called when :func:`dir` is called on the object. A sequence must be
1639 returned. :func:`dir` converts the returned sequence to a list and sorts it.
Benjamin Peterson1cef37c2008-07-02 14:44:54 +00001640
1641
Ivan Levkivskyi5364b5c2017-12-14 11:59:44 +01001642Customizing module attribute access
1643^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1644
1645.. index::
1646 single: __getattr__ (module attribute)
1647 single: __dir__ (module attribute)
1648 single: __class__ (module attribute)
1649
1650Special names ``__getattr__`` and ``__dir__`` can be also used to customize
1651access to module attributes. The ``__getattr__`` function at the module level
1652should accept one argument which is the name of an attribute and return the
1653computed value or raise an :exc:`AttributeError`. If an attribute is
1654not found on a module object through the normal lookup, i.e.
1655:meth:`object.__getattribute__`, then ``__getattr__`` is searched in
1656the module ``__dict__`` before raising an :exc:`AttributeError`. If found,
1657it is called with the attribute name and the result is returned.
1658
alclarks4544e782019-11-17 22:00:43 +00001659The ``__dir__`` function should accept no arguments, and return a sequence of
Ivan Levkivskyi5364b5c2017-12-14 11:59:44 +01001660strings that represents the names accessible on module. If present, this
1661function overrides the standard :func:`dir` search on a module.
1662
1663For a more fine grained customization of the module behavior (setting
1664attributes, properties, etc.), one can set the ``__class__`` attribute of
1665a module object to a subclass of :class:`types.ModuleType`. For example::
1666
1667 import sys
1668 from types import ModuleType
1669
1670 class VerboseModule(ModuleType):
1671 def __repr__(self):
1672 return f'Verbose {self.__name__}'
1673
1674 def __setattr__(self, attr, value):
1675 print(f'Setting {attr}...')
Denis Osipov0bee3c32018-11-06 06:53:21 +05001676 super().__setattr__(attr, value)
Ivan Levkivskyi5364b5c2017-12-14 11:59:44 +01001677
1678 sys.modules[__name__].__class__ = VerboseModule
1679
1680.. note::
1681 Defining module ``__getattr__`` and setting module ``__class__`` only
1682 affect lookups made using the attribute access syntax -- directly accessing
1683 the module globals (whether by code within the module, or via a reference
1684 to the module's globals dictionary) is unaffected.
1685
Cheryl Sabella85527cf2018-01-26 21:40:52 -05001686.. versionchanged:: 3.5
1687 ``__class__`` module attribute is now writable.
1688
1689.. versionadded:: 3.7
1690 ``__getattr__`` and ``__dir__`` module attributes.
1691
1692.. seealso::
1693
1694 :pep:`562` - Module __getattr__ and __dir__
1695 Describes the ``__getattr__`` and ``__dir__`` functions on modules.
1696
Ivan Levkivskyi5364b5c2017-12-14 11:59:44 +01001697
Georg Brandl116aa622007-08-15 14:28:22 +00001698.. _descriptors:
1699
1700Implementing Descriptors
1701^^^^^^^^^^^^^^^^^^^^^^^^
1702
1703The following methods only apply when an instance of the class containing the
Raymond Hettinger3b654be2011-03-22 16:27:02 -07001704method (a so-called *descriptor* class) appears in an *owner* class (the
1705descriptor must be in either the owner's class dictionary or in the class
1706dictionary for one of its parents). In the examples below, "the attribute"
1707refers to the attribute whose name is the key of the property in the owner
Martin Panterbae5d812016-06-18 03:57:31 +00001708class' :attr:`~object.__dict__`.
Georg Brandl116aa622007-08-15 14:28:22 +00001709
1710
Raymond Hettinger0dac68f2019-08-29 01:27:42 -07001711.. method:: object.__get__(self, instance, owner=None)
Georg Brandl116aa622007-08-15 14:28:22 +00001712
Raymond Hettinger0dac68f2019-08-29 01:27:42 -07001713 Called to get the attribute of the owner class (class attribute access) or
1714 of an instance of that class (instance attribute access). The optional
1715 *owner* argument is the owner class, while *instance* is the instance that
1716 the attribute was accessed through, or ``None`` when the attribute is
1717 accessed through the *owner*.
Georg Brandl116aa622007-08-15 14:28:22 +00001718
Raymond Hettinger0dac68f2019-08-29 01:27:42 -07001719 This method should return the computed attribute value or raise an
1720 :exc:`AttributeError` exception.
1721
1722 :PEP:`252` specifies that :meth:`__get__` is callable with one or two
1723 arguments. Python's own built-in descriptors support this specification;
1724 however, it is likely that some third-party tools have descriptors
1725 that require both arguments. Python's own :meth:`__getattribute__`
1726 implementation always passes in both arguments whether they are required
1727 or not.
Georg Brandl116aa622007-08-15 14:28:22 +00001728
1729.. method:: object.__set__(self, instance, value)
1730
1731 Called to set the attribute on an instance *instance* of the owner class to a
1732 new value, *value*.
1733
Raymond Hettinger0dac68f2019-08-29 01:27:42 -07001734 Note, adding :meth:`__set__` or :meth:`__delete__` changes the kind of
1735 descriptor to a "data descriptor". See :ref:`descriptor-invocation` for
1736 more details.
Georg Brandl116aa622007-08-15 14:28:22 +00001737
1738.. method:: object.__delete__(self, instance)
1739
1740 Called to delete the attribute on an instance *instance* of the owner class.
1741
1742
Nick Coghland78448e2016-07-30 16:26:03 +10001743.. method:: object.__set_name__(self, owner, name)
1744
1745 Called at the time the owning class *owner* is created. The
1746 descriptor has been assigned to *name*.
1747
Florian Dahlitz1bddf892019-11-27 09:46:40 +01001748 .. note::
Berker Peksag01d17192016-07-30 14:06:15 +03001749
Tal Einat02519f72019-11-28 07:22:09 +02001750 :meth:`__set_name__` is only called implicitly as part of the
1751 :class:`type` constructor, so it will need to be called explicitly with
1752 the appropriate parameters when a descriptor is added to a class after
1753 initial creation::
Florian Dahlitz1bddf892019-11-27 09:46:40 +01001754
Tal Einat02519f72019-11-28 07:22:09 +02001755 class A:
1756 pass
Florian Dahlitz1bddf892019-11-27 09:46:40 +01001757 descr = custom_descriptor()
Tal Einat02519f72019-11-28 07:22:09 +02001758 A.attr = descr
1759 descr.__set_name__(A, 'attr')
Florian Dahlitz1bddf892019-11-27 09:46:40 +01001760
1761 See :ref:`class-object-creation` for more details.
1762
1763 .. versionadded:: 3.6
Nick Coghland78448e2016-07-30 16:26:03 +10001764
Yury Selivanov490a72e2014-04-08 14:01:12 -04001765The attribute :attr:`__objclass__` is interpreted by the :mod:`inspect` module
1766as specifying the class where this object was defined (setting this
1767appropriately can assist in runtime introspection of dynamic class attributes).
1768For callables, it may indicate that an instance of the given type (or a
1769subclass) is expected or required as the first positional argument (for example,
1770CPython sets this attribute for unbound methods that are implemented in C).
Yury Selivanovb9aa8cb2014-04-08 12:04:04 -04001771
1772
Georg Brandl116aa622007-08-15 14:28:22 +00001773.. _descriptor-invocation:
1774
1775Invoking Descriptors
1776^^^^^^^^^^^^^^^^^^^^
1777
1778In general, a descriptor is an object attribute with "binding behavior", one
1779whose attribute access has been overridden by methods in the descriptor
1780protocol: :meth:`__get__`, :meth:`__set__`, and :meth:`__delete__`. If any of
1781those methods are defined for an object, it is said to be a descriptor.
1782
1783The default behavior for attribute access is to get, set, or delete the
1784attribute from an object's dictionary. For instance, ``a.x`` has a lookup chain
1785starting with ``a.__dict__['x']``, then ``type(a).__dict__['x']``, and
1786continuing through the base classes of ``type(a)`` excluding metaclasses.
1787
1788However, if the looked-up value is an object defining one of the descriptor
1789methods, then Python may override the default behavior and invoke the descriptor
1790method instead. Where this occurs in the precedence chain depends on which
Georg Brandl23e8db52008-04-07 19:17:06 +00001791descriptor methods were defined and how they were called.
Georg Brandl116aa622007-08-15 14:28:22 +00001792
1793The starting point for descriptor invocation is a binding, ``a.x``. How the
1794arguments are assembled depends on ``a``:
1795
1796Direct Call
1797 The simplest and least common call is when user code directly invokes a
1798 descriptor method: ``x.__get__(a)``.
1799
1800Instance Binding
Georg Brandl85eb8c12007-08-31 16:33:38 +00001801 If binding to an object instance, ``a.x`` is transformed into the call:
Georg Brandl116aa622007-08-15 14:28:22 +00001802 ``type(a).__dict__['x'].__get__(a, type(a))``.
1803
1804Class Binding
Georg Brandl85eb8c12007-08-31 16:33:38 +00001805 If binding to a class, ``A.x`` is transformed into the call:
Georg Brandl116aa622007-08-15 14:28:22 +00001806 ``A.__dict__['x'].__get__(None, A)``.
1807
1808Super Binding
csabella12b1c182017-05-14 20:42:00 -07001809 If ``a`` is an instance of :class:`super`, then the binding ``super(B, obj).m()``
1810 searches ``obj.__class__.__mro__`` for the base class ``A``
Georg Brandl116aa622007-08-15 14:28:22 +00001811 immediately preceding ``B`` and then invokes the descriptor with the call:
Raymond Hettingerb199b222011-03-22 15:28:45 -07001812 ``A.__dict__['m'].__get__(obj, obj.__class__)``.
Georg Brandl116aa622007-08-15 14:28:22 +00001813
Géry Ogama1a5e3c2021-04-25 23:13:19 +02001814For instance bindings, the precedence of descriptor invocation depends on
Benjamin Peterson5e55b3e2010-02-03 02:35:45 +00001815which descriptor methods are defined. A descriptor can define any combination
1816of :meth:`__get__`, :meth:`__set__` and :meth:`__delete__`. If it does not
1817define :meth:`__get__`, then accessing the attribute will return the descriptor
1818object itself unless there is a value in the object's instance dictionary. If
1819the descriptor defines :meth:`__set__` and/or :meth:`__delete__`, it is a data
1820descriptor; if it defines neither, it is a non-data descriptor. Normally, data
1821descriptors define both :meth:`__get__` and :meth:`__set__`, while non-data
1822descriptors have just the :meth:`__get__` method. Data descriptors with
Géry Ogam4c155f72019-10-29 08:04:01 +01001823:meth:`__get__` and :meth:`__set__` (and/or :meth:`__delete__`) defined always override a redefinition in an
Georg Brandl116aa622007-08-15 14:28:22 +00001824instance dictionary. In contrast, non-data descriptors can be overridden by
Benjamin Peterson5e55b3e2010-02-03 02:35:45 +00001825instances.
Georg Brandl116aa622007-08-15 14:28:22 +00001826
1827Python methods (including :func:`staticmethod` and :func:`classmethod`) are
1828implemented as non-data descriptors. Accordingly, instances can redefine and
1829override methods. This allows individual instances to acquire behaviors that
1830differ from other instances of the same class.
1831
1832The :func:`property` function is implemented as a data descriptor. Accordingly,
1833instances cannot override the behavior of a property.
1834
1835
1836.. _slots:
1837
1838__slots__
1839^^^^^^^^^
1840
Aaron Hall, MBA2b44e302017-05-25 22:33:26 -07001841*__slots__* allow us to explicitly declare data members (like
1842properties) and deny the creation of *__dict__* and *__weakref__*
1843(unless explicitly declared in *__slots__* or available in a parent.)
Georg Brandl116aa622007-08-15 14:28:22 +00001844
Aaron Hall, MBA2b44e302017-05-25 22:33:26 -07001845The space saved over using *__dict__* can be significant.
Raymond Hettinger74638842019-02-21 03:34:04 -08001846Attribute lookup speed can be significantly improved as well.
Georg Brandl116aa622007-08-15 14:28:22 +00001847
Georg Brandl85eb8c12007-08-31 16:33:38 +00001848.. data:: object.__slots__
Georg Brandl116aa622007-08-15 14:28:22 +00001849
Georg Brandl85eb8c12007-08-31 16:33:38 +00001850 This class variable can be assigned a string, iterable, or sequence of
Georg Brandla4c8c472014-10-31 10:38:49 +01001851 strings with variable names used by instances. *__slots__* reserves space
1852 for the declared variables and prevents the automatic creation of *__dict__*
1853 and *__weakref__* for each instance.
Georg Brandl116aa622007-08-15 14:28:22 +00001854
Georg Brandl116aa622007-08-15 14:28:22 +00001855
1856Notes on using *__slots__*
Georg Brandl16174572007-09-01 12:38:06 +00001857""""""""""""""""""""""""""
Georg Brandl116aa622007-08-15 14:28:22 +00001858
Aaron Hall, MBA2b44e302017-05-25 22:33:26 -07001859* When inheriting from a class without *__slots__*, the *__dict__* and
1860 *__weakref__* attribute of the instances will always be accessible.
Georg Brandl3dbca812008-07-23 16:10:53 +00001861
Georg Brandl116aa622007-08-15 14:28:22 +00001862* Without a *__dict__* variable, instances cannot be assigned new variables not
1863 listed in the *__slots__* definition. Attempts to assign to an unlisted
1864 variable name raises :exc:`AttributeError`. If dynamic assignment of new
Georg Brandl85eb8c12007-08-31 16:33:38 +00001865 variables is desired, then add ``'__dict__'`` to the sequence of strings in
1866 the *__slots__* declaration.
Georg Brandl116aa622007-08-15 14:28:22 +00001867
Georg Brandl116aa622007-08-15 14:28:22 +00001868* Without a *__weakref__* variable for each instance, classes defining
1869 *__slots__* do not support weak references to its instances. If weak reference
1870 support is needed, then add ``'__weakref__'`` to the sequence of strings in the
1871 *__slots__* declaration.
1872
Georg Brandl116aa622007-08-15 14:28:22 +00001873* *__slots__* are implemented at the class level by creating descriptors
1874 (:ref:`descriptors`) for each variable name. As a result, class attributes
1875 cannot be used to set default values for instance variables defined by
1876 *__slots__*; otherwise, the class attribute would overwrite the descriptor
1877 assignment.
1878
Aaron Hall, MBA2b44e302017-05-25 22:33:26 -07001879* The action of a *__slots__* declaration is not limited to the class
1880 where it is defined. *__slots__* declared in parents are available in
1881 child classes. However, child subclasses will get a *__dict__* and
1882 *__weakref__* unless they also define *__slots__* (which should only
1883 contain names of any *additional* slots).
Georg Brandl495f7b52009-10-27 15:28:25 +00001884
Georg Brandl116aa622007-08-15 14:28:22 +00001885* If a class defines a slot also defined in a base class, the instance variable
1886 defined by the base class slot is inaccessible (except by retrieving its
1887 descriptor directly from the base class). This renders the meaning of the
1888 program undefined. In the future, a check may be added to prevent this.
1889
Benjamin Peterson1a6e0d02008-10-25 15:49:17 +00001890* Nonempty *__slots__* does not work for classes derived from "variable-length"
Zachary Ware340a6922013-12-31 12:09:26 -06001891 built-in types such as :class:`int`, :class:`bytes` and :class:`tuple`.
Georg Brandl116aa622007-08-15 14:28:22 +00001892
1893* Any non-string iterable may be assigned to *__slots__*. Mappings may also be
1894 used; however, in the future, special meaning may be assigned to the values
1895 corresponding to each key.
1896
1897* *__class__* assignment works only if both classes have the same *__slots__*.
1898
Aaron Hall, MBA2b44e302017-05-25 22:33:26 -07001899* Multiple inheritance with multiple slotted parent classes can be used,
1900 but only one parent is allowed to have attributes created by slots
1901 (the other bases must have empty slot layouts) - violations raise
1902 :exc:`TypeError`.
Georg Brandl116aa622007-08-15 14:28:22 +00001903
alclarks4544e782019-11-17 22:00:43 +00001904* If an iterator is used for *__slots__* then a descriptor is created for each
1905 of the iterator's values. However, the *__slots__* attribute will be an empty
1906 iterator.
1907
Nick Coghland78448e2016-07-30 16:26:03 +10001908.. _class-customization:
Georg Brandl116aa622007-08-15 14:28:22 +00001909
1910Customizing class creation
1911--------------------------
1912
Nick Coghland78448e2016-07-30 16:26:03 +10001913Whenever a class inherits from another class, *__init_subclass__* is
1914called on that class. This way, it is possible to write classes which
1915change the behavior of subclasses. This is closely related to class
1916decorators, but where class decorators only affect the specific class they're
1917applied to, ``__init_subclass__`` solely applies to future subclasses of the
1918class defining the method.
1919
1920.. classmethod:: object.__init_subclass__(cls)
Berker Peksag01d17192016-07-30 14:06:15 +03001921
Nick Coghland78448e2016-07-30 16:26:03 +10001922 This method is called whenever the containing class is subclassed.
1923 *cls* is then the new subclass. If defined as a normal instance method,
1924 this method is implicitly converted to a class method.
1925
1926 Keyword arguments which are given to a new class are passed to
1927 the parent's class ``__init_subclass__``. For compatibility with
1928 other classes using ``__init_subclass__``, one should take out the
1929 needed keyword arguments and pass the others over to the base
1930 class, as in::
1931
1932 class Philosopher:
Serhiy Storchaka70c5f2a2019-06-01 11:38:24 +03001933 def __init_subclass__(cls, /, default_name, **kwargs):
Nick Coghland78448e2016-07-30 16:26:03 +10001934 super().__init_subclass__(**kwargs)
1935 cls.default_name = default_name
1936
1937 class AustralianPhilosopher(Philosopher, default_name="Bruce"):
1938 pass
1939
1940 The default implementation ``object.__init_subclass__`` does
1941 nothing, but raises an error if it is called with any arguments.
1942
Nick Coghlan607e1c42016-07-31 12:42:49 +10001943 .. note::
1944
1945 The metaclass hint ``metaclass`` is consumed by the rest of the type
1946 machinery, and is never passed to ``__init_subclass__`` implementations.
1947 The actual metaclass (rather than the explicit hint) can be accessed as
1948 ``type(cls)``.
1949
Berker Peksag01d17192016-07-30 14:06:15 +03001950 .. versionadded:: 3.6
1951
Nick Coghland78448e2016-07-30 16:26:03 +10001952
1953.. _metaclasses:
1954
1955Metaclasses
1956^^^^^^^^^^^
1957
Nick Coghlan19d24672016-12-05 16:47:55 +10001958.. index::
Serhiy Storchakaddb961d2018-10-26 09:00:49 +03001959 single: metaclass
1960 builtin: type
Serhiy Storchaka913876d2018-10-28 13:41:26 +02001961 single: = (equals); class definition
Nick Coghlan19d24672016-12-05 16:47:55 +10001962
Nick Coghlan7fc570a2012-05-20 02:34:13 +10001963By default, classes are constructed using :func:`type`. The class body is
1964executed in a new namespace and the class name is bound locally to the
1965result of ``type(name, bases, namespace)``.
Georg Brandl116aa622007-08-15 14:28:22 +00001966
Raymond Hettinger7ea386e2016-08-25 21:11:50 -07001967The class creation process can be customized by passing the ``metaclass``
Nick Coghlan7fc570a2012-05-20 02:34:13 +10001968keyword argument in the class definition line, or by inheriting from an
1969existing class that included such an argument. In the following example,
1970both ``MyClass`` and ``MySubclass`` are instances of ``Meta``::
Georg Brandl116aa622007-08-15 14:28:22 +00001971
Nick Coghlan7fc570a2012-05-20 02:34:13 +10001972 class Meta(type):
1973 pass
Georg Brandl116aa622007-08-15 14:28:22 +00001974
Nick Coghlan7fc570a2012-05-20 02:34:13 +10001975 class MyClass(metaclass=Meta):
1976 pass
Georg Brandl116aa622007-08-15 14:28:22 +00001977
Nick Coghlan7fc570a2012-05-20 02:34:13 +10001978 class MySubclass(MyClass):
1979 pass
Christian Heimes790c8232008-01-07 21:14:23 +00001980
Nick Coghlan7fc570a2012-05-20 02:34:13 +10001981Any other keyword arguments that are specified in the class definition are
1982passed through to all metaclass operations described below.
Christian Heimes790c8232008-01-07 21:14:23 +00001983
Nick Coghlan7fc570a2012-05-20 02:34:13 +10001984When a class definition is executed, the following steps occur:
Christian Heimes790c8232008-01-07 21:14:23 +00001985
Jules Lasne (jlasne)1fc5bf22019-03-27 11:10:33 +01001986* MRO entries are resolved;
1987* the appropriate metaclass is determined;
1988* the class namespace is prepared;
1989* the class body is executed;
1990* the class object is created.
Georg Brandl116aa622007-08-15 14:28:22 +00001991
Ivan Levkivskyibd5f9652018-05-08 19:38:41 +01001992
1993Resolving MRO entries
1994^^^^^^^^^^^^^^^^^^^^^
1995
1996If a base that appears in class definition is not an instance of :class:`type`,
1997then an ``__mro_entries__`` method is searched on it. If found, it is called
1998with the original bases tuple. This method must return a tuple of classes that
1999will be used instead of this base. The tuple may be empty, in such case
2000the original base is ignored.
2001
2002.. seealso::
2003
2004 :pep:`560` - Core support for typing module and generic types
2005
2006
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002007Determining the appropriate metaclass
2008^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nick Coghlan19d24672016-12-05 16:47:55 +10002009.. index::
2010 single: metaclass hint
Georg Brandl116aa622007-08-15 14:28:22 +00002011
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002012The appropriate metaclass for a class definition is determined as follows:
Georg Brandl116aa622007-08-15 14:28:22 +00002013
Jules Lasne (jlasne)1fc5bf22019-03-27 11:10:33 +01002014* if no bases and no explicit metaclass are given, then :func:`type` is used;
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002015* if an explicit metaclass is given and it is *not* an instance of
Jules Lasne (jlasne)1fc5bf22019-03-27 11:10:33 +01002016 :func:`type`, then it is used directly as the metaclass;
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002017* if an instance of :func:`type` is given as the explicit metaclass, or
Jules Lasne (jlasne)1fc5bf22019-03-27 11:10:33 +01002018 bases are defined, then the most derived metaclass is used.
Georg Brandl116aa622007-08-15 14:28:22 +00002019
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002020The most derived metaclass is selected from the explicitly specified
2021metaclass (if any) and the metaclasses (i.e. ``type(cls)``) of all specified
2022base classes. The most derived metaclass is one which is a subtype of *all*
2023of these candidate metaclasses. If none of the candidate metaclasses meets
2024that criterion, then the class definition will fail with ``TypeError``.
2025
2026
R David Murrayaf7d2c42014-02-12 13:00:36 -05002027.. _prepare:
2028
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002029Preparing the class namespace
2030^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2031
Nick Coghlan19d24672016-12-05 16:47:55 +10002032.. index::
2033 single: __prepare__ (metaclass method)
2034
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002035Once the appropriate metaclass has been identified, then the class namespace
2036is prepared. If the metaclass has a ``__prepare__`` attribute, it is called
2037as ``namespace = metaclass.__prepare__(name, bases, **kwds)`` (where the
alclarks7de61742020-01-25 18:49:58 +00002038additional keyword arguments, if any, come from the class definition). The
ananthan-123fbe2e0b2020-02-22 23:26:02 +05302039``__prepare__`` method should be implemented as a :func:`classmethod`. The
2040namespace returned by ``__prepare__`` is passed in to ``__new__``, but when
2041the final class object is created the namespace is copied into a new ``dict``.
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002042
2043If the metaclass has no ``__prepare__`` attribute, then the class namespace
Caleb Donovicke59334e2020-03-06 10:20:48 -08002044is initialised as an empty ordered mapping.
Eric Snow92a6c172016-09-05 14:50:11 -07002045
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002046.. seealso::
2047
2048 :pep:`3115` - Metaclasses in Python 3000
2049 Introduced the ``__prepare__`` namespace hook
2050
2051
2052Executing the class body
2053^^^^^^^^^^^^^^^^^^^^^^^^
2054
Nick Coghlan19d24672016-12-05 16:47:55 +10002055.. index::
2056 single: class; body
2057
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002058The class body is executed (approximately) as
2059``exec(body, globals(), namespace)``. The key difference from a normal
2060call to :func:`exec` is that lexical scoping allows the class body (including
2061any methods) to reference names from the current and outer scopes when the
2062class definition occurs inside a function.
2063
2064However, even when the class definition occurs inside the function, methods
2065defined inside the class still cannot see names defined at the class scope.
2066Class variables must be accessed through the first parameter of instance or
Nick Coghlan19d24672016-12-05 16:47:55 +10002067class methods, or through the implicit lexically scoped ``__class__`` reference
2068described in the next section.
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002069
Nick Coghlan19d24672016-12-05 16:47:55 +10002070.. _class-object-creation:
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002071
2072Creating the class object
2073^^^^^^^^^^^^^^^^^^^^^^^^^
2074
Nick Coghlan19d24672016-12-05 16:47:55 +10002075.. index::
2076 single: __class__ (method cell)
2077 single: __classcell__ (class namespace entry)
2078
2079
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002080Once the class namespace has been populated by executing the class body,
2081the class object is created by calling
2082``metaclass(name, bases, namespace, **kwds)`` (the additional keywords
Nick Coghlan78770f02012-05-20 18:15:11 +10002083passed here are the same as those passed to ``__prepare__``).
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002084
2085This class object is the one that will be referenced by the zero-argument
2086form of :func:`super`. ``__class__`` is an implicit closure reference
2087created by the compiler if any methods in a class body refer to either
2088``__class__`` or ``super``. This allows the zero argument form of
2089:func:`super` to correctly identify the class being defined based on
2090lexical scoping, while the class or instance that was used to make the
2091current call is identified based on the first argument passed to the method.
2092
Nick Coghlan19d24672016-12-05 16:47:55 +10002093.. impl-detail::
2094
2095 In CPython 3.6 and later, the ``__class__`` cell is passed to the metaclass
2096 as a ``__classcell__`` entry in the class namespace. If present, this must
2097 be propagated up to the ``type.__new__`` call in order for the class to be
2098 initialised correctly.
Serhiy Storchakaf5e7b192018-05-20 08:48:12 +03002099 Failing to do so will result in a :exc:`RuntimeError` in Python 3.8.
Nick Coghlan19d24672016-12-05 16:47:55 +10002100
2101When using the default metaclass :class:`type`, or any metaclass that ultimately
2102calls ``type.__new__``, the following additional customisation steps are
2103invoked after creating the class object:
2104
2105* first, ``type.__new__`` collects all of the descriptors in the class
2106 namespace that define a :meth:`~object.__set_name__` method;
2107* second, all of these ``__set_name__`` methods are called with the class
Jules Lasne (jlasne)1fc5bf22019-03-27 11:10:33 +01002108 being defined and the assigned name of that particular descriptor;
Nick Coghlan19d24672016-12-05 16:47:55 +10002109* finally, the :meth:`~object.__init_subclass__` hook is called on the
2110 immediate parent of the new class in its method resolution order.
2111
Nick Coghlanb2674752012-05-20 19:36:40 +10002112After the class object is created, it is passed to the class decorators
2113included in the class definition (if any) and the resulting object is bound
2114in the local namespace as the defined class.
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002115
R David Murraydd4fcf52016-06-02 20:05:43 -04002116When a new class is created by ``type.__new__``, the object provided as the
Eric Snow68f4dd82016-09-09 11:22:14 -07002117namespace parameter is copied to a new ordered mapping and the original
2118object is discarded. The new copy is wrapped in a read-only proxy, which
2119becomes the :attr:`~object.__dict__` attribute of the class object.
R David Murraydd4fcf52016-06-02 20:05:43 -04002120
Nick Coghlan7fc570a2012-05-20 02:34:13 +10002121.. seealso::
2122
2123 :pep:`3135` - New super
2124 Describes the implicit ``__class__`` closure reference
2125
2126
Andrés Delfinoc2ccac72018-11-16 08:41:55 -03002127Uses for metaclasses
2128^^^^^^^^^^^^^^^^^^^^
Georg Brandl116aa622007-08-15 14:28:22 +00002129
2130The potential uses for metaclasses are boundless. Some ideas that have been
Louie Lub8d1b9d2017-09-13 12:44:14 +08002131explored include enum, logging, interface checking, automatic delegation,
2132automatic property creation, proxies, frameworks, and automatic resource
Georg Brandl116aa622007-08-15 14:28:22 +00002133locking/synchronization.
2134
2135
Georg Brandl8569e582010-05-19 20:57:08 +00002136Customizing instance and subclass checks
2137----------------------------------------
2138
2139The following methods are used to override the default behavior of the
2140:func:`isinstance` and :func:`issubclass` built-in functions.
2141
2142In particular, the metaclass :class:`abc.ABCMeta` implements these methods in
2143order to allow the addition of Abstract Base Classes (ABCs) as "virtual base
Benjamin Petersond7c3ed52010-06-27 22:32:30 +00002144classes" to any class or type (including built-in types), including other
Georg Brandl8569e582010-05-19 20:57:08 +00002145ABCs.
2146
2147.. method:: class.__instancecheck__(self, instance)
2148
2149 Return true if *instance* should be considered a (direct or indirect)
2150 instance of *class*. If defined, called to implement ``isinstance(instance,
2151 class)``.
2152
2153
2154.. method:: class.__subclasscheck__(self, subclass)
2155
2156 Return true if *subclass* should be considered a (direct or indirect)
2157 subclass of *class*. If defined, called to implement ``issubclass(subclass,
2158 class)``.
2159
2160
2161Note that these methods are looked up on the type (metaclass) of a class. They
2162cannot be defined as class methods in the actual class. This is consistent with
Benjamin Petersond7c3ed52010-06-27 22:32:30 +00002163the lookup of special methods that are called on instances, only in this
Georg Brandl8569e582010-05-19 20:57:08 +00002164case the instance is itself a class.
2165
2166.. seealso::
2167
2168 :pep:`3119` - Introducing Abstract Base Classes
2169 Includes the specification for customizing :func:`isinstance` and
Serhiy Storchaka0d196ed2013-10-09 14:02:31 +03002170 :func:`issubclass` behavior through :meth:`~class.__instancecheck__` and
2171 :meth:`~class.__subclasscheck__`, with motivation for this functionality
2172 in the context of adding Abstract Base Classes (see the :mod:`abc`
2173 module) to the language.
Georg Brandl8569e582010-05-19 20:57:08 +00002174
2175
Ivan Levkivskyibd5f9652018-05-08 19:38:41 +01002176Emulating generic types
2177-----------------------
2178
2179One can implement the generic class syntax as specified by :pep:`484`
Jules Lasne (jlasne)1fc5bf22019-03-27 11:10:33 +01002180(for example ``List[int]``) by defining a special method:
Ivan Levkivskyibd5f9652018-05-08 19:38:41 +01002181
2182.. classmethod:: object.__class_getitem__(cls, key)
2183
2184 Return an object representing the specialization of a generic class
2185 by type arguments found in *key*.
2186
2187This method is looked up on the class object itself, and when defined in
2188the class body, this method is implicitly a class method. Note, this
2189mechanism is primarily reserved for use with static type hints, other usage
2190is discouraged.
2191
2192.. seealso::
2193
2194 :pep:`560` - Core support for typing module and generic types
2195
2196
Georg Brandl116aa622007-08-15 14:28:22 +00002197.. _callable-types:
2198
2199Emulating callable objects
2200--------------------------
2201
2202
2203.. method:: object.__call__(self[, args...])
2204
2205 .. index:: pair: call; instance
2206
2207 Called when the instance is "called" as a function; if this method is defined,
Andre Delfino95f710c2020-10-27 13:18:57 -03002208 ``x(arg1, arg2, ...)`` roughly translates to ``type(x).__call__(x, arg1, ...)``.
Georg Brandl116aa622007-08-15 14:28:22 +00002209
2210
2211.. _sequence-types:
2212
2213Emulating container types
2214-------------------------
2215
2216The following methods can be defined to implement container objects. Containers
2217usually are sequences (such as lists or tuples) or mappings (like dictionaries),
2218but can represent other containers as well. The first set of methods is used
2219either to emulate a sequence or to emulate a mapping; the difference is that for
2220a sequence, the allowable keys should be the integers *k* for which ``0 <= k <
2221N`` where *N* is the length of the sequence, or slice objects, which define a
Georg Brandlcb8ecb12007-09-04 06:35:14 +00002222range of items. It is also recommended that mappings provide the methods
Georg Brandlc7723722008-05-26 17:47:11 +00002223:meth:`keys`, :meth:`values`, :meth:`items`, :meth:`get`, :meth:`clear`,
Serhiy Storchaka0d196ed2013-10-09 14:02:31 +03002224:meth:`setdefault`, :meth:`pop`, :meth:`popitem`, :meth:`!copy`, and
Georg Brandlcb8ecb12007-09-04 06:35:14 +00002225:meth:`update` behaving similar to those for Python's standard dictionary
Serhiy Storchaka2e576f52017-04-24 09:05:00 +03002226objects. The :mod:`collections.abc` module provides a
Serhiy Storchaka0d196ed2013-10-09 14:02:31 +03002227:class:`~collections.abc.MutableMapping`
Georg Brandlc7723722008-05-26 17:47:11 +00002228abstract base class to help create those methods from a base set of
2229:meth:`__getitem__`, :meth:`__setitem__`, :meth:`__delitem__`, and :meth:`keys`.
2230Mutable sequences should provide methods :meth:`append`, :meth:`count`,
2231:meth:`index`, :meth:`extend`, :meth:`insert`, :meth:`pop`, :meth:`remove`,
2232:meth:`reverse` and :meth:`sort`, like Python standard list objects. Finally,
2233sequence types should implement addition (meaning concatenation) and
2234multiplication (meaning repetition) by defining the methods :meth:`__add__`,
2235:meth:`__radd__`, :meth:`__iadd__`, :meth:`__mul__`, :meth:`__rmul__` and
2236:meth:`__imul__` described below; they should not define other numerical
2237operators. It is recommended that both mappings and sequences implement the
2238:meth:`__contains__` method to allow efficient use of the ``in`` operator; for
2239mappings, ``in`` should search the mapping's keys; for sequences, it should
2240search through the values. It is further recommended that both mappings and
2241sequences implement the :meth:`__iter__` method to allow efficient iteration
alclarks4544e782019-11-17 22:00:43 +00002242through the container; for mappings, :meth:`__iter__` should iterate
2243through the object's keys; for sequences, it should iterate through the values.
Georg Brandl116aa622007-08-15 14:28:22 +00002244
2245.. method:: object.__len__(self)
2246
2247 .. index::
2248 builtin: len
2249 single: __bool__() (object method)
2250
2251 Called to implement the built-in function :func:`len`. Should return the length
2252 of the object, an integer ``>=`` 0. Also, an object that doesn't define a
2253 :meth:`__bool__` method and whose :meth:`__len__` method returns zero is
2254 considered to be false in a Boolean context.
2255
Serhiy Storchaka85157cd2017-04-23 08:37:58 +03002256 .. impl-detail::
2257
2258 In CPython, the length is required to be at most :attr:`sys.maxsize`.
2259 If the length is larger than :attr:`!sys.maxsize` some features (such as
2260 :func:`len`) may raise :exc:`OverflowError`. To prevent raising
2261 :exc:`!OverflowError` by truth value testing, an object must define a
2262 :meth:`__bool__` method.
2263
Georg Brandl116aa622007-08-15 14:28:22 +00002264
Armin Ronacher74b38b12012-10-07 10:29:32 +02002265.. method:: object.__length_hint__(self)
2266
Ezio Melottie12dc282012-10-07 12:09:36 +03002267 Called to implement :func:`operator.length_hint`. Should return an estimated
Armin Ronacher74b38b12012-10-07 10:29:32 +02002268 length for the object (which may be greater or less than the actual length).
Jeroen Demeyer009ef292019-09-10 16:01:13 +02002269 The length must be an integer ``>=`` 0. The return value may also be
Steve Dowera39a4c72019-09-10 15:25:12 +01002270 :const:`NotImplemented`, which is treated the same as if the
2271 ``__length_hint__`` method didn't exist at all. This method is purely an
2272 optimization and is never required for correctness.
Armin Ronacher74b38b12012-10-07 10:29:32 +02002273
2274 .. versionadded:: 3.4
2275
Serhiy Storchaka85157cd2017-04-23 08:37:58 +03002276
Andre Delfino1ce853f2018-12-05 16:42:44 -03002277.. index:: object: slice
2278
Georg Brandlcb8ecb12007-09-04 06:35:14 +00002279.. note::
2280
2281 Slicing is done exclusively with the following three methods. A call like ::
2282
2283 a[1:2] = b
2284
2285 is translated to ::
2286
2287 a[slice(1, 2, None)] = b
2288
2289 and so forth. Missing slice items are always filled in with ``None``.
2290
2291
Georg Brandl116aa622007-08-15 14:28:22 +00002292.. method:: object.__getitem__(self, key)
2293
Georg Brandl116aa622007-08-15 14:28:22 +00002294 Called to implement evaluation of ``self[key]``. For sequence types, the
2295 accepted keys should be integers and slice objects. Note that the special
2296 interpretation of negative indexes (if the class wishes to emulate a sequence
2297 type) is up to the :meth:`__getitem__` method. If *key* is of an inappropriate
2298 type, :exc:`TypeError` may be raised; if of a value outside the set of indexes
2299 for the sequence (after any special interpretation of negative values),
2300 :exc:`IndexError` should be raised. For mapping types, if *key* is missing (not
2301 in the container), :exc:`KeyError` should be raised.
2302
2303 .. note::
2304
2305 :keyword:`for` loops expect that an :exc:`IndexError` will be raised for illegal
2306 indexes to allow proper detection of the end of the sequence.
2307
2308
2309.. method:: object.__setitem__(self, key, value)
2310
2311 Called to implement assignment to ``self[key]``. Same note as for
2312 :meth:`__getitem__`. This should only be implemented for mappings if the
2313 objects support changes to the values for keys, or if new keys can be added, or
2314 for sequences if elements can be replaced. The same exceptions should be raised
2315 for improper *key* values as for the :meth:`__getitem__` method.
2316
2317
2318.. method:: object.__delitem__(self, key)
2319
2320 Called to implement deletion of ``self[key]``. Same note as for
2321 :meth:`__getitem__`. This should only be implemented for mappings if the
2322 objects support removal of keys, or for sequences if elements can be removed
2323 from the sequence. The same exceptions should be raised for improper *key*
2324 values as for the :meth:`__getitem__` method.
2325
2326
Andre Delfino1ce853f2018-12-05 16:42:44 -03002327.. method:: object.__missing__(self, key)
2328
2329 Called by :class:`dict`\ .\ :meth:`__getitem__` to implement ``self[key]`` for dict subclasses
2330 when key is not in the dictionary.
2331
2332
Georg Brandl116aa622007-08-15 14:28:22 +00002333.. method:: object.__iter__(self)
2334
2335 This method is called when an iterator is required for a container. This method
2336 should return a new iterator object that can iterate over all the objects in the
R David Murrayc9f5f2d2014-12-10 09:51:01 -05002337 container. For mappings, it should iterate over the keys of the container.
Georg Brandl116aa622007-08-15 14:28:22 +00002338
2339 Iterator objects also need to implement this method; they are required to return
2340 themselves. For more information on iterator objects, see :ref:`typeiter`.
2341
Christian Heimes7f044312008-01-06 17:05:40 +00002342
2343.. method:: object.__reversed__(self)
2344
Georg Brandl22b34312009-07-26 14:54:51 +00002345 Called (if present) by the :func:`reversed` built-in to implement
Christian Heimes7f044312008-01-06 17:05:40 +00002346 reverse iteration. It should return a new iterator object that iterates
2347 over all the objects in the container in reverse order.
2348
Georg Brandl8a1e4c42009-05-25 21:13:36 +00002349 If the :meth:`__reversed__` method is not provided, the :func:`reversed`
Georg Brandl22b34312009-07-26 14:54:51 +00002350 built-in will fall back to using the sequence protocol (:meth:`__len__` and
Georg Brandl8a1e4c42009-05-25 21:13:36 +00002351 :meth:`__getitem__`). Objects that support the sequence protocol should
2352 only provide :meth:`__reversed__` if they can provide an implementation
2353 that is more efficient than the one provided by :func:`reversed`.
Christian Heimes7f044312008-01-06 17:05:40 +00002354
2355
Georg Brandl116aa622007-08-15 14:28:22 +00002356The membership test operators (:keyword:`in` and :keyword:`not in`) are normally
alclarks4544e782019-11-17 22:00:43 +00002357implemented as an iteration through a container. However, container objects can
Georg Brandl116aa622007-08-15 14:28:22 +00002358supply the following special method with a more efficient implementation, which
alclarks4544e782019-11-17 22:00:43 +00002359also does not require the object be iterable.
Georg Brandl116aa622007-08-15 14:28:22 +00002360
Georg Brandl116aa622007-08-15 14:28:22 +00002361.. method:: object.__contains__(self, item)
2362
Georg Brandl495f7b52009-10-27 15:28:25 +00002363 Called to implement membership test operators. Should return true if *item*
2364 is in *self*, false otherwise. For mapping objects, this should consider the
2365 keys of the mapping rather than the values or the key-item pairs.
2366
2367 For objects that don't define :meth:`__contains__`, the membership test first
2368 tries iteration via :meth:`__iter__`, then the old sequence iteration
2369 protocol via :meth:`__getitem__`, see :ref:`this section in the language
2370 reference <membership-test-details>`.
Georg Brandl116aa622007-08-15 14:28:22 +00002371
2372
Georg Brandl116aa622007-08-15 14:28:22 +00002373.. _numeric-types:
2374
2375Emulating numeric types
2376-----------------------
2377
2378The following methods can be defined to emulate numeric objects. Methods
2379corresponding to operations that are not supported by the particular kind of
2380number implemented (e.g., bitwise operations for non-integral numbers) should be
2381left undefined.
2382
2383
2384.. method:: object.__add__(self, other)
2385 object.__sub__(self, other)
2386 object.__mul__(self, other)
Benjamin Petersond51374e2014-04-09 23:55:56 -04002387 object.__matmul__(self, other)
Georg Brandlae55dc02008-09-06 17:43:49 +00002388 object.__truediv__(self, other)
Georg Brandl116aa622007-08-15 14:28:22 +00002389 object.__floordiv__(self, other)
2390 object.__mod__(self, other)
2391 object.__divmod__(self, other)
2392 object.__pow__(self, other[, modulo])
2393 object.__lshift__(self, other)
2394 object.__rshift__(self, other)
2395 object.__and__(self, other)
2396 object.__xor__(self, other)
2397 object.__or__(self, other)
2398
2399 .. index::
2400 builtin: divmod
2401 builtin: pow
2402 builtin: pow
2403
Benjamin Petersond51374e2014-04-09 23:55:56 -04002404 These methods are called to implement the binary arithmetic operations
2405 (``+``, ``-``, ``*``, ``@``, ``/``, ``//``, ``%``, :func:`divmod`,
2406 :func:`pow`, ``**``, ``<<``, ``>>``, ``&``, ``^``, ``|``). For instance, to
2407 evaluate the expression ``x + y``, where *x* is an instance of a class that
2408 has an :meth:`__add__` method, ``x.__add__(y)`` is called. The
2409 :meth:`__divmod__` method should be the equivalent to using
2410 :meth:`__floordiv__` and :meth:`__mod__`; it should not be related to
2411 :meth:`__truediv__`. Note that :meth:`__pow__` should be defined to accept
2412 an optional third argument if the ternary version of the built-in :func:`pow`
2413 function is to be supported.
Georg Brandl116aa622007-08-15 14:28:22 +00002414
2415 If one of those methods does not support the operation with the supplied
2416 arguments, it should return ``NotImplemented``.
2417
2418
Georg Brandl116aa622007-08-15 14:28:22 +00002419.. method:: object.__radd__(self, other)
2420 object.__rsub__(self, other)
2421 object.__rmul__(self, other)
Benjamin Petersond51374e2014-04-09 23:55:56 -04002422 object.__rmatmul__(self, other)
Georg Brandl116aa622007-08-15 14:28:22 +00002423 object.__rtruediv__(self, other)
2424 object.__rfloordiv__(self, other)
2425 object.__rmod__(self, other)
2426 object.__rdivmod__(self, other)
HongWeipengabc0c4f2020-01-05 16:20:29 -06002427 object.__rpow__(self, other[, modulo])
Georg Brandl116aa622007-08-15 14:28:22 +00002428 object.__rlshift__(self, other)
2429 object.__rrshift__(self, other)
2430 object.__rand__(self, other)
2431 object.__rxor__(self, other)
2432 object.__ror__(self, other)
2433
2434 .. index::
2435 builtin: divmod
2436 builtin: pow
2437
Benjamin Petersond51374e2014-04-09 23:55:56 -04002438 These methods are called to implement the binary arithmetic operations
2439 (``+``, ``-``, ``*``, ``@``, ``/``, ``//``, ``%``, :func:`divmod`,
2440 :func:`pow`, ``**``, ``<<``, ``>>``, ``&``, ``^``, ``|``) with reflected
2441 (swapped) operands. These functions are only called if the left operand does
Guido van Rossum97c1adf2016-08-18 09:22:23 -07002442 not support the corresponding operation [#]_ and the operands are of different
Benjamin Petersond51374e2014-04-09 23:55:56 -04002443 types. [#]_ For instance, to evaluate the expression ``x - y``, where *y* is
2444 an instance of a class that has an :meth:`__rsub__` method, ``y.__rsub__(x)``
2445 is called if ``x.__sub__(y)`` returns *NotImplemented*.
Georg Brandl116aa622007-08-15 14:28:22 +00002446
2447 .. index:: builtin: pow
2448
2449 Note that ternary :func:`pow` will not try calling :meth:`__rpow__` (the
2450 coercion rules would become too complicated).
2451
2452 .. note::
2453
Brett Cannond02d8242020-10-05 09:42:21 -07002454 If the right operand's type is a subclass of the left operand's type and
2455 that subclass provides a different implementation of the reflected method
2456 for the operation, this method will be called before the left operand's
2457 non-reflected method. This behavior allows subclasses to override their
2458 ancestors' operations.
Georg Brandl116aa622007-08-15 14:28:22 +00002459
2460
2461.. method:: object.__iadd__(self, other)
2462 object.__isub__(self, other)
2463 object.__imul__(self, other)
Benjamin Petersond51374e2014-04-09 23:55:56 -04002464 object.__imatmul__(self, other)
Georg Brandl116aa622007-08-15 14:28:22 +00002465 object.__itruediv__(self, other)
2466 object.__ifloordiv__(self, other)
2467 object.__imod__(self, other)
2468 object.__ipow__(self, other[, modulo])
2469 object.__ilshift__(self, other)
2470 object.__irshift__(self, other)
2471 object.__iand__(self, other)
2472 object.__ixor__(self, other)
2473 object.__ior__(self, other)
2474
Benjamin Petersonb58dda72009-01-18 22:27:04 +00002475 These methods are called to implement the augmented arithmetic assignments
Benjamin Petersond51374e2014-04-09 23:55:56 -04002476 (``+=``, ``-=``, ``*=``, ``@=``, ``/=``, ``//=``, ``%=``, ``**=``, ``<<=``,
2477 ``>>=``, ``&=``, ``^=``, ``|=``). These methods should attempt to do the
2478 operation in-place (modifying *self*) and return the result (which could be,
2479 but does not have to be, *self*). If a specific method is not defined, the
2480 augmented assignment falls back to the normal methods. For instance, if *x*
2481 is an instance of a class with an :meth:`__iadd__` method, ``x += y`` is
2482 equivalent to ``x = x.__iadd__(y)`` . Otherwise, ``x.__add__(y)`` and
2483 ``y.__radd__(x)`` are considered, as with the evaluation of ``x + y``. In
2484 certain situations, augmented assignment can result in unexpected errors (see
2485 :ref:`faq-augmented-assignment-tuple-error`), but this behavior is in fact
2486 part of the data model.
Georg Brandl116aa622007-08-15 14:28:22 +00002487
2488
2489.. method:: object.__neg__(self)
2490 object.__pos__(self)
2491 object.__abs__(self)
2492 object.__invert__(self)
2493
2494 .. index:: builtin: abs
2495
2496 Called to implement the unary arithmetic operations (``-``, ``+``, :func:`abs`
2497 and ``~``).
2498
2499
2500.. method:: object.__complex__(self)
2501 object.__int__(self)
Georg Brandl116aa622007-08-15 14:28:22 +00002502 object.__float__(self)
2503
2504 .. index::
2505 builtin: complex
2506 builtin: int
Georg Brandl116aa622007-08-15 14:28:22 +00002507 builtin: float
2508
Mark Summerfield9557f602008-07-01 14:42:30 +00002509 Called to implement the built-in functions :func:`complex`,
Serhiy Storchaka496431f2018-03-10 17:18:32 +02002510 :func:`int` and :func:`float`. Should return a value
Mark Summerfield9557f602008-07-01 14:42:30 +00002511 of the appropriate type.
Georg Brandl116aa622007-08-15 14:28:22 +00002512
2513
2514.. method:: object.__index__(self)
2515
Ethan Furmandf3ed242014-01-05 06:50:30 -08002516 Called to implement :func:`operator.index`, and whenever Python needs to
2517 losslessly convert the numeric object to an integer object (such as in
2518 slicing, or in the built-in :func:`bin`, :func:`hex` and :func:`oct`
2519 functions). Presence of this method indicates that the numeric object is
2520 an integer type. Must return an integer.
2521
Serhiy Storchakabdbad712019-06-02 00:05:48 +03002522 If :meth:`__int__`, :meth:`__float__` and :meth:`__complex__` are not
2523 defined then corresponding built-in functions :func:`int`, :func:`float`
2524 and :func:`complex` fall back to :meth:`__index__`.
Georg Brandl116aa622007-08-15 14:28:22 +00002525
Georg Brandl116aa622007-08-15 14:28:22 +00002526
Serhiy Storchaka496431f2018-03-10 17:18:32 +02002527.. method:: object.__round__(self, [,ndigits])
2528 object.__trunc__(self)
2529 object.__floor__(self)
2530 object.__ceil__(self)
2531
2532 .. index:: builtin: round
2533
2534 Called to implement the built-in function :func:`round` and :mod:`math`
2535 functions :func:`~math.trunc`, :func:`~math.floor` and :func:`~math.ceil`.
2536 Unless *ndigits* is passed to :meth:`!__round__` all these methods should
2537 return the value of the object truncated to an :class:`~numbers.Integral`
2538 (typically an :class:`int`).
2539
2540 If :meth:`__int__` is not defined then the built-in function :func:`int`
2541 falls back to :meth:`__trunc__`.
2542
2543
Georg Brandl116aa622007-08-15 14:28:22 +00002544.. _context-managers:
2545
2546With Statement Context Managers
2547-------------------------------
2548
Georg Brandl116aa622007-08-15 14:28:22 +00002549A :dfn:`context manager` is an object that defines the runtime context to be
2550established when executing a :keyword:`with` statement. The context manager
2551handles the entry into, and the exit from, the desired runtime context for the
2552execution of the block of code. Context managers are normally invoked using the
Serhiy Storchaka2b57c432018-12-19 08:09:46 +02002553:keyword:`!with` statement (described in section :ref:`with`), but can also be
Georg Brandl116aa622007-08-15 14:28:22 +00002554used by directly invoking their methods.
2555
2556.. index::
2557 statement: with
2558 single: context manager
2559
2560Typical uses of context managers include saving and restoring various kinds of
2561global state, locking and unlocking resources, closing opened files, etc.
2562
2563For more information on context managers, see :ref:`typecontextmanager`.
2564
2565
2566.. method:: object.__enter__(self)
2567
2568 Enter the runtime context related to this object. The :keyword:`with` statement
2569 will bind this method's return value to the target(s) specified in the
Serhiy Storchaka2b57c432018-12-19 08:09:46 +02002570 :keyword:`!as` clause of the statement, if any.
Georg Brandl116aa622007-08-15 14:28:22 +00002571
2572
2573.. method:: object.__exit__(self, exc_type, exc_value, traceback)
2574
2575 Exit the runtime context related to this object. The parameters describe the
2576 exception that caused the context to be exited. If the context was exited
2577 without an exception, all three arguments will be :const:`None`.
2578
2579 If an exception is supplied, and the method wishes to suppress the exception
2580 (i.e., prevent it from being propagated), it should return a true value.
2581 Otherwise, the exception will be processed normally upon exit from this method.
2582
2583 Note that :meth:`__exit__` methods should not reraise the passed-in exception;
2584 this is the caller's responsibility.
2585
2586
2587.. seealso::
2588
Serhiy Storchakae4ba8722016-03-31 15:30:54 +03002589 :pep:`343` - The "with" statement
Georg Brandl116aa622007-08-15 14:28:22 +00002590 The specification, background, and examples for the Python :keyword:`with`
2591 statement.
2592
Nick Coghlan3a5d7e32008-08-31 12:40:14 +00002593
Daniel F Moisseta22bca62021-03-01 04:08:38 +00002594.. _class-pattern-matching:
2595
2596Customizing positional arguments in class pattern matching
2597----------------------------------------------------------
2598
2599When using a class name in a pattern, positional arguments in the pattern are not
2600allowed by default, i.e. ``case MyClass(x, y)`` is typically invalid without special
2601support in ``MyClass``. To be able to use that kind of patterns, the class needs to
2602define a *__match_args__* attribute.
2603
2604.. data:: object.__match_args__
2605
Ken Jin5143fd12021-04-07 00:03:00 +08002606 This class variable can be assigned a tuple of strings. When this class is
Daniel F Moisseta22bca62021-03-01 04:08:38 +00002607 used in a class pattern with positional arguments, each positional argument will
2608 be converted into a keyword argument, using the corresponding value in
2609 *__match_args__* as the keyword. The absence of this attribute is equivalent to
2610 setting it to ``()``.
2611
2612For example, if ``MyClass.__match_args__`` is ``("left", "center", "right")`` that means
2613that ``case MyClass(x, y)`` is equivalent to ``case MyClass(left=x, center=y)``. Note
2614that the number of arguments in the pattern must be smaller than or equal to the number
2615of elements in *__match_args__*; if it is larger, the pattern match attempt will raise
2616a :exc:`TypeError`.
2617
2618.. versionadded:: 3.10
2619
2620.. seealso::
2621
2622 :pep:`634` - Structural Pattern Matching
2623 The specification for the Python ``match`` statement.
2624
2625
Nick Coghlan3a5d7e32008-08-31 12:40:14 +00002626.. _special-lookup:
2627
2628Special method lookup
2629---------------------
2630
2631For custom classes, implicit invocations of special methods are only guaranteed
2632to work correctly if defined on an object's type, not in the object's instance
2633dictionary. That behaviour is the reason why the following code raises an
2634exception::
2635
Éric Araujo28053fb2010-11-22 03:09:19 +00002636 >>> class C:
Nick Coghlan3a5d7e32008-08-31 12:40:14 +00002637 ... pass
2638 ...
2639 >>> c = C()
2640 >>> c.__len__ = lambda: 5
2641 >>> len(c)
2642 Traceback (most recent call last):
2643 File "<stdin>", line 1, in <module>
2644 TypeError: object of type 'C' has no len()
2645
2646The rationale behind this behaviour lies with a number of special methods such
2647as :meth:`__hash__` and :meth:`__repr__` that are implemented by all objects,
2648including type objects. If the implicit lookup of these methods used the
2649conventional lookup process, they would fail when invoked on the type object
2650itself::
2651
2652 >>> 1 .__hash__() == hash(1)
2653 True
2654 >>> int.__hash__() == hash(int)
2655 Traceback (most recent call last):
2656 File "<stdin>", line 1, in <module>
2657 TypeError: descriptor '__hash__' of 'int' object needs an argument
2658
2659Incorrectly attempting to invoke an unbound method of a class in this way is
2660sometimes referred to as 'metaclass confusion', and is avoided by bypassing
2661the instance when looking up special methods::
2662
2663 >>> type(1).__hash__(1) == hash(1)
2664 True
2665 >>> type(int).__hash__(int) == hash(int)
2666 True
2667
2668In addition to bypassing any instance attributes in the interest of
Georg Brandlaf265f42008-12-07 15:06:20 +00002669correctness, implicit special method lookup generally also bypasses the
Nick Coghlan3a5d7e32008-08-31 12:40:14 +00002670:meth:`__getattribute__` method even of the object's metaclass::
2671
2672 >>> class Meta(type):
Berker Peksag770319d2015-04-11 14:59:30 +03002673 ... def __getattribute__(*args):
2674 ... print("Metaclass getattribute invoked")
2675 ... return type.__getattribute__(*args)
Nick Coghlan3a5d7e32008-08-31 12:40:14 +00002676 ...
Benjamin Petersone348d1a2008-10-19 21:29:05 +00002677 >>> class C(object, metaclass=Meta):
Nick Coghlan3a5d7e32008-08-31 12:40:14 +00002678 ... def __len__(self):
2679 ... return 10
2680 ... def __getattribute__(*args):
Benjamin Peterson64106fb2008-10-29 20:35:35 +00002681 ... print("Class getattribute invoked")
Nick Coghlan3a5d7e32008-08-31 12:40:14 +00002682 ... return object.__getattribute__(*args)
2683 ...
2684 >>> c = C()
2685 >>> c.__len__() # Explicit lookup via instance
2686 Class getattribute invoked
2687 10
2688 >>> type(c).__len__(c) # Explicit lookup via type
2689 Metaclass getattribute invoked
2690 10
2691 >>> len(c) # Implicit lookup
2692 10
2693
2694Bypassing the :meth:`__getattribute__` machinery in this fashion
2695provides significant scope for speed optimisations within the
2696interpreter, at the cost of some flexibility in the handling of
2697special methods (the special method *must* be set on the class
2698object itself in order to be consistently invoked by the interpreter).
2699
2700
Yury Selivanov66f88282015-06-24 11:04:15 -04002701.. index::
2702 single: coroutine
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002703
2704Coroutines
2705==========
2706
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002707
2708Awaitable Objects
2709-----------------
2710
Yury Selivanov66f88282015-06-24 11:04:15 -04002711An :term:`awaitable` object generally implements an :meth:`__await__` method.
Victor Stinnerbb0b0852020-08-14 12:20:05 +02002712:term:`Coroutine objects <coroutine>` returned from :keyword:`async def` functions
Yury Selivanov66f88282015-06-24 11:04:15 -04002713are awaitable.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002714
Yury Selivanov66f88282015-06-24 11:04:15 -04002715.. note::
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002716
Yury Selivanov66f88282015-06-24 11:04:15 -04002717 The :term:`generator iterator` objects returned from generators
2718 decorated with :func:`types.coroutine` or :func:`asyncio.coroutine`
2719 are also awaitable, but they do not implement :meth:`__await__`.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002720
2721.. method:: object.__await__(self)
2722
2723 Must return an :term:`iterator`. Should be used to implement
2724 :term:`awaitable` objects. For instance, :class:`asyncio.Future` implements
2725 this method to be compatible with the :keyword:`await` expression.
2726
2727.. versionadded:: 3.5
2728
2729.. seealso:: :pep:`492` for additional information about awaitable objects.
2730
2731
Yury Selivanov66f88282015-06-24 11:04:15 -04002732.. _coroutine-objects:
2733
2734Coroutine Objects
2735-----------------
2736
Victor Stinnerbb0b0852020-08-14 12:20:05 +02002737:term:`Coroutine objects <coroutine>` are :term:`awaitable` objects.
Yury Selivanov66f88282015-06-24 11:04:15 -04002738A coroutine's execution can be controlled by calling :meth:`__await__` and
2739iterating over the result. When the coroutine has finished executing and
2740returns, the iterator raises :exc:`StopIteration`, and the exception's
2741:attr:`~StopIteration.value` attribute holds the return value. If the
2742coroutine raises an exception, it is propagated by the iterator. Coroutines
2743should not directly raise unhandled :exc:`StopIteration` exceptions.
2744
2745Coroutines also have the methods listed below, which are analogous to
2746those of generators (see :ref:`generator-methods`). However, unlike
2747generators, coroutines do not directly support iteration.
2748
Yury Selivanov77c96812016-02-13 17:59:05 -05002749.. versionchanged:: 3.5.2
2750 It is a :exc:`RuntimeError` to await on a coroutine more than once.
2751
2752
Yury Selivanov66f88282015-06-24 11:04:15 -04002753.. method:: coroutine.send(value)
2754
2755 Starts or resumes execution of the coroutine. If *value* is ``None``,
2756 this is equivalent to advancing the iterator returned by
2757 :meth:`__await__`. If *value* is not ``None``, this method delegates
2758 to the :meth:`~generator.send` method of the iterator that caused
2759 the coroutine to suspend. The result (return value,
2760 :exc:`StopIteration`, or other exception) is the same as when
2761 iterating over the :meth:`__await__` return value, described above.
2762
2763.. method:: coroutine.throw(type[, value[, traceback]])
2764
2765 Raises the specified exception in the coroutine. This method delegates
2766 to the :meth:`~generator.throw` method of the iterator that caused
2767 the coroutine to suspend, if it has such a method. Otherwise,
2768 the exception is raised at the suspension point. The result
2769 (return value, :exc:`StopIteration`, or other exception) is the same as
2770 when iterating over the :meth:`__await__` return value, described
2771 above. If the exception is not caught in the coroutine, it propagates
2772 back to the caller.
2773
2774.. method:: coroutine.close()
2775
2776 Causes the coroutine to clean itself up and exit. If the coroutine
2777 is suspended, this method first delegates to the :meth:`~generator.close`
2778 method of the iterator that caused the coroutine to suspend, if it
2779 has such a method. Then it raises :exc:`GeneratorExit` at the
2780 suspension point, causing the coroutine to immediately clean itself up.
2781 Finally, the coroutine is marked as having finished executing, even if
2782 it was never started.
2783
2784 Coroutine objects are automatically closed using the above process when
2785 they are about to be destroyed.
2786
Yury Selivanova6f6edb2016-06-09 15:08:31 -04002787.. _async-iterators:
Yury Selivanov66f88282015-06-24 11:04:15 -04002788
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002789Asynchronous Iterators
2790----------------------
2791
Yury Selivanovfaa135a2017-10-06 02:08:57 -04002792An *asynchronous iterator* can call asynchronous code in
2793its ``__anext__`` method.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002794
Martin Panterd2ad5712015-11-02 04:20:33 +00002795Asynchronous iterators can be used in an :keyword:`async for` statement.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002796
2797.. method:: object.__aiter__(self)
2798
Yury Selivanova6f6edb2016-06-09 15:08:31 -04002799 Must return an *asynchronous iterator* object.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002800
2801.. method:: object.__anext__(self)
2802
2803 Must return an *awaitable* resulting in a next value of the iterator. Should
2804 raise a :exc:`StopAsyncIteration` error when the iteration is over.
2805
2806An example of an asynchronous iterable object::
2807
2808 class Reader:
2809 async def readline(self):
2810 ...
2811
Yury Selivanova6f6edb2016-06-09 15:08:31 -04002812 def __aiter__(self):
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002813 return self
2814
2815 async def __anext__(self):
2816 val = await self.readline()
2817 if val == b'':
2818 raise StopAsyncIteration
2819 return val
2820
2821.. versionadded:: 3.5
2822
Yury Selivanovfaa135a2017-10-06 02:08:57 -04002823.. versionchanged:: 3.7
2824 Prior to Python 3.7, ``__aiter__`` could return an *awaitable*
2825 that would resolve to an
2826 :term:`asynchronous iterator <asynchronous iterator>`.
Yury Selivanova6f6edb2016-06-09 15:08:31 -04002827
Yury Selivanovfaa135a2017-10-06 02:08:57 -04002828 Starting with Python 3.7, ``__aiter__`` must return an
2829 asynchronous iterator object. Returning anything else
2830 will result in a :exc:`TypeError` error.
Yury Selivanova6f6edb2016-06-09 15:08:31 -04002831
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002832
Jelle Zijlstra2e624692017-04-30 18:25:58 -07002833.. _async-context-managers:
2834
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002835Asynchronous Context Managers
2836-----------------------------
2837
2838An *asynchronous context manager* is a *context manager* that is able to
2839suspend execution in its ``__aenter__`` and ``__aexit__`` methods.
2840
Martin Panterd2ad5712015-11-02 04:20:33 +00002841Asynchronous context managers can be used in an :keyword:`async with` statement.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002842
2843.. method:: object.__aenter__(self)
2844
Andre Delfinoa8a79ca2019-05-03 12:08:10 -03002845 Semantically similar to :meth:`__enter__`, the only
2846 difference being that it must return an *awaitable*.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002847
2848.. method:: object.__aexit__(self, exc_type, exc_value, traceback)
2849
Andre Delfinoa8a79ca2019-05-03 12:08:10 -03002850 Semantically similar to :meth:`__exit__`, the only
2851 difference being that it must return an *awaitable*.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04002852
2853An example of an asynchronous context manager class::
2854
2855 class AsyncContextManager:
2856 async def __aenter__(self):
2857 await log('entering context')
2858
2859 async def __aexit__(self, exc_type, exc, tb):
2860 await log('exiting context')
2861
2862.. versionadded:: 3.5
2863
2864
Georg Brandl116aa622007-08-15 14:28:22 +00002865.. rubric:: Footnotes
2866
Nick Coghlan3a5d7e32008-08-31 12:40:14 +00002867.. [#] It *is* possible in some cases to change an object's type, under certain
2868 controlled conditions. It generally isn't a good idea though, since it can
2869 lead to some very strange behaviour if it is handled incorrectly.
2870
Guido van Rossum97c1adf2016-08-18 09:22:23 -07002871.. [#] The :meth:`__hash__`, :meth:`__iter__`, :meth:`__reversed__`, and
2872 :meth:`__contains__` methods have special handling for this; others
2873 will still raise a :exc:`TypeError`, but may do so by relying on
2874 the behavior that ``None`` is not callable.
2875
2876.. [#] "Does not support" here means that the class has no such method, or
2877 the method returns ``NotImplemented``. Do not set the method to
2878 ``None`` if you want to force fallback to the right operand's reflected
Martin Panter28540182016-11-21 04:10:45 +00002879 method—that will instead have the opposite effect of explicitly
Guido van Rossum97c1adf2016-08-18 09:22:23 -07002880 *blocking* such fallback.
2881
Brett Cannond02d8242020-10-05 09:42:21 -07002882.. [#] For operands of the same type, it is assumed that if the non-reflected
2883 method -- such as :meth:`__add__` -- fails then the overall operation is not
2884 supported, which is why the reflected method is not called.