blob: 6e9e07a809b93ef2e7c59ae36d4ec532453c1c6b [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001
2.. _expressions:
3
4***********
5Expressions
6***********
7
Georg Brandl4b491312007-08-31 09:22:56 +00008.. index:: expression, BNF
Georg Brandl116aa622007-08-15 14:28:22 +00009
Brett Cannon7603fa02011-01-06 23:08:16 +000010This chapter explains the meaning of the elements of expressions in Python.
Georg Brandl116aa622007-08-15 14:28:22 +000011
Georg Brandl116aa622007-08-15 14:28:22 +000012**Syntax Notes:** In this and the following chapters, extended BNF notation will
13be used to describe syntax, not lexical analysis. When (one alternative of) a
14syntax rule has the form
15
16.. productionlist:: *
17 name: `othername`
18
Georg Brandl116aa622007-08-15 14:28:22 +000019and no semantics are given, the semantics of this form of ``name`` are the same
20as for ``othername``.
21
22
23.. _conversions:
24
25Arithmetic conversions
26======================
27
28.. index:: pair: arithmetic; conversion
29
Georg Brandl116aa622007-08-15 14:28:22 +000030When a description of an arithmetic operator below uses the phrase "the numeric
Georg Brandl96593ed2007-09-07 14:15:41 +000031arguments are converted to a common type," this means that the operator
Raymond Hettingeraa7886d2014-05-26 22:20:37 -070032implementation for built-in types works as follows:
Georg Brandl116aa622007-08-15 14:28:22 +000033
34* If either argument is a complex number, the other is converted to complex;
35
36* otherwise, if either argument is a floating point number, the other is
37 converted to floating point;
38
Georg Brandl96593ed2007-09-07 14:15:41 +000039* otherwise, both must be integers and no conversion is necessary.
Georg Brandl116aa622007-08-15 14:28:22 +000040
Raymond Hettingeraa7886d2014-05-26 22:20:37 -070041Some additional rules apply for certain operators (e.g., a string as a left
42argument to the '%' operator). Extensions must define their own conversion
43behavior.
Georg Brandl116aa622007-08-15 14:28:22 +000044
45
46.. _atoms:
47
48Atoms
49=====
50
Georg Brandl96593ed2007-09-07 14:15:41 +000051.. index:: atom
Georg Brandl116aa622007-08-15 14:28:22 +000052
53Atoms are the most basic elements of expressions. The simplest atoms are
Georg Brandl96593ed2007-09-07 14:15:41 +000054identifiers or literals. Forms enclosed in parentheses, brackets or braces are
55also categorized syntactically as atoms. The syntax for atoms is:
Georg Brandl116aa622007-08-15 14:28:22 +000056
57.. productionlist::
58 atom: `identifier` | `literal` | `enclosure`
Georg Brandl96593ed2007-09-07 14:15:41 +000059 enclosure: `parenth_form` | `list_display` | `dict_display` | `set_display`
60 : | `generator_expression` | `yield_atom`
Georg Brandl116aa622007-08-15 14:28:22 +000061
62
63.. _atom-identifiers:
64
65Identifiers (Names)
66-------------------
67
Georg Brandl96593ed2007-09-07 14:15:41 +000068.. index:: name, identifier
Georg Brandl116aa622007-08-15 14:28:22 +000069
70An identifier occurring as an atom is a name. See section :ref:`identifiers`
71for lexical definition and section :ref:`naming` for documentation of naming and
72binding.
73
74.. index:: exception: NameError
75
76When the name is bound to an object, evaluation of the atom yields that object.
77When a name is not bound, an attempt to evaluate it raises a :exc:`NameError`
78exception.
79
80.. index::
81 pair: name; mangling
82 pair: private; names
83
84**Private name mangling:** When an identifier that textually occurs in a class
85definition begins with two or more underscore characters and does not end in two
86or more underscores, it is considered a :dfn:`private name` of that class.
87Private names are transformed to a longer form before code is generated for
Georg Brandldec3b3f2013-04-14 10:13:42 +020088them. The transformation inserts the class name, with leading underscores
89removed and a single underscore inserted, in front of the name. For example,
90the identifier ``__spam`` occurring in a class named ``Ham`` will be transformed
91to ``_Ham__spam``. This transformation is independent of the syntactical
92context in which the identifier is used. If the transformed name is extremely
93long (longer than 255 characters), implementation defined truncation may happen.
94If the class name consists only of underscores, no transformation is done.
Georg Brandl116aa622007-08-15 14:28:22 +000095
Georg Brandl116aa622007-08-15 14:28:22 +000096
97.. _atom-literals:
98
99Literals
100--------
101
102.. index:: single: literal
103
Georg Brandl96593ed2007-09-07 14:15:41 +0000104Python supports string and bytes literals and various numeric literals:
Georg Brandl116aa622007-08-15 14:28:22 +0000105
106.. productionlist::
Georg Brandl96593ed2007-09-07 14:15:41 +0000107 literal: `stringliteral` | `bytesliteral`
108 : | `integer` | `floatnumber` | `imagnumber`
Georg Brandl116aa622007-08-15 14:28:22 +0000109
Georg Brandl96593ed2007-09-07 14:15:41 +0000110Evaluation of a literal yields an object of the given type (string, bytes,
111integer, floating point number, complex number) with the given value. The value
112may be approximated in the case of floating point and imaginary (complex)
Georg Brandl116aa622007-08-15 14:28:22 +0000113literals. See section :ref:`literals` for details.
114
115.. index::
116 triple: immutable; data; type
117 pair: immutable; object
118
Terry Jan Reedyead1de22012-02-17 19:56:58 -0500119All literals correspond to immutable data types, and hence the object's identity
120is less important than its value. Multiple evaluations of literals with the
121same value (either the same occurrence in the program text or a different
122occurrence) may obtain the same object or a different object with the same
123value.
Georg Brandl116aa622007-08-15 14:28:22 +0000124
125
126.. _parenthesized:
127
128Parenthesized forms
129-------------------
130
131.. index:: single: parenthesized form
132
133A parenthesized form is an optional expression list enclosed in parentheses:
134
135.. productionlist::
Martin Panter0c0da482016-06-12 01:46:50 +0000136 parenth_form: "(" [`starred_expression`] ")"
Georg Brandl116aa622007-08-15 14:28:22 +0000137
138A parenthesized expression list yields whatever that expression list yields: if
139the list contains at least one comma, it yields a tuple; otherwise, it yields
140the single expression that makes up the expression list.
141
142.. index:: pair: empty; tuple
143
144An empty pair of parentheses yields an empty tuple object. Since tuples are
145immutable, the rules for literals apply (i.e., two occurrences of the empty
146tuple may or may not yield the same object).
147
148.. index::
149 single: comma
150 pair: tuple; display
151
152Note that tuples are not formed by the parentheses, but rather by use of the
153comma operator. The exception is the empty tuple, for which parentheses *are*
154required --- allowing unparenthesized "nothing" in expressions would cause
155ambiguities and allow common typos to pass uncaught.
156
157
Georg Brandl96593ed2007-09-07 14:15:41 +0000158.. _comprehensions:
159
160Displays for lists, sets and dictionaries
161-----------------------------------------
162
163For constructing a list, a set or a dictionary Python provides special syntax
164called "displays", each of them in two flavors:
165
166* either the container contents are listed explicitly, or
167
168* they are computed via a set of looping and filtering instructions, called a
169 :dfn:`comprehension`.
170
171Common syntax elements for comprehensions are:
172
173.. productionlist::
174 comprehension: `expression` `comp_for`
Yury Selivanov03660042016-12-15 17:36:05 -0500175 comp_for: [ASYNC] "for" `target_list` "in" `or_test` [`comp_iter`]
Georg Brandl96593ed2007-09-07 14:15:41 +0000176 comp_iter: `comp_for` | `comp_if`
177 comp_if: "if" `expression_nocond` [`comp_iter`]
178
179The comprehension consists of a single expression followed by at least one
180:keyword:`for` clause and zero or more :keyword:`for` or :keyword:`if` clauses.
181In this case, the elements of the new container are those that would be produced
182by considering each of the :keyword:`for` or :keyword:`if` clauses a block,
183nesting from left to right, and evaluating the expression to produce an element
184each time the innermost block is reached.
185
Georg Brandl02c30562007-09-07 17:52:53 +0000186Note that the comprehension is executed in a separate scope, so names assigned
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700187to in the target list don't "leak" into the enclosing scope.
Georg Brandl02c30562007-09-07 17:52:53 +0000188
Yury Selivanov03660042016-12-15 17:36:05 -0500189Since Python 3.6, in an :keyword:`async def` function, an :keyword:`async for`
190clause may be used to iterate over a :term:`asynchronous iterator`.
191A comprehension in an :keyword:`async def` function may consist of either a
192:keyword:`for` or :keyword:`async for` clause following the leading
Jim Fasarakis-Hilliard132ac382017-02-24 22:32:54 +0200193expression, may contain additional :keyword:`for` or :keyword:`async for`
Yury Selivanov03660042016-12-15 17:36:05 -0500194clauses, and may also use :keyword:`await` expressions.
195If a comprehension contains either :keyword:`async for` clauses
196or :keyword:`await` expressions it is called an
197:dfn:`asynchronous comprehension`. An asynchronous comprehension may
198suspend the execution of the coroutine function in which it appears.
199See also :pep:`530`.
Georg Brandl96593ed2007-09-07 14:15:41 +0000200
Georg Brandl116aa622007-08-15 14:28:22 +0000201.. _lists:
202
203List displays
204-------------
205
206.. index::
207 pair: list; display
208 pair: list; comprehensions
Georg Brandl96593ed2007-09-07 14:15:41 +0000209 pair: empty; list
210 object: list
Georg Brandl116aa622007-08-15 14:28:22 +0000211
212A list display is a possibly empty series of expressions enclosed in square
213brackets:
214
215.. productionlist::
Martin Panter0c0da482016-06-12 01:46:50 +0000216 list_display: "[" [`starred_list` | `comprehension`] "]"
Georg Brandl116aa622007-08-15 14:28:22 +0000217
Georg Brandl96593ed2007-09-07 14:15:41 +0000218A list display yields a new list object, the contents being specified by either
219a list of expressions or a comprehension. When a comma-separated list of
220expressions is supplied, its elements are evaluated from left to right and
221placed into the list object in that order. When a comprehension is supplied,
222the list is constructed from the elements resulting from the comprehension.
Georg Brandl116aa622007-08-15 14:28:22 +0000223
224
Georg Brandl96593ed2007-09-07 14:15:41 +0000225.. _set:
Georg Brandl116aa622007-08-15 14:28:22 +0000226
Georg Brandl96593ed2007-09-07 14:15:41 +0000227Set displays
228------------
Georg Brandl116aa622007-08-15 14:28:22 +0000229
Georg Brandl96593ed2007-09-07 14:15:41 +0000230.. index:: pair: set; display
231 object: set
Georg Brandl116aa622007-08-15 14:28:22 +0000232
Georg Brandl96593ed2007-09-07 14:15:41 +0000233A set display is denoted by curly braces and distinguishable from dictionary
234displays by the lack of colons separating keys and values:
Georg Brandl116aa622007-08-15 14:28:22 +0000235
236.. productionlist::
Martin Panter0c0da482016-06-12 01:46:50 +0000237 set_display: "{" (`starred_list` | `comprehension`) "}"
Georg Brandl116aa622007-08-15 14:28:22 +0000238
Georg Brandl96593ed2007-09-07 14:15:41 +0000239A set display yields a new mutable set object, the contents being specified by
240either a sequence of expressions or a comprehension. When a comma-separated
241list of expressions is supplied, its elements are evaluated from left to right
242and added to the set object. When a comprehension is supplied, the set is
243constructed from the elements resulting from the comprehension.
Georg Brandl116aa622007-08-15 14:28:22 +0000244
Georg Brandl528cdb12008-09-21 07:09:51 +0000245An empty set cannot be constructed with ``{}``; this literal constructs an empty
246dictionary.
Christian Heimes78644762008-03-04 23:39:23 +0000247
248
Georg Brandl116aa622007-08-15 14:28:22 +0000249.. _dict:
250
251Dictionary displays
252-------------------
253
254.. index:: pair: dictionary; display
Georg Brandl96593ed2007-09-07 14:15:41 +0000255 key, datum, key/datum pair
256 object: dictionary
Georg Brandl116aa622007-08-15 14:28:22 +0000257
258A dictionary display is a possibly empty series of key/datum pairs enclosed in
259curly braces:
260
261.. productionlist::
Georg Brandl96593ed2007-09-07 14:15:41 +0000262 dict_display: "{" [`key_datum_list` | `dict_comprehension`] "}"
Georg Brandl116aa622007-08-15 14:28:22 +0000263 key_datum_list: `key_datum` ("," `key_datum`)* [","]
Martin Panter0c0da482016-06-12 01:46:50 +0000264 key_datum: `expression` ":" `expression` | "**" `or_expr`
Georg Brandl96593ed2007-09-07 14:15:41 +0000265 dict_comprehension: `expression` ":" `expression` `comp_for`
Georg Brandl116aa622007-08-15 14:28:22 +0000266
267A dictionary display yields a new dictionary object.
268
Georg Brandl96593ed2007-09-07 14:15:41 +0000269If a comma-separated sequence of key/datum pairs is given, they are evaluated
270from left to right to define the entries of the dictionary: each key object is
271used as a key into the dictionary to store the corresponding datum. This means
272that you can specify the same key multiple times in the key/datum list, and the
273final dictionary's value for that key will be the last one given.
274
Martin Panter0c0da482016-06-12 01:46:50 +0000275.. index:: unpacking; dictionary, **; in dictionary displays
276
277A double asterisk ``**`` denotes :dfn:`dictionary unpacking`.
278Its operand must be a :term:`mapping`. Each mapping item is added
279to the new dictionary. Later values replace values already set by
280earlier key/datum pairs and earlier dictionary unpackings.
281
282.. versionadded:: 3.5
283 Unpacking into dictionary displays, originally proposed by :pep:`448`.
284
Georg Brandl96593ed2007-09-07 14:15:41 +0000285A dict comprehension, in contrast to list and set comprehensions, needs two
286expressions separated with a colon followed by the usual "for" and "if" clauses.
287When the comprehension is run, the resulting key and value elements are inserted
288in the new dictionary in the order they are produced.
Georg Brandl116aa622007-08-15 14:28:22 +0000289
290.. index:: pair: immutable; object
Georg Brandl96593ed2007-09-07 14:15:41 +0000291 hashable
Georg Brandl116aa622007-08-15 14:28:22 +0000292
293Restrictions on the types of the key values are listed earlier in section
Guido van Rossum2cc30da2007-11-02 23:46:40 +0000294:ref:`types`. (To summarize, the key type should be :term:`hashable`, which excludes
Georg Brandl116aa622007-08-15 14:28:22 +0000295all mutable objects.) Clashes between duplicate keys are not detected; the last
296datum (textually rightmost in the display) stored for a given key value
297prevails.
298
299
Georg Brandl96593ed2007-09-07 14:15:41 +0000300.. _genexpr:
301
302Generator expressions
303---------------------
304
305.. index:: pair: generator; expression
306 object: generator
307
308A generator expression is a compact generator notation in parentheses:
309
310.. productionlist::
311 generator_expression: "(" `expression` `comp_for` ")"
312
313A generator expression yields a new generator object. Its syntax is the same as
314for comprehensions, except that it is enclosed in parentheses instead of
315brackets or curly braces.
316
317Variables used in the generator expression are evaluated lazily when the
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700318:meth:`~generator.__next__` method is called for the generator object (in the same
Ezio Melotti7fa82222012-10-12 13:42:08 +0300319fashion as normal generators). However, the leftmost :keyword:`for` clause is
320immediately evaluated, so that an error produced by it can be seen before any
321other possible error in the code that handles the generator expression.
322Subsequent :keyword:`for` clauses cannot be evaluated immediately since they
323may depend on the previous :keyword:`for` loop. For example: ``(x*y for x in
324range(10) for y in bar(x))``.
Georg Brandl96593ed2007-09-07 14:15:41 +0000325
326The parentheses can be omitted on calls with only one argument. See section
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700327:ref:`calls` for details.
Georg Brandl96593ed2007-09-07 14:15:41 +0000328
Yury Selivanov03660042016-12-15 17:36:05 -0500329Since Python 3.6, if the generator appears in an :keyword:`async def` function,
330then :keyword:`async for` clauses and :keyword:`await` expressions are permitted
331as with an asynchronous comprehension. If a generator expression
332contains either :keyword:`async for` clauses or :keyword:`await` expressions
333it is called an :dfn:`asynchronous generator expression`.
334An asynchronous generator expression yields a new asynchronous
335generator object, which is an asynchronous iterator
336(see :ref:`async-iterators`).
Georg Brandl96593ed2007-09-07 14:15:41 +0000337
Georg Brandl116aa622007-08-15 14:28:22 +0000338.. _yieldexpr:
339
340Yield expressions
341-----------------
342
343.. index::
344 keyword: yield
345 pair: yield; expression
346 pair: generator; function
347
348.. productionlist::
349 yield_atom: "(" `yield_expression` ")"
Nick Coghlan1f7ce622012-01-13 21:43:40 +1000350 yield_expression: "yield" [`expression_list` | "from" `expression`]
Georg Brandl116aa622007-08-15 14:28:22 +0000351
Yury Selivanov03660042016-12-15 17:36:05 -0500352The yield expression is used when defining a :term:`generator` function
353or an :term:`asynchronous generator` function and
Benjamin Petersond1c85fd2014-01-26 22:52:08 -0500354thus can only be used in the body of a function definition. Using a yield
Yury Selivanov03660042016-12-15 17:36:05 -0500355expression in a function's body causes that function to be a generator,
356and using it in an :keyword:`async def` function's body causes that
357coroutine function to be an asynchronous generator. For example::
358
359 def gen(): # defines a generator function
360 yield 123
361
362 async def agen(): # defines an asynchronous generator function (PEP 525)
363 yield 123
364
365Generator functions are described below, while asynchronous generator
366functions are described separately in section
367:ref:`asynchronous-generator-functions`.
Georg Brandl116aa622007-08-15 14:28:22 +0000368
369When a generator function is called, it returns an iterator known as a
Guido van Rossumd0150ad2015-05-05 12:02:01 -0700370generator. That generator then controls the execution of the generator function.
Georg Brandl116aa622007-08-15 14:28:22 +0000371The execution starts when one of the generator's methods is called. At that
Benjamin Petersond1c85fd2014-01-26 22:52:08 -0500372time, the execution proceeds to the first yield expression, where it is
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700373suspended again, returning the value of :token:`expression_list` to the generator's
Benjamin Petersond1c85fd2014-01-26 22:52:08 -0500374caller. By suspended, we mean that all local state is retained, including the
Ethan Furman2f825af2015-01-14 22:25:27 -0800375current bindings of local variables, the instruction pointer, the internal
376evaluation stack, and the state of any exception handling. When the execution
377is resumed by calling one of the
Benjamin Petersond1c85fd2014-01-26 22:52:08 -0500378generator's methods, the function can proceed exactly as if the yield expression
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700379were just another external call. The value of the yield expression after
Benjamin Petersond1c85fd2014-01-26 22:52:08 -0500380resuming depends on the method which resumed the execution. If
381:meth:`~generator.__next__` is used (typically via either a :keyword:`for` or
382the :func:`next` builtin) then the result is :const:`None`. Otherwise, if
383:meth:`~generator.send` is used, then the result will be the value passed in to
384that method.
Georg Brandl116aa622007-08-15 14:28:22 +0000385
386.. index:: single: coroutine
387
388All of this makes generator functions quite similar to coroutines; they yield
389multiple times, they have more than one entry point and their execution can be
390suspended. The only difference is that a generator function cannot control
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700391where the execution should continue after it yields; the control is always
Georg Brandl6faee4e2010-09-21 14:48:28 +0000392transferred to the generator's caller.
Georg Brandl116aa622007-08-15 14:28:22 +0000393
Ethan Furman2f825af2015-01-14 22:25:27 -0800394Yield expressions are allowed anywhere in a :keyword:`try` construct. If the
395generator is not resumed before it is
Benjamin Petersond1c85fd2014-01-26 22:52:08 -0500396finalized (by reaching a zero reference count or by being garbage collected),
397the generator-iterator's :meth:`~generator.close` method will be called,
398allowing any pending :keyword:`finally` clauses to execute.
Georg Brandl02c30562007-09-07 17:52:53 +0000399
Nick Coghlan0ed80192012-01-14 14:43:24 +1000400When ``yield from <expr>`` is used, it treats the supplied expression as
Nick Coghlan1f7ce622012-01-13 21:43:40 +1000401a subiterator. All values produced by that subiterator are passed directly
402to the caller of the current generator's methods. Any values passed in with
Serhiy Storchaka0d196ed2013-10-09 14:02:31 +0300403:meth:`~generator.send` and any exceptions passed in with
404:meth:`~generator.throw` are passed to the underlying iterator if it has the
405appropriate methods. If this is not the case, then :meth:`~generator.send`
406will raise :exc:`AttributeError` or :exc:`TypeError`, while
407:meth:`~generator.throw` will just raise the passed in exception immediately.
Nick Coghlan1f7ce622012-01-13 21:43:40 +1000408
409When the underlying iterator is complete, the :attr:`~StopIteration.value`
410attribute of the raised :exc:`StopIteration` instance becomes the value of
411the yield expression. It can be either set explicitly when raising
412:exc:`StopIteration`, or automatically when the sub-iterator is a generator
413(by returning a value from the sub-generator).
414
Nick Coghlan0ed80192012-01-14 14:43:24 +1000415 .. versionchanged:: 3.3
Martin Panterd21e0b52015-10-10 10:36:22 +0000416 Added ``yield from <expr>`` to delegate control flow to a subiterator.
Nick Coghlan0ed80192012-01-14 14:43:24 +1000417
Benjamin Petersond1c85fd2014-01-26 22:52:08 -0500418The parentheses may be omitted when the yield expression is the sole expression
419on the right hand side of an assignment statement.
420
421.. seealso::
422
Serhiy Storchakae4ba8722016-03-31 15:30:54 +0300423 :pep:`255` - Simple Generators
Benjamin Petersond1c85fd2014-01-26 22:52:08 -0500424 The proposal for adding generators and the :keyword:`yield` statement to Python.
425
Serhiy Storchakae4ba8722016-03-31 15:30:54 +0300426 :pep:`342` - Coroutines via Enhanced Generators
Benjamin Petersond1c85fd2014-01-26 22:52:08 -0500427 The proposal to enhance the API and syntax of generators, making them
428 usable as simple coroutines.
429
Serhiy Storchakae4ba8722016-03-31 15:30:54 +0300430 :pep:`380` - Syntax for Delegating to a Subgenerator
Benjamin Petersond1c85fd2014-01-26 22:52:08 -0500431 The proposal to introduce the :token:`yield_from` syntax, making delegation
432 to sub-generators easy.
Nick Coghlan1f7ce622012-01-13 21:43:40 +1000433
Georg Brandl116aa622007-08-15 14:28:22 +0000434.. index:: object: generator
Yury Selivanov66f88282015-06-24 11:04:15 -0400435.. _generator-methods:
Georg Brandl116aa622007-08-15 14:28:22 +0000436
R David Murray2c1d1d62012-08-17 20:48:59 -0400437Generator-iterator methods
438^^^^^^^^^^^^^^^^^^^^^^^^^^
439
440This subsection describes the methods of a generator iterator. They can
441be used to control the execution of a generator function.
442
443Note that calling any of the generator methods below when the generator
444is already executing raises a :exc:`ValueError` exception.
Georg Brandl116aa622007-08-15 14:28:22 +0000445
446.. index:: exception: StopIteration
447
448
Georg Brandl96593ed2007-09-07 14:15:41 +0000449.. method:: generator.__next__()
Georg Brandl116aa622007-08-15 14:28:22 +0000450
Georg Brandl96593ed2007-09-07 14:15:41 +0000451 Starts the execution of a generator function or resumes it at the last
Benjamin Petersond1c85fd2014-01-26 22:52:08 -0500452 executed yield expression. When a generator function is resumed with a
453 :meth:`~generator.__next__` method, the current yield expression always
454 evaluates to :const:`None`. The execution then continues to the next yield
455 expression, where the generator is suspended again, and the value of the
Serhiy Storchaka848c8b22014-09-05 23:27:36 +0300456 :token:`expression_list` is returned to :meth:`__next__`'s caller. If the
Benjamin Petersond1c85fd2014-01-26 22:52:08 -0500457 generator exits without yielding another value, a :exc:`StopIteration`
Georg Brandl96593ed2007-09-07 14:15:41 +0000458 exception is raised.
459
460 This method is normally called implicitly, e.g. by a :keyword:`for` loop, or
461 by the built-in :func:`next` function.
Georg Brandl116aa622007-08-15 14:28:22 +0000462
463
464.. method:: generator.send(value)
465
466 Resumes the execution and "sends" a value into the generator function. The
Benjamin Petersond1c85fd2014-01-26 22:52:08 -0500467 *value* argument becomes the result of the current yield expression. The
468 :meth:`send` method returns the next value yielded by the generator, or
469 raises :exc:`StopIteration` if the generator exits without yielding another
470 value. When :meth:`send` is called to start the generator, it must be called
471 with :const:`None` as the argument, because there is no yield expression that
472 could receive the value.
Georg Brandl116aa622007-08-15 14:28:22 +0000473
474
475.. method:: generator.throw(type[, value[, traceback]])
476
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700477 Raises an exception of type ``type`` at the point where the generator was paused,
Georg Brandl116aa622007-08-15 14:28:22 +0000478 and returns the next value yielded by the generator function. If the generator
479 exits without yielding another value, a :exc:`StopIteration` exception is
480 raised. If the generator function does not catch the passed-in exception, or
481 raises a different exception, then that exception propagates to the caller.
482
483.. index:: exception: GeneratorExit
484
485
486.. method:: generator.close()
487
488 Raises a :exc:`GeneratorExit` at the point where the generator function was
Yury Selivanov8170e8c2015-05-09 11:44:30 -0400489 paused. If the generator function then exits gracefully, is already closed,
490 or raises :exc:`GeneratorExit` (by not catching the exception), close
491 returns to its caller. If the generator yields a value, a
492 :exc:`RuntimeError` is raised. If the generator raises any other exception,
493 it is propagated to the caller. :meth:`close` does nothing if the generator
494 has already exited due to an exception or normal exit.
Georg Brandl116aa622007-08-15 14:28:22 +0000495
Chris Jerdonek2654b862012-12-23 15:31:57 -0800496.. index:: single: yield; examples
497
498Examples
499^^^^^^^^
500
Georg Brandl116aa622007-08-15 14:28:22 +0000501Here is a simple example that demonstrates the behavior of generators and
502generator functions::
503
504 >>> def echo(value=None):
Georg Brandl6911e3c2007-09-04 07:15:32 +0000505 ... print("Execution starts when 'next()' is called for the first time.")
Georg Brandl116aa622007-08-15 14:28:22 +0000506 ... try:
507 ... while True:
508 ... try:
509 ... value = (yield value)
Georg Brandlfe800a32009-08-03 17:50:20 +0000510 ... except Exception as e:
Georg Brandl116aa622007-08-15 14:28:22 +0000511 ... value = e
512 ... finally:
Georg Brandl6911e3c2007-09-04 07:15:32 +0000513 ... print("Don't forget to clean up when 'close()' is called.")
Georg Brandl116aa622007-08-15 14:28:22 +0000514 ...
515 >>> generator = echo(1)
Georg Brandl96593ed2007-09-07 14:15:41 +0000516 >>> print(next(generator))
Georg Brandl116aa622007-08-15 14:28:22 +0000517 Execution starts when 'next()' is called for the first time.
518 1
Georg Brandl96593ed2007-09-07 14:15:41 +0000519 >>> print(next(generator))
Georg Brandl116aa622007-08-15 14:28:22 +0000520 None
Georg Brandl6911e3c2007-09-04 07:15:32 +0000521 >>> print(generator.send(2))
Georg Brandl116aa622007-08-15 14:28:22 +0000522 2
523 >>> generator.throw(TypeError, "spam")
524 TypeError('spam',)
525 >>> generator.close()
526 Don't forget to clean up when 'close()' is called.
527
Chris Jerdonek2654b862012-12-23 15:31:57 -0800528For examples using ``yield from``, see :ref:`pep-380` in "What's New in
529Python."
530
Yury Selivanov03660042016-12-15 17:36:05 -0500531.. _asynchronous-generator-functions:
532
533Asynchronous generator functions
534^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
535
536The presence of a yield expression in a function or method defined using
537:keyword:`async def` further defines the function as a
538:term:`asynchronous generator` function.
539
540When an asynchronous generator function is called, it returns an
541asynchronous iterator known as an asynchronous generator object.
542That object then controls the execution of the generator function.
543An asynchronous generator object is typically used in an
544:keyword:`async for` statement in a coroutine function analogously to
545how a generator object would be used in a :keyword:`for` statement.
546
547Calling one of the asynchronous generator's methods returns an
548:term:`awaitable` object, and the execution starts when this object
549is awaited on. At that time, the execution proceeds to the first yield
550expression, where it is suspended again, returning the value of
551:token:`expression_list` to the awaiting coroutine. As with a generator,
552suspension means that all local state is retained, including the
553current bindings of local variables, the instruction pointer, the internal
554evaluation stack, and the state of any exception handling. When the execution
555is resumed by awaiting on the next object returned by the asynchronous
556generator's methods, the function can proceed exactly as if the yield
557expression were just another external call. The value of the yield expression
558after resuming depends on the method which resumed the execution. If
559:meth:`~agen.__anext__` is used then the result is :const:`None`. Otherwise, if
560:meth:`~agen.asend` is used, then the result will be the value passed in to
561that method.
562
563In an asynchronous generator function, yield expressions are allowed anywhere
564in a :keyword:`try` construct. However, if an asynchronous generator is not
565resumed before it is finalized (by reaching a zero reference count or by
566being garbage collected), then a yield expression within a :keyword:`try`
567construct could result in a failure to execute pending :keyword:`finally`
568clauses. In this case, it is the responsibility of the event loop or
569scheduler running the asynchronous generator to call the asynchronous
570generator-iterator's :meth:`~agen.aclose` method and run the resulting
571coroutine object, thus allowing any pending :keyword:`finally` clauses
572to execute.
573
574To take care of finalization, an event loop should define
575a *finalizer* function which takes an asynchronous generator-iterator
576and presumably calls :meth:`~agen.aclose` and executes the coroutine.
577This *finalizer* may be registered by calling :func:`sys.set_asyncgen_hooks`.
578When first iterated over, an asynchronous generator-iterator will store the
579registered *finalizer* to be called upon finalization. For a reference example
580of a *finalizer* method see the implementation of
581``asyncio.Loop.shutdown_asyncgens`` in :source:`Lib/asyncio/base_events.py`.
582
583The expression ``yield from <expr>`` is a syntax error when used in an
584asynchronous generator function.
585
586.. index:: object: asynchronous-generator
587.. _asynchronous-generator-methods:
588
589Asynchronous generator-iterator methods
590^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
591
592This subsection describes the methods of an asynchronous generator iterator,
593which are used to control the execution of a generator function.
594
595
596.. index:: exception: StopAsyncIteration
597
598.. coroutinemethod:: agen.__anext__()
599
600 Returns an awaitable which when run starts to execute the asynchronous
601 generator or resumes it at the last executed yield expression. When an
602 asynchronous generator function is resumed with a :meth:`~agen.__anext__`
603 method, the current yield expression always evaluates to :const:`None` in
604 the returned awaitable, which when run will continue to the next yield
605 expression. The value of the :token:`expression_list` of the yield
606 expression is the value of the :exc:`StopIteration` exception raised by
607 the completing coroutine. If the asynchronous generator exits without
608 yielding another value, the awaitable instead raises an
609 :exc:`StopAsyncIteration` exception, signalling that the asynchronous
610 iteration has completed.
611
612 This method is normally called implicitly by a :keyword:`async for` loop.
613
614
615.. coroutinemethod:: agen.asend(value)
616
617 Returns an awaitable which when run resumes the execution of the
618 asynchronous generator. As with the :meth:`~generator.send()` method for a
619 generator, this "sends" a value into the asynchronous generator function,
620 and the *value* argument becomes the result of the current yield expression.
621 The awaitable returned by the :meth:`asend` method will return the next
622 value yielded by the generator as the value of the raised
623 :exc:`StopIteration`, or raises :exc:`StopAsyncIteration` if the
624 asynchronous generator exits without yielding another value. When
625 :meth:`asend` is called to start the asynchronous
626 generator, it must be called with :const:`None` as the argument,
627 because there is no yield expression that could receive the value.
628
629
630.. coroutinemethod:: agen.athrow(type[, value[, traceback]])
631
632 Returns an awaitable that raises an exception of type ``type`` at the point
633 where the asynchronous generator was paused, and returns the next value
634 yielded by the generator function as the value of the raised
635 :exc:`StopIteration` exception. If the asynchronous generator exits
636 without yielding another value, an :exc:`StopAsyncIteration` exception is
637 raised by the awaitable.
638 If the generator function does not catch the passed-in exception, or
639 raises a different exception, then when the awaitalbe is run that exception
640 propagates to the caller of the awaitable.
641
642.. index:: exception: GeneratorExit
643
644
645.. coroutinemethod:: agen.aclose()
646
647 Returns an awaitable that when run will throw a :exc:`GeneratorExit` into
648 the asynchronous generator function at the point where it was paused.
649 If the asynchronous generator function then exits gracefully, is already
650 closed, or raises :exc:`GeneratorExit` (by not catching the exception),
651 then the returned awaitable will raise a :exc:`StopIteration` exception.
652 Any further awaitables returned by subsequent calls to the asynchronous
653 generator will raise a :exc:`StopAsyncIteration` exception. If the
654 asynchronous generator yields a value, a :exc:`RuntimeError` is raised
655 by the awaitable. If the asynchronous generator raises any other exception,
656 it is propagated to the caller of the awaitable. If the asynchronous
657 generator has already exited due to an exception or normal exit, then
658 further calls to :meth:`aclose` will return an awaitable that does nothing.
Georg Brandl116aa622007-08-15 14:28:22 +0000659
Georg Brandl116aa622007-08-15 14:28:22 +0000660.. _primaries:
661
662Primaries
663=========
664
665.. index:: single: primary
666
667Primaries represent the most tightly bound operations of the language. Their
668syntax is:
669
670.. productionlist::
671 primary: `atom` | `attributeref` | `subscription` | `slicing` | `call`
672
673
674.. _attribute-references:
675
676Attribute references
677--------------------
678
679.. index:: pair: attribute; reference
680
681An attribute reference is a primary followed by a period and a name:
682
683.. productionlist::
684 attributeref: `primary` "." `identifier`
685
686.. index::
687 exception: AttributeError
688 object: module
689 object: list
690
691The primary must evaluate to an object of a type that supports attribute
Georg Brandl96593ed2007-09-07 14:15:41 +0000692references, which most objects do. This object is then asked to produce the
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700693attribute whose name is the identifier. This production can be customized by
Zachary Ware2f78b842014-06-03 09:32:40 -0500694overriding the :meth:`__getattr__` method. If this attribute is not available,
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700695the exception :exc:`AttributeError` is raised. Otherwise, the type and value of
696the object produced is determined by the object. Multiple evaluations of the
697same attribute reference may yield different objects.
Georg Brandl116aa622007-08-15 14:28:22 +0000698
699
700.. _subscriptions:
701
702Subscriptions
703-------------
704
705.. index:: single: subscription
706
707.. index::
708 object: sequence
709 object: mapping
710 object: string
711 object: tuple
712 object: list
713 object: dictionary
714 pair: sequence; item
715
716A subscription selects an item of a sequence (string, tuple or list) or mapping
717(dictionary) object:
718
719.. productionlist::
720 subscription: `primary` "[" `expression_list` "]"
721
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700722The primary must evaluate to an object that supports subscription (lists or
723dictionaries for example). User-defined objects can support subscription by
724defining a :meth:`__getitem__` method.
Georg Brandl96593ed2007-09-07 14:15:41 +0000725
726For built-in objects, there are two types of objects that support subscription:
Georg Brandl116aa622007-08-15 14:28:22 +0000727
728If the primary is a mapping, the expression list must evaluate to an object
729whose value is one of the keys of the mapping, and the subscription selects the
730value in the mapping that corresponds to that key. (The expression list is a
731tuple except if it has exactly one item.)
732
Raymond Hettingerf77c1d62010-09-15 00:09:26 +0000733If the primary is a sequence, the expression (list) must evaluate to an integer
734or a slice (as discussed in the following section).
735
736The formal syntax makes no special provision for negative indices in
737sequences; however, built-in sequences all provide a :meth:`__getitem__`
738method that interprets negative indices by adding the length of the sequence
739to the index (so that ``x[-1]`` selects the last item of ``x``). The
740resulting value must be a nonnegative integer less than the number of items in
741the sequence, and the subscription selects the item whose index is that value
742(counting from zero). Since the support for negative indices and slicing
743occurs in the object's :meth:`__getitem__` method, subclasses overriding
744this method will need to explicitly add that support.
Georg Brandl116aa622007-08-15 14:28:22 +0000745
746.. index::
747 single: character
748 pair: string; item
749
750A string's items are characters. A character is not a separate data type but a
751string of exactly one character.
752
753
754.. _slicings:
755
756Slicings
757--------
758
759.. index::
760 single: slicing
761 single: slice
762
763.. index::
764 object: sequence
765 object: string
766 object: tuple
767 object: list
768
769A slicing selects a range of items in a sequence object (e.g., a string, tuple
770or list). Slicings may be used as expressions or as targets in assignment or
771:keyword:`del` statements. The syntax for a slicing:
772
773.. productionlist::
Georg Brandl48310cd2009-01-03 21:18:54 +0000774 slicing: `primary` "[" `slice_list` "]"
Georg Brandl116aa622007-08-15 14:28:22 +0000775 slice_list: `slice_item` ("," `slice_item`)* [","]
Georg Brandlcb8ecb12007-09-04 06:35:14 +0000776 slice_item: `expression` | `proper_slice`
Thomas Wouters53de1902007-09-04 09:03:59 +0000777 proper_slice: [`lower_bound`] ":" [`upper_bound`] [ ":" [`stride`] ]
Georg Brandl116aa622007-08-15 14:28:22 +0000778 lower_bound: `expression`
779 upper_bound: `expression`
780 stride: `expression`
Georg Brandl116aa622007-08-15 14:28:22 +0000781
782There is ambiguity in the formal syntax here: anything that looks like an
783expression list also looks like a slice list, so any subscription can be
784interpreted as a slicing. Rather than further complicating the syntax, this is
785disambiguated by defining that in this case the interpretation as a subscription
786takes priority over the interpretation as a slicing (this is the case if the
Thomas Wouters53de1902007-09-04 09:03:59 +0000787slice list contains no proper slice).
Georg Brandl116aa622007-08-15 14:28:22 +0000788
789.. index::
790 single: start (slice object attribute)
791 single: stop (slice object attribute)
792 single: step (slice object attribute)
793
Georg Brandla4c8c472014-10-31 10:38:49 +0100794The semantics for a slicing are as follows. The primary is indexed (using the
795same :meth:`__getitem__` method as
Georg Brandl96593ed2007-09-07 14:15:41 +0000796normal subscription) with a key that is constructed from the slice list, as
797follows. If the slice list contains at least one comma, the key is a tuple
798containing the conversion of the slice items; otherwise, the conversion of the
799lone slice item is the key. The conversion of a slice item that is an
800expression is that expression. The conversion of a proper slice is a slice
Serhiy Storchaka0d196ed2013-10-09 14:02:31 +0300801object (see section :ref:`types`) whose :attr:`~slice.start`,
802:attr:`~slice.stop` and :attr:`~slice.step` attributes are the values of the
803expressions given as lower bound, upper bound and stride, respectively,
804substituting ``None`` for missing expressions.
Georg Brandl116aa622007-08-15 14:28:22 +0000805
806
Chris Jerdonekb4309942012-12-25 14:54:44 -0800807.. index::
808 object: callable
809 single: call
810 single: argument; call semantics
811
Georg Brandl116aa622007-08-15 14:28:22 +0000812.. _calls:
813
814Calls
815-----
816
Chris Jerdonekb4309942012-12-25 14:54:44 -0800817A call calls a callable object (e.g., a :term:`function`) with a possibly empty
818series of :term:`arguments <argument>`:
Georg Brandl116aa622007-08-15 14:28:22 +0000819
820.. productionlist::
Georg Brandldc529c12008-09-21 17:03:29 +0000821 call: `primary` "(" [`argument_list` [","] | `comprehension`] ")"
Martin Panter0c0da482016-06-12 01:46:50 +0000822 argument_list: `positional_arguments` ["," `starred_and_keywords`]
823 : ["," `keywords_arguments`]
824 : | `starred_and_keywords` ["," `keywords_arguments`]
825 : | `keywords_arguments`
826 positional_arguments: ["*"] `expression` ("," ["*"] `expression`)*
827 starred_and_keywords: ("*" `expression` | `keyword_item`)
828 : ("," "*" `expression` | "," `keyword_item`)*
829 keywords_arguments: (`keyword_item` | "**" `expression`)
Martin Panter7106a512016-12-24 10:20:38 +0000830 : ("," `keyword_item` | "," "**" `expression`)*
Georg Brandl116aa622007-08-15 14:28:22 +0000831 keyword_item: `identifier` "=" `expression`
832
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700833An optional trailing comma may be present after the positional and keyword arguments
834but does not affect the semantics.
Georg Brandl116aa622007-08-15 14:28:22 +0000835
Chris Jerdonekb4309942012-12-25 14:54:44 -0800836.. index::
837 single: parameter; call semantics
838
Georg Brandl116aa622007-08-15 14:28:22 +0000839The primary must evaluate to a callable object (user-defined functions, built-in
840functions, methods of built-in objects, class objects, methods of class
Georg Brandl96593ed2007-09-07 14:15:41 +0000841instances, and all objects having a :meth:`__call__` method are callable). All
842argument expressions are evaluated before the call is attempted. Please refer
Chris Jerdonekb4309942012-12-25 14:54:44 -0800843to section :ref:`function` for the syntax of formal :term:`parameter` lists.
Georg Brandl96593ed2007-09-07 14:15:41 +0000844
845.. XXX update with kwonly args PEP
Georg Brandl116aa622007-08-15 14:28:22 +0000846
847If keyword arguments are present, they are first converted to positional
848arguments, as follows. First, a list of unfilled slots is created for the
849formal parameters. If there are N positional arguments, they are placed in the
850first N slots. Next, for each keyword argument, the identifier is used to
851determine the corresponding slot (if the identifier is the same as the first
852formal parameter name, the first slot is used, and so on). If the slot is
853already filled, a :exc:`TypeError` exception is raised. Otherwise, the value of
854the argument is placed in the slot, filling it (even if the expression is
855``None``, it fills the slot). When all arguments have been processed, the slots
856that are still unfilled are filled with the corresponding default value from the
857function definition. (Default values are calculated, once, when the function is
858defined; thus, a mutable object such as a list or dictionary used as default
859value will be shared by all calls that don't specify an argument value for the
860corresponding slot; this should usually be avoided.) If there are any unfilled
861slots for which no default value is specified, a :exc:`TypeError` exception is
862raised. Otherwise, the list of filled slots is used as the argument list for
863the call.
864
Georg Brandl495f7b52009-10-27 15:28:25 +0000865.. impl-detail::
Georg Brandl48310cd2009-01-03 21:18:54 +0000866
Georg Brandl495f7b52009-10-27 15:28:25 +0000867 An implementation may provide built-in functions whose positional parameters
868 do not have names, even if they are 'named' for the purpose of documentation,
869 and which therefore cannot be supplied by keyword. In CPython, this is the
Georg Brandl60203b42010-10-06 10:11:56 +0000870 case for functions implemented in C that use :c:func:`PyArg_ParseTuple` to
Georg Brandl495f7b52009-10-27 15:28:25 +0000871 parse their arguments.
Christian Heimes81ee3ef2008-05-04 22:42:01 +0000872
Georg Brandl116aa622007-08-15 14:28:22 +0000873If there are more positional arguments than there are formal parameter slots, a
874:exc:`TypeError` exception is raised, unless a formal parameter using the syntax
875``*identifier`` is present; in this case, that formal parameter receives a tuple
876containing the excess positional arguments (or an empty tuple if there were no
877excess positional arguments).
878
879If any keyword argument does not correspond to a formal parameter name, a
880:exc:`TypeError` exception is raised, unless a formal parameter using the syntax
881``**identifier`` is present; in this case, that formal parameter receives a
882dictionary containing the excess keyword arguments (using the keywords as keys
883and the argument values as corresponding values), or a (new) empty dictionary if
884there were no excess keyword arguments.
885
Eli Bendersky7bd081c2011-07-30 07:05:16 +0300886.. index::
887 single: *; in function calls
Martin Panter0c0da482016-06-12 01:46:50 +0000888 single: unpacking; in function calls
Eli Bendersky7bd081c2011-07-30 07:05:16 +0300889
Georg Brandl116aa622007-08-15 14:28:22 +0000890If the syntax ``*expression`` appears in the function call, ``expression`` must
Martin Panter0c0da482016-06-12 01:46:50 +0000891evaluate to an :term:`iterable`. Elements from these iterables are
892treated as if they were additional positional arguments. For the call
893``f(x1, x2, *y, x3, x4)``, if *y* evaluates to a sequence *y1*, ..., *yM*,
894this is equivalent to a call with M+4 positional arguments *x1*, *x2*,
895*y1*, ..., *yM*, *x3*, *x4*.
Georg Brandl116aa622007-08-15 14:28:22 +0000896
Benjamin Peterson2d735bc2008-08-19 20:57:10 +0000897A consequence of this is that although the ``*expression`` syntax may appear
Martin Panter0c0da482016-06-12 01:46:50 +0000898*after* explicit keyword arguments, it is processed *before* the
899keyword arguments (and any ``**expression`` arguments -- see below). So::
Georg Brandl116aa622007-08-15 14:28:22 +0000900
901 >>> def f(a, b):
Serhiy Storchakadba90392016-05-10 12:01:23 +0300902 ... print(a, b)
Georg Brandl116aa622007-08-15 14:28:22 +0000903 ...
904 >>> f(b=1, *(2,))
905 2 1
906 >>> f(a=1, *(2,))
907 Traceback (most recent call last):
908 File "<stdin>", line 1, in ?
909 TypeError: f() got multiple values for keyword argument 'a'
910 >>> f(1, *(2,))
911 1 2
912
913It is unusual for both keyword arguments and the ``*expression`` syntax to be
914used in the same call, so in practice this confusion does not arise.
915
Eli Bendersky7bd081c2011-07-30 07:05:16 +0300916.. index::
917 single: **; in function calls
918
Georg Brandl116aa622007-08-15 14:28:22 +0000919If the syntax ``**expression`` appears in the function call, ``expression`` must
Martin Panter0c0da482016-06-12 01:46:50 +0000920evaluate to a :term:`mapping`, the contents of which are treated as
921additional keyword arguments. If a keyword is already present
922(as an explicit keyword argument, or from another unpacking),
923a :exc:`TypeError` exception is raised.
Georg Brandl116aa622007-08-15 14:28:22 +0000924
925Formal parameters using the syntax ``*identifier`` or ``**identifier`` cannot be
926used as positional argument slots or as keyword argument names.
927
Martin Panter0c0da482016-06-12 01:46:50 +0000928.. versionchanged:: 3.5
929 Function calls accept any number of ``*`` and ``**`` unpackings,
930 positional arguments may follow iterable unpackings (``*``),
931 and keyword arguments may follow dictionary unpackings (``**``).
932 Originally proposed by :pep:`448`.
933
Georg Brandl116aa622007-08-15 14:28:22 +0000934A call always returns some value, possibly ``None``, unless it raises an
935exception. How this value is computed depends on the type of the callable
936object.
937
938If it is---
939
940a user-defined function:
941 .. index::
942 pair: function; call
943 triple: user-defined; function; call
944 object: user-defined function
945 object: function
946
947 The code block for the function is executed, passing it the argument list. The
948 first thing the code block will do is bind the formal parameters to the
949 arguments; this is described in section :ref:`function`. When the code block
950 executes a :keyword:`return` statement, this specifies the return value of the
951 function call.
952
953a built-in function or method:
954 .. index::
955 pair: function; call
956 pair: built-in function; call
957 pair: method; call
958 pair: built-in method; call
959 object: built-in method
960 object: built-in function
961 object: method
962 object: function
963
964 The result is up to the interpreter; see :ref:`built-in-funcs` for the
965 descriptions of built-in functions and methods.
966
967a class object:
968 .. index::
969 object: class
970 pair: class object; call
971
972 A new instance of that class is returned.
973
974a class instance method:
975 .. index::
976 object: class instance
977 object: instance
978 pair: class instance; call
979
980 The corresponding user-defined function is called, with an argument list that is
981 one longer than the argument list of the call: the instance becomes the first
982 argument.
983
984a class instance:
985 .. index::
986 pair: instance; call
987 single: __call__() (object method)
988
989 The class must define a :meth:`__call__` method; the effect is then the same as
990 if that method was called.
991
992
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400993.. _await:
994
995Await expression
996================
997
998Suspend the execution of :term:`coroutine` on an :term:`awaitable` object.
999Can only be used inside a :term:`coroutine function`.
1000
1001.. productionlist::
Serhiy Storchakac7cc9852016-05-08 21:59:46 +03001002 await_expr: "await" `primary`
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04001003
1004.. versionadded:: 3.5
1005
1006
Georg Brandl116aa622007-08-15 14:28:22 +00001007.. _power:
1008
1009The power operator
1010==================
1011
1012The power operator binds more tightly than unary operators on its left; it binds
1013less tightly than unary operators on its right. The syntax is:
1014
1015.. productionlist::
Serhiy Storchakac7cc9852016-05-08 21:59:46 +03001016 power: ( `await_expr` | `primary` ) ["**" `u_expr`]
Georg Brandl116aa622007-08-15 14:28:22 +00001017
1018Thus, in an unparenthesized sequence of power and unary operators, the operators
1019are evaluated from right to left (this does not constrain the evaluation order
Guido van Rossum04110fb2007-08-24 16:32:05 +00001020for the operands): ``-1**2`` results in ``-1``.
Georg Brandl116aa622007-08-15 14:28:22 +00001021
1022The power operator has the same semantics as the built-in :func:`pow` function,
1023when called with two arguments: it yields its left argument raised to the power
1024of its right argument. The numeric arguments are first converted to a common
Georg Brandl96593ed2007-09-07 14:15:41 +00001025type, and the result is of that type.
Georg Brandl116aa622007-08-15 14:28:22 +00001026
Georg Brandl96593ed2007-09-07 14:15:41 +00001027For int operands, the result has the same type as the operands unless the second
1028argument is negative; in that case, all arguments are converted to float and a
1029float result is delivered. For example, ``10**2`` returns ``100``, but
1030``10**-2`` returns ``0.01``.
Georg Brandl116aa622007-08-15 14:28:22 +00001031
1032Raising ``0.0`` to a negative power results in a :exc:`ZeroDivisionError`.
Christian Heimes072c0f12008-01-03 23:01:04 +00001033Raising a negative number to a fractional power results in a :class:`complex`
Christian Heimesfaf2f632008-01-06 16:59:19 +00001034number. (In earlier versions it raised a :exc:`ValueError`.)
Georg Brandl116aa622007-08-15 14:28:22 +00001035
1036
1037.. _unary:
1038
Benjamin Petersonba01dd92009-02-20 04:02:38 +00001039Unary arithmetic and bitwise operations
1040=======================================
Georg Brandl116aa622007-08-15 14:28:22 +00001041
1042.. index::
1043 triple: unary; arithmetic; operation
Christian Heimesfaf2f632008-01-06 16:59:19 +00001044 triple: unary; bitwise; operation
Georg Brandl116aa622007-08-15 14:28:22 +00001045
Benjamin Petersonba01dd92009-02-20 04:02:38 +00001046All unary arithmetic and bitwise operations have the same priority:
Georg Brandl116aa622007-08-15 14:28:22 +00001047
1048.. productionlist::
1049 u_expr: `power` | "-" `u_expr` | "+" `u_expr` | "~" `u_expr`
1050
1051.. index::
1052 single: negation
1053 single: minus
1054
1055The unary ``-`` (minus) operator yields the negation of its numeric argument.
1056
1057.. index:: single: plus
1058
1059The unary ``+`` (plus) operator yields its numeric argument unchanged.
1060
1061.. index:: single: inversion
1062
Christian Heimesfaf2f632008-01-06 16:59:19 +00001063
Georg Brandl95817b32008-05-11 14:30:18 +00001064The unary ``~`` (invert) operator yields the bitwise inversion of its integer
1065argument. The bitwise inversion of ``x`` is defined as ``-(x+1)``. It only
1066applies to integral numbers.
Georg Brandl116aa622007-08-15 14:28:22 +00001067
1068.. index:: exception: TypeError
1069
1070In all three cases, if the argument does not have the proper type, a
1071:exc:`TypeError` exception is raised.
1072
1073
1074.. _binary:
1075
1076Binary arithmetic operations
1077============================
1078
1079.. index:: triple: binary; arithmetic; operation
1080
1081The binary arithmetic operations have the conventional priority levels. Note
1082that some of these operations also apply to certain non-numeric types. Apart
1083from the power operator, there are only two levels, one for multiplicative
1084operators and one for additive operators:
1085
1086.. productionlist::
Benjamin Petersond51374e2014-04-09 23:55:56 -04001087 m_expr: `u_expr` | `m_expr` "*" `u_expr` | `m_expr` "@" `m_expr` |
1088 : `m_expr` "//" `u_expr`| `m_expr` "/" `u_expr` |
1089 : `m_expr` "%" `u_expr`
Georg Brandl116aa622007-08-15 14:28:22 +00001090 a_expr: `m_expr` | `a_expr` "+" `m_expr` | `a_expr` "-" `m_expr`
1091
1092.. index:: single: multiplication
1093
1094The ``*`` (multiplication) operator yields the product of its arguments. The
Georg Brandl96593ed2007-09-07 14:15:41 +00001095arguments must either both be numbers, or one argument must be an integer and
1096the other must be a sequence. In the former case, the numbers are converted to a
1097common type and then multiplied together. In the latter case, sequence
1098repetition is performed; a negative repetition factor yields an empty sequence.
Georg Brandl116aa622007-08-15 14:28:22 +00001099
Benjamin Petersond51374e2014-04-09 23:55:56 -04001100.. index:: single: matrix multiplication
1101
1102The ``@`` (at) operator is intended to be used for matrix multiplication. No
1103builtin Python types implement this operator.
1104
1105.. versionadded:: 3.5
1106
Georg Brandl116aa622007-08-15 14:28:22 +00001107.. index::
1108 exception: ZeroDivisionError
1109 single: division
1110
1111The ``/`` (division) and ``//`` (floor division) operators yield the quotient of
1112their arguments. The numeric arguments are first converted to a common type.
Georg Brandl0aaae262013-10-08 21:47:18 +02001113Division of integers yields a float, while floor division of integers results in an
Georg Brandl96593ed2007-09-07 14:15:41 +00001114integer; the result is that of mathematical division with the 'floor' function
1115applied to the result. Division by zero raises the :exc:`ZeroDivisionError`
1116exception.
Georg Brandl116aa622007-08-15 14:28:22 +00001117
1118.. index:: single: modulo
1119
1120The ``%`` (modulo) operator yields the remainder from the division of the first
1121argument by the second. The numeric arguments are first converted to a common
1122type. A zero right argument raises the :exc:`ZeroDivisionError` exception. The
1123arguments may be floating point numbers, e.g., ``3.14%0.7`` equals ``0.34``
1124(since ``3.14`` equals ``4*0.7 + 0.34``.) The modulo operator always yields a
1125result with the same sign as its second operand (or zero); the absolute value of
1126the result is strictly smaller than the absolute value of the second operand
1127[#]_.
1128
Georg Brandl96593ed2007-09-07 14:15:41 +00001129The floor division and modulo operators are connected by the following
1130identity: ``x == (x//y)*y + (x%y)``. Floor division and modulo are also
1131connected with the built-in function :func:`divmod`: ``divmod(x, y) == (x//y,
1132x%y)``. [#]_.
Georg Brandl116aa622007-08-15 14:28:22 +00001133
1134In addition to performing the modulo operation on numbers, the ``%`` operator is
Georg Brandl96593ed2007-09-07 14:15:41 +00001135also overloaded by string objects to perform old-style string formatting (also
1136known as interpolation). The syntax for string formatting is described in the
Georg Brandl4b491312007-08-31 09:22:56 +00001137Python Library Reference, section :ref:`old-string-formatting`.
Georg Brandl116aa622007-08-15 14:28:22 +00001138
1139The floor division operator, the modulo operator, and the :func:`divmod`
Georg Brandl96593ed2007-09-07 14:15:41 +00001140function are not defined for complex numbers. Instead, convert to a floating
1141point number using the :func:`abs` function if appropriate.
Georg Brandl116aa622007-08-15 14:28:22 +00001142
1143.. index:: single: addition
1144
Georg Brandl96593ed2007-09-07 14:15:41 +00001145The ``+`` (addition) operator yields the sum of its arguments. The arguments
Raymond Hettingeraa7886d2014-05-26 22:20:37 -07001146must either both be numbers or both be sequences of the same type. In the
1147former case, the numbers are converted to a common type and then added together.
1148In the latter case, the sequences are concatenated.
Georg Brandl116aa622007-08-15 14:28:22 +00001149
1150.. index:: single: subtraction
1151
1152The ``-`` (subtraction) operator yields the difference of its arguments. The
1153numeric arguments are first converted to a common type.
1154
1155
1156.. _shifting:
1157
1158Shifting operations
1159===================
1160
1161.. index:: pair: shifting; operation
1162
1163The shifting operations have lower priority than the arithmetic operations:
1164
1165.. productionlist::
1166 shift_expr: `a_expr` | `shift_expr` ( "<<" | ">>" ) `a_expr`
1167
Georg Brandl96593ed2007-09-07 14:15:41 +00001168These operators accept integers as arguments. They shift the first argument to
1169the left or right by the number of bits given by the second argument.
Georg Brandl116aa622007-08-15 14:28:22 +00001170
1171.. index:: exception: ValueError
1172
Georg Brandl0aaae262013-10-08 21:47:18 +02001173A right shift by *n* bits is defined as floor division by ``pow(2,n)``. A left
1174shift by *n* bits is defined as multiplication with ``pow(2,n)``.
Georg Brandl116aa622007-08-15 14:28:22 +00001175
1176
1177.. _bitwise:
1178
Christian Heimesfaf2f632008-01-06 16:59:19 +00001179Binary bitwise operations
1180=========================
Georg Brandl116aa622007-08-15 14:28:22 +00001181
Christian Heimesfaf2f632008-01-06 16:59:19 +00001182.. index:: triple: binary; bitwise; operation
Georg Brandl116aa622007-08-15 14:28:22 +00001183
1184Each of the three bitwise operations has a different priority level:
1185
1186.. productionlist::
1187 and_expr: `shift_expr` | `and_expr` "&" `shift_expr`
1188 xor_expr: `and_expr` | `xor_expr` "^" `and_expr`
1189 or_expr: `xor_expr` | `or_expr` "|" `xor_expr`
1190
Christian Heimesfaf2f632008-01-06 16:59:19 +00001191.. index:: pair: bitwise; and
Georg Brandl116aa622007-08-15 14:28:22 +00001192
Georg Brandl96593ed2007-09-07 14:15:41 +00001193The ``&`` operator yields the bitwise AND of its arguments, which must be
1194integers.
Georg Brandl116aa622007-08-15 14:28:22 +00001195
1196.. index::
Christian Heimesfaf2f632008-01-06 16:59:19 +00001197 pair: bitwise; xor
Georg Brandl116aa622007-08-15 14:28:22 +00001198 pair: exclusive; or
1199
1200The ``^`` operator yields the bitwise XOR (exclusive OR) of its arguments, which
Georg Brandl96593ed2007-09-07 14:15:41 +00001201must be integers.
Georg Brandl116aa622007-08-15 14:28:22 +00001202
1203.. index::
Christian Heimesfaf2f632008-01-06 16:59:19 +00001204 pair: bitwise; or
Georg Brandl116aa622007-08-15 14:28:22 +00001205 pair: inclusive; or
1206
1207The ``|`` operator yields the bitwise (inclusive) OR of its arguments, which
Georg Brandl96593ed2007-09-07 14:15:41 +00001208must be integers.
Georg Brandl116aa622007-08-15 14:28:22 +00001209
1210
1211.. _comparisons:
1212
1213Comparisons
1214===========
1215
1216.. index:: single: comparison
1217
1218.. index:: pair: C; language
1219
1220Unlike C, all comparison operations in Python have the same priority, which is
1221lower than that of any arithmetic, shifting or bitwise operation. Also unlike
1222C, expressions like ``a < b < c`` have the interpretation that is conventional
1223in mathematics:
1224
1225.. productionlist::
1226 comparison: `or_expr` ( `comp_operator` `or_expr` )*
1227 comp_operator: "<" | ">" | "==" | ">=" | "<=" | "!="
1228 : | "is" ["not"] | ["not"] "in"
1229
1230Comparisons yield boolean values: ``True`` or ``False``.
1231
1232.. index:: pair: chaining; comparisons
1233
1234Comparisons can be chained arbitrarily, e.g., ``x < y <= z`` is equivalent to
1235``x < y and y <= z``, except that ``y`` is evaluated only once (but in both
1236cases ``z`` is not evaluated at all when ``x < y`` is found to be false).
1237
Guido van Rossum04110fb2007-08-24 16:32:05 +00001238Formally, if *a*, *b*, *c*, ..., *y*, *z* are expressions and *op1*, *op2*, ...,
1239*opN* are comparison operators, then ``a op1 b op2 c ... y opN z`` is equivalent
1240to ``a op1 b and b op2 c and ... y opN z``, except that each expression is
1241evaluated at most once.
Georg Brandl116aa622007-08-15 14:28:22 +00001242
Guido van Rossum04110fb2007-08-24 16:32:05 +00001243Note that ``a op1 b op2 c`` doesn't imply any kind of comparison between *a* and
Georg Brandl116aa622007-08-15 14:28:22 +00001244*c*, so that, e.g., ``x < y > z`` is perfectly legal (though perhaps not
1245pretty).
1246
Martin Panteraa0da862015-09-23 05:28:13 +00001247Value comparisons
1248-----------------
1249
Georg Brandl116aa622007-08-15 14:28:22 +00001250The operators ``<``, ``>``, ``==``, ``>=``, ``<=``, and ``!=`` compare the
Martin Panteraa0da862015-09-23 05:28:13 +00001251values of two objects. The objects do not need to have the same type.
Georg Brandl116aa622007-08-15 14:28:22 +00001252
Martin Panteraa0da862015-09-23 05:28:13 +00001253Chapter :ref:`objects` states that objects have a value (in addition to type
1254and identity). The value of an object is a rather abstract notion in Python:
1255For example, there is no canonical access method for an object's value. Also,
1256there is no requirement that the value of an object should be constructed in a
1257particular way, e.g. comprised of all its data attributes. Comparison operators
1258implement a particular notion of what the value of an object is. One can think
1259of them as defining the value of an object indirectly, by means of their
1260comparison implementation.
Georg Brandl116aa622007-08-15 14:28:22 +00001261
Martin Panteraa0da862015-09-23 05:28:13 +00001262Because all types are (direct or indirect) subtypes of :class:`object`, they
1263inherit the default comparison behavior from :class:`object`. Types can
1264customize their comparison behavior by implementing
1265:dfn:`rich comparison methods` like :meth:`__lt__`, described in
1266:ref:`customization`.
Georg Brandl116aa622007-08-15 14:28:22 +00001267
Martin Panteraa0da862015-09-23 05:28:13 +00001268The default behavior for equality comparison (``==`` and ``!=``) is based on
1269the identity of the objects. Hence, equality comparison of instances with the
1270same identity results in equality, and equality comparison of instances with
1271different identities results in inequality. A motivation for this default
1272behavior is the desire that all objects should be reflexive (i.e. ``x is y``
1273implies ``x == y``).
1274
1275A default order comparison (``<``, ``>``, ``<=``, and ``>=``) is not provided;
1276an attempt raises :exc:`TypeError`. A motivation for this default behavior is
1277the lack of a similar invariant as for equality.
1278
1279The behavior of the default equality comparison, that instances with different
1280identities are always unequal, may be in contrast to what types will need that
1281have a sensible definition of object value and value-based equality. Such
1282types will need to customize their comparison behavior, and in fact, a number
1283of built-in types have done that.
1284
1285The following list describes the comparison behavior of the most important
1286built-in types.
1287
1288* Numbers of built-in numeric types (:ref:`typesnumeric`) and of the standard
1289 library types :class:`fractions.Fraction` and :class:`decimal.Decimal` can be
1290 compared within and across their types, with the restriction that complex
1291 numbers do not support order comparison. Within the limits of the types
1292 involved, they compare mathematically (algorithmically) correct without loss
1293 of precision.
1294
1295 The not-a-number values :const:`float('NaN')` and :const:`Decimal('NaN')`
1296 are special. They are identical to themselves (``x is x`` is true) but
1297 are not equal to themselves (``x == x`` is false). Additionally,
1298 comparing any number to a not-a-number value
Raymond Hettingera2a08fb2008-11-17 22:55:16 +00001299 will return ``False``. For example, both ``3 < float('NaN')`` and
1300 ``float('NaN') < 3`` will return ``False``.
1301
Martin Panteraa0da862015-09-23 05:28:13 +00001302* Binary sequences (instances of :class:`bytes` or :class:`bytearray`) can be
1303 compared within and across their types. They compare lexicographically using
1304 the numeric values of their elements.
Georg Brandl4b491312007-08-31 09:22:56 +00001305
Martin Panteraa0da862015-09-23 05:28:13 +00001306* Strings (instances of :class:`str`) compare lexicographically using the
1307 numerical Unicode code points (the result of the built-in function
1308 :func:`ord`) of their characters. [#]_
Georg Brandl116aa622007-08-15 14:28:22 +00001309
Martin Panteraa0da862015-09-23 05:28:13 +00001310 Strings and binary sequences cannot be directly compared.
Georg Brandl116aa622007-08-15 14:28:22 +00001311
Martin Panteraa0da862015-09-23 05:28:13 +00001312* Sequences (instances of :class:`tuple`, :class:`list`, or :class:`range`) can
1313 be compared only within each of their types, with the restriction that ranges
1314 do not support order comparison. Equality comparison across these types
Jim Fasarakis-Hilliard132ac382017-02-24 22:32:54 +02001315 results in inequality, and ordering comparison across these types raises
Martin Panteraa0da862015-09-23 05:28:13 +00001316 :exc:`TypeError`.
Georg Brandl116aa622007-08-15 14:28:22 +00001317
Martin Panteraa0da862015-09-23 05:28:13 +00001318 Sequences compare lexicographically using comparison of corresponding
1319 elements, whereby reflexivity of the elements is enforced.
Georg Brandl116aa622007-08-15 14:28:22 +00001320
Martin Panteraa0da862015-09-23 05:28:13 +00001321 In enforcing reflexivity of elements, the comparison of collections assumes
1322 that for a collection element ``x``, ``x == x`` is always true. Based on
1323 that assumption, element identity is compared first, and element comparison
1324 is performed only for distinct elements. This approach yields the same
1325 result as a strict element comparison would, if the compared elements are
1326 reflexive. For non-reflexive elements, the result is different than for
1327 strict element comparison, and may be surprising: The non-reflexive
1328 not-a-number values for example result in the following comparison behavior
1329 when used in a list::
1330
1331 >>> nan = float('NaN')
1332 >>> nan is nan
1333 True
1334 >>> nan == nan
1335 False <-- the defined non-reflexive behavior of NaN
1336 >>> [nan] == [nan]
1337 True <-- list enforces reflexivity and tests identity first
1338
1339 Lexicographical comparison between built-in collections works as follows:
1340
1341 - For two collections to compare equal, they must be of the same type, have
1342 the same length, and each pair of corresponding elements must compare
1343 equal (for example, ``[1,2] == (1,2)`` is false because the type is not the
1344 same).
1345
1346 - Collections that support order comparison are ordered the same as their
1347 first unequal elements (for example, ``[1,2,x] <= [1,2,y]`` has the same
1348 value as ``x <= y``). If a corresponding element does not exist, the
1349 shorter collection is ordered first (for example, ``[1,2] < [1,2,3]`` is
1350 true).
1351
1352* Mappings (instances of :class:`dict`) compare equal if and only if they have
cocoatomocdcac032017-03-31 14:48:49 +09001353 equal `(key, value)` pairs. Equality comparison of the keys and values
Martin Panteraa0da862015-09-23 05:28:13 +00001354 enforces reflexivity.
1355
1356 Order comparisons (``<``, ``>``, ``<=``, and ``>=``) raise :exc:`TypeError`.
1357
1358* Sets (instances of :class:`set` or :class:`frozenset`) can be compared within
1359 and across their types.
1360
1361 They define order
1362 comparison operators to mean subset and superset tests. Those relations do
1363 not define total orderings (for example, the two sets ``{1,2}`` and ``{2,3}``
1364 are not equal, nor subsets of one another, nor supersets of one
Raymond Hettingera2a08fb2008-11-17 22:55:16 +00001365 another). Accordingly, sets are not appropriate arguments for functions
Martin Panteraa0da862015-09-23 05:28:13 +00001366 which depend on total ordering (for example, :func:`min`, :func:`max`, and
1367 :func:`sorted` produce undefined results given a list of sets as inputs).
Raymond Hettingera2a08fb2008-11-17 22:55:16 +00001368
Martin Panteraa0da862015-09-23 05:28:13 +00001369 Comparison of sets enforces reflexivity of its elements.
Georg Brandl116aa622007-08-15 14:28:22 +00001370
Martin Panteraa0da862015-09-23 05:28:13 +00001371* Most other built-in types have no comparison methods implemented, so they
1372 inherit the default comparison behavior.
Raymond Hettingera2a08fb2008-11-17 22:55:16 +00001373
Martin Panteraa0da862015-09-23 05:28:13 +00001374User-defined classes that customize their comparison behavior should follow
1375some consistency rules, if possible:
1376
1377* Equality comparison should be reflexive.
1378 In other words, identical objects should compare equal:
1379
1380 ``x is y`` implies ``x == y``
1381
1382* Comparison should be symmetric.
1383 In other words, the following expressions should have the same result:
1384
1385 ``x == y`` and ``y == x``
1386
1387 ``x != y`` and ``y != x``
1388
1389 ``x < y`` and ``y > x``
1390
1391 ``x <= y`` and ``y >= x``
1392
1393* Comparison should be transitive.
1394 The following (non-exhaustive) examples illustrate that:
1395
1396 ``x > y and y > z`` implies ``x > z``
1397
1398 ``x < y and y <= z`` implies ``x < z``
1399
1400* Inverse comparison should result in the boolean negation.
1401 In other words, the following expressions should have the same result:
1402
1403 ``x == y`` and ``not x != y``
1404
1405 ``x < y`` and ``not x >= y`` (for total ordering)
1406
1407 ``x > y`` and ``not x <= y`` (for total ordering)
1408
1409 The last two expressions apply to totally ordered collections (e.g. to
1410 sequences, but not to sets or mappings). See also the
1411 :func:`~functools.total_ordering` decorator.
1412
Martin Panter8dbb0ca2017-01-29 10:00:23 +00001413* The :func:`hash` result should be consistent with equality.
1414 Objects that are equal should either have the same hash value,
1415 or be marked as unhashable.
1416
Martin Panteraa0da862015-09-23 05:28:13 +00001417Python does not enforce these consistency rules. In fact, the not-a-number
1418values are an example for not following these rules.
1419
1420
1421.. _in:
1422.. _not in:
Georg Brandl495f7b52009-10-27 15:28:25 +00001423.. _membership-test-details:
1424
Martin Panteraa0da862015-09-23 05:28:13 +00001425Membership test operations
1426--------------------------
1427
Georg Brandl96593ed2007-09-07 14:15:41 +00001428The operators :keyword:`in` and :keyword:`not in` test for membership. ``x in
Amit Kumar0ae7c8b2017-03-28 19:43:01 +05301429s`` evaluates to ``True`` if *x* is a member of *s*, and ``False`` otherwise.
1430``x not in s`` returns the negation of ``x in s``. All built-in sequences and
1431set types support this as well as dictionary, for which :keyword:`in` tests
1432whether the dictionary has a given key. For container types such as list, tuple,
1433set, frozenset, dict, or collections.deque, the expression ``x in y`` is equivalent
Stefan Krahc8bdc012010-04-01 10:34:09 +00001434to ``any(x is e or x == e for e in y)``.
Georg Brandl116aa622007-08-15 14:28:22 +00001435
Amit Kumar0ae7c8b2017-03-28 19:43:01 +05301436For the string and bytes types, ``x in y`` is ``True`` if and only if *x* is a
Georg Brandl4b491312007-08-31 09:22:56 +00001437substring of *y*. An equivalent test is ``y.find(x) != -1``. Empty strings are
1438always considered to be a substring of any other string, so ``"" in "abc"`` will
1439return ``True``.
Georg Brandl116aa622007-08-15 14:28:22 +00001440
Georg Brandl116aa622007-08-15 14:28:22 +00001441For user-defined classes which define the :meth:`__contains__` method, ``x in
Amit Kumar0ae7c8b2017-03-28 19:43:01 +05301442y`` returns ``True`` if ``y.__contains__(x)`` returns a true value, and
1443``False`` otherwise.
Georg Brandl116aa622007-08-15 14:28:22 +00001444
Georg Brandl495f7b52009-10-27 15:28:25 +00001445For user-defined classes which do not define :meth:`__contains__` but do define
Amit Kumar0ae7c8b2017-03-28 19:43:01 +05301446:meth:`__iter__`, ``x in y`` is ``True`` if some value ``z`` with ``x == z`` is
Georg Brandl495f7b52009-10-27 15:28:25 +00001447produced while iterating over ``y``. If an exception is raised during the
1448iteration, it is as if :keyword:`in` raised that exception.
1449
1450Lastly, the old-style iteration protocol is tried: if a class defines
Amit Kumar0ae7c8b2017-03-28 19:43:01 +05301451:meth:`__getitem__`, ``x in y`` is ``True`` if and only if there is a non-negative
Georg Brandl116aa622007-08-15 14:28:22 +00001452integer index *i* such that ``x == y[i]``, and all lower integer indices do not
Georg Brandl96593ed2007-09-07 14:15:41 +00001453raise :exc:`IndexError` exception. (If any other exception is raised, it is as
Georg Brandl116aa622007-08-15 14:28:22 +00001454if :keyword:`in` raised that exception).
1455
1456.. index::
1457 operator: in
1458 operator: not in
1459 pair: membership; test
1460 object: sequence
1461
1462The operator :keyword:`not in` is defined to have the inverse true value of
1463:keyword:`in`.
1464
1465.. index::
1466 operator: is
1467 operator: is not
1468 pair: identity; test
1469
Martin Panteraa0da862015-09-23 05:28:13 +00001470
1471.. _is:
1472.. _is not:
1473
1474Identity comparisons
1475--------------------
1476
Georg Brandl116aa622007-08-15 14:28:22 +00001477The operators :keyword:`is` and :keyword:`is not` test for object identity: ``x
Raymond Hettinger06e18a72016-09-11 17:23:49 -07001478is y`` is true if and only if *x* and *y* are the same object. Object identity
1479is determined using the :meth:`id` function. ``x is not y`` yields the inverse
1480truth value. [#]_
Georg Brandl116aa622007-08-15 14:28:22 +00001481
1482
1483.. _booleans:
Christian Heimes5b5e81c2007-12-31 16:14:33 +00001484.. _and:
1485.. _or:
1486.. _not:
Georg Brandl116aa622007-08-15 14:28:22 +00001487
1488Boolean operations
1489==================
1490
1491.. index::
1492 pair: Conditional; expression
1493 pair: Boolean; operation
1494
Georg Brandl116aa622007-08-15 14:28:22 +00001495.. productionlist::
Georg Brandl116aa622007-08-15 14:28:22 +00001496 or_test: `and_test` | `or_test` "or" `and_test`
1497 and_test: `not_test` | `and_test` "and" `not_test`
1498 not_test: `comparison` | "not" `not_test`
1499
1500In the context of Boolean operations, and also when expressions are used by
1501control flow statements, the following values are interpreted as false:
1502``False``, ``None``, numeric zero of all types, and empty strings and containers
1503(including strings, tuples, lists, dictionaries, sets and frozensets). All
Georg Brandl96593ed2007-09-07 14:15:41 +00001504other values are interpreted as true. User-defined objects can customize their
1505truth value by providing a :meth:`__bool__` method.
Georg Brandl116aa622007-08-15 14:28:22 +00001506
1507.. index:: operator: not
1508
1509The operator :keyword:`not` yields ``True`` if its argument is false, ``False``
1510otherwise.
1511
Georg Brandl116aa622007-08-15 14:28:22 +00001512.. index:: operator: and
1513
1514The expression ``x and y`` first evaluates *x*; if *x* is false, its value is
1515returned; otherwise, *y* is evaluated and the resulting value is returned.
1516
1517.. index:: operator: or
1518
1519The expression ``x or y`` first evaluates *x*; if *x* is true, its value is
1520returned; otherwise, *y* is evaluated and the resulting value is returned.
1521
1522(Note that neither :keyword:`and` nor :keyword:`or` restrict the value and type
1523they return to ``False`` and ``True``, but rather return the last evaluated
Georg Brandl96593ed2007-09-07 14:15:41 +00001524argument. This is sometimes useful, e.g., if ``s`` is a string that should be
Georg Brandl116aa622007-08-15 14:28:22 +00001525replaced by a default value if it is empty, the expression ``s or 'foo'`` yields
Raymond Hettingeraa7886d2014-05-26 22:20:37 -07001526the desired value. Because :keyword:`not` has to create a new value, it
1527returns a boolean value regardless of the type of its argument
1528(for example, ``not 'foo'`` produces ``False`` rather than ``''``.)
Georg Brandl116aa622007-08-15 14:28:22 +00001529
1530
Alexander Belopolsky50ba19e2010-12-15 19:47:37 +00001531Conditional expressions
Georg Brandl93dc9eb2010-03-14 10:56:14 +00001532=======================
1533
Georg Brandl93dc9eb2010-03-14 10:56:14 +00001534.. index::
1535 pair: conditional; expression
1536 pair: ternary; operator
1537
1538.. productionlist::
1539 conditional_expression: `or_test` ["if" `or_test` "else" `expression`]
Georg Brandl242e6a02013-10-06 10:28:39 +02001540 expression: `conditional_expression` | `lambda_expr`
1541 expression_nocond: `or_test` | `lambda_expr_nocond`
Georg Brandl93dc9eb2010-03-14 10:56:14 +00001542
1543Conditional expressions (sometimes called a "ternary operator") have the lowest
1544priority of all Python operations.
1545
Raymond Hettingeraa7886d2014-05-26 22:20:37 -07001546The expression ``x if C else y`` first evaluates the condition, *C* rather than *x*.
1547If *C* is true, *x* is evaluated and its value is returned; otherwise, *y* is
Georg Brandl93dc9eb2010-03-14 10:56:14 +00001548evaluated and its value is returned.
1549
1550See :pep:`308` for more details about conditional expressions.
1551
1552
Georg Brandl116aa622007-08-15 14:28:22 +00001553.. _lambdas:
Georg Brandlc4f8b242009-04-10 08:17:21 +00001554.. _lambda:
Georg Brandl116aa622007-08-15 14:28:22 +00001555
1556Lambdas
1557=======
1558
1559.. index::
1560 pair: lambda; expression
1561 pair: lambda; form
1562 pair: anonymous; function
1563
1564.. productionlist::
Georg Brandl242e6a02013-10-06 10:28:39 +02001565 lambda_expr: "lambda" [`parameter_list`]: `expression`
1566 lambda_expr_nocond: "lambda" [`parameter_list`]: `expression_nocond`
Georg Brandl116aa622007-08-15 14:28:22 +00001567
Zachary Ware2f78b842014-06-03 09:32:40 -05001568Lambda expressions (sometimes called lambda forms) are used to create anonymous
Raymond Hettingeraa7886d2014-05-26 22:20:37 -07001569functions. The expression ``lambda arguments: expression`` yields a function
Martin Panter1050d2d2016-07-26 11:18:21 +02001570object. The unnamed object behaves like a function object defined with:
1571
1572.. code-block:: none
Georg Brandl116aa622007-08-15 14:28:22 +00001573
Georg Brandl96593ed2007-09-07 14:15:41 +00001574 def <lambda>(arguments):
Georg Brandl116aa622007-08-15 14:28:22 +00001575 return expression
1576
1577See section :ref:`function` for the syntax of parameter lists. Note that
Georg Brandl242e6a02013-10-06 10:28:39 +02001578functions created with lambda expressions cannot contain statements or
1579annotations.
Georg Brandl116aa622007-08-15 14:28:22 +00001580
Georg Brandl116aa622007-08-15 14:28:22 +00001581
1582.. _exprlists:
1583
1584Expression lists
1585================
1586
1587.. index:: pair: expression; list
1588
1589.. productionlist::
1590 expression_list: `expression` ( "," `expression` )* [","]
Martin Panter0c0da482016-06-12 01:46:50 +00001591 starred_list: `starred_item` ( "," `starred_item` )* [","]
1592 starred_expression: `expression` | ( `starred_item` "," )* [`starred_item`]
1593 starred_item: `expression` | "*" `or_expr`
Georg Brandl116aa622007-08-15 14:28:22 +00001594
1595.. index:: object: tuple
1596
Martin Panter0c0da482016-06-12 01:46:50 +00001597Except when part of a list or set display, an expression list
1598containing at least one comma yields a tuple. The length of
Georg Brandl116aa622007-08-15 14:28:22 +00001599the tuple is the number of expressions in the list. The expressions are
1600evaluated from left to right.
1601
Martin Panter0c0da482016-06-12 01:46:50 +00001602.. index::
1603 pair: iterable; unpacking
1604 single: *; in expression lists
1605
1606An asterisk ``*`` denotes :dfn:`iterable unpacking`. Its operand must be
1607an :term:`iterable`. The iterable is expanded into a sequence of items,
1608which are included in the new tuple, list, or set, at the site of
1609the unpacking.
1610
1611.. versionadded:: 3.5
1612 Iterable unpacking in expression lists, originally proposed by :pep:`448`.
1613
Georg Brandl116aa622007-08-15 14:28:22 +00001614.. index:: pair: trailing; comma
1615
1616The trailing comma is required only to create a single tuple (a.k.a. a
1617*singleton*); it is optional in all other cases. A single expression without a
1618trailing comma doesn't create a tuple, but rather yields the value of that
1619expression. (To create an empty tuple, use an empty pair of parentheses:
1620``()``.)
1621
1622
1623.. _evalorder:
1624
1625Evaluation order
1626================
1627
1628.. index:: pair: evaluation; order
1629
Georg Brandl96593ed2007-09-07 14:15:41 +00001630Python evaluates expressions from left to right. Notice that while evaluating
1631an assignment, the right-hand side is evaluated before the left-hand side.
Georg Brandl116aa622007-08-15 14:28:22 +00001632
1633In the following lines, expressions will be evaluated in the arithmetic order of
1634their suffixes::
1635
1636 expr1, expr2, expr3, expr4
1637 (expr1, expr2, expr3, expr4)
1638 {expr1: expr2, expr3: expr4}
1639 expr1 + expr2 * (expr3 - expr4)
Georg Brandl734e2682008-08-12 08:18:18 +00001640 expr1(expr2, expr3, *expr4, **expr5)
Georg Brandl116aa622007-08-15 14:28:22 +00001641 expr3, expr4 = expr1, expr2
1642
1643
1644.. _operator-summary:
1645
Ezio Melotti9f929bb2012-12-25 15:45:15 +02001646Operator precedence
1647===================
Georg Brandl116aa622007-08-15 14:28:22 +00001648
1649.. index:: pair: operator; precedence
1650
Raymond Hettingeraa7886d2014-05-26 22:20:37 -07001651The following table summarizes the operator precedence in Python, from lowest
Georg Brandl96593ed2007-09-07 14:15:41 +00001652precedence (least binding) to highest precedence (most binding). Operators in
Georg Brandl116aa622007-08-15 14:28:22 +00001653the same box have the same precedence. Unless the syntax is explicitly given,
1654operators are binary. Operators in the same box group left to right (except for
Raymond Hettingeraa7886d2014-05-26 22:20:37 -07001655exponentiation, which groups from right to left).
1656
1657Note that comparisons, membership tests, and identity tests, all have the same
1658precedence and have a left-to-right chaining feature as described in the
1659:ref:`comparisons` section.
Georg Brandl116aa622007-08-15 14:28:22 +00001660
Benjamin Petersonba01dd92009-02-20 04:02:38 +00001661
1662+-----------------------------------------------+-------------------------------------+
1663| Operator | Description |
1664+===============================================+=====================================+
1665| :keyword:`lambda` | Lambda expression |
1666+-----------------------------------------------+-------------------------------------+
Georg Brandl93dc9eb2010-03-14 10:56:14 +00001667| :keyword:`if` -- :keyword:`else` | Conditional expression |
1668+-----------------------------------------------+-------------------------------------+
Benjamin Petersonba01dd92009-02-20 04:02:38 +00001669| :keyword:`or` | Boolean OR |
1670+-----------------------------------------------+-------------------------------------+
1671| :keyword:`and` | Boolean AND |
1672+-----------------------------------------------+-------------------------------------+
Ezio Melotti9f929bb2012-12-25 15:45:15 +02001673| :keyword:`not` ``x`` | Boolean NOT |
Benjamin Petersonba01dd92009-02-20 04:02:38 +00001674+-----------------------------------------------+-------------------------------------+
Ezio Melotti9f929bb2012-12-25 15:45:15 +02001675| :keyword:`in`, :keyword:`not in`, | Comparisons, including membership |
Georg Brandl44ea77b2013-03-28 13:28:44 +01001676| :keyword:`is`, :keyword:`is not`, ``<``, | tests and identity tests |
Georg Brandla5ebc262009-06-03 07:26:22 +00001677| ``<=``, ``>``, ``>=``, ``!=``, ``==`` | |
Benjamin Petersonba01dd92009-02-20 04:02:38 +00001678+-----------------------------------------------+-------------------------------------+
1679| ``|`` | Bitwise OR |
1680+-----------------------------------------------+-------------------------------------+
1681| ``^`` | Bitwise XOR |
1682+-----------------------------------------------+-------------------------------------+
1683| ``&`` | Bitwise AND |
1684+-----------------------------------------------+-------------------------------------+
1685| ``<<``, ``>>`` | Shifts |
1686+-----------------------------------------------+-------------------------------------+
1687| ``+``, ``-`` | Addition and subtraction |
1688+-----------------------------------------------+-------------------------------------+
Benjamin Petersond51374e2014-04-09 23:55:56 -04001689| ``*``, ``@``, ``/``, ``//``, ``%`` | Multiplication, matrix |
1690| | multiplication division, |
1691| | remainder [#]_ |
Benjamin Petersonba01dd92009-02-20 04:02:38 +00001692+-----------------------------------------------+-------------------------------------+
1693| ``+x``, ``-x``, ``~x`` | Positive, negative, bitwise NOT |
1694+-----------------------------------------------+-------------------------------------+
1695| ``**`` | Exponentiation [#]_ |
1696+-----------------------------------------------+-------------------------------------+
Yury Selivanovf3e40fa2015-05-21 11:50:30 -04001697| ``await`` ``x`` | Await expression |
1698+-----------------------------------------------+-------------------------------------+
Benjamin Petersonba01dd92009-02-20 04:02:38 +00001699| ``x[index]``, ``x[index:index]``, | Subscription, slicing, |
1700| ``x(arguments...)``, ``x.attribute`` | call, attribute reference |
1701+-----------------------------------------------+-------------------------------------+
1702| ``(expressions...)``, | Binding or tuple display, |
1703| ``[expressions...]``, | list display, |
Ezio Melotti9f929bb2012-12-25 15:45:15 +02001704| ``{key: value...}``, | dictionary display, |
Brett Cannon925914f2010-11-21 19:58:24 +00001705| ``{expressions...}`` | set display |
Benjamin Petersonba01dd92009-02-20 04:02:38 +00001706+-----------------------------------------------+-------------------------------------+
1707
Georg Brandl116aa622007-08-15 14:28:22 +00001708
1709.. rubric:: Footnotes
1710
Georg Brandl116aa622007-08-15 14:28:22 +00001711.. [#] While ``abs(x%y) < abs(y)`` is true mathematically, for floats it may not be
1712 true numerically due to roundoff. For example, and assuming a platform on which
1713 a Python float is an IEEE 754 double-precision number, in order that ``-1e-100 %
1714 1e100`` have the same sign as ``1e100``, the computed result is ``-1e-100 +
Georg Brandl063f2372010-12-01 15:32:43 +00001715 1e100``, which is numerically exactly equal to ``1e100``. The function
1716 :func:`math.fmod` returns a result whose sign matches the sign of the
Georg Brandl116aa622007-08-15 14:28:22 +00001717 first argument instead, and so returns ``-1e-100`` in this case. Which approach
1718 is more appropriate depends on the application.
1719
1720.. [#] If x is very close to an exact integer multiple of y, it's possible for
Georg Brandl96593ed2007-09-07 14:15:41 +00001721 ``x//y`` to be one larger than ``(x-x%y)//y`` due to rounding. In such
Georg Brandl116aa622007-08-15 14:28:22 +00001722 cases, Python returns the latter result, in order to preserve that
1723 ``divmod(x,y)[0] * y + x % y`` be very close to ``x``.
1724
Martin Panteraa0da862015-09-23 05:28:13 +00001725.. [#] The Unicode standard distinguishes between :dfn:`code points`
1726 (e.g. U+0041) and :dfn:`abstract characters` (e.g. "LATIN CAPITAL LETTER A").
1727 While most abstract characters in Unicode are only represented using one
1728 code point, there is a number of abstract characters that can in addition be
1729 represented using a sequence of more than one code point. For example, the
1730 abstract character "LATIN CAPITAL LETTER C WITH CEDILLA" can be represented
1731 as a single :dfn:`precomposed character` at code position U+00C7, or as a
1732 sequence of a :dfn:`base character` at code position U+0043 (LATIN CAPITAL
1733 LETTER C), followed by a :dfn:`combining character` at code position U+0327
1734 (COMBINING CEDILLA).
1735
1736 The comparison operators on strings compare at the level of Unicode code
1737 points. This may be counter-intuitive to humans. For example,
1738 ``"\u00C7" == "\u0043\u0327"`` is ``False``, even though both strings
1739 represent the same abstract character "LATIN CAPITAL LETTER C WITH CEDILLA".
1740
1741 To compare strings at the level of abstract characters (that is, in a way
1742 intuitive to humans), use :func:`unicodedata.normalize`.
Guido van Rossumda27fd22007-08-17 00:24:54 +00001743
Georg Brandl48310cd2009-01-03 21:18:54 +00001744.. [#] Due to automatic garbage-collection, free lists, and the dynamic nature of
Benjamin Peterson41181742008-07-02 20:22:54 +00001745 descriptors, you may notice seemingly unusual behaviour in certain uses of
1746 the :keyword:`is` operator, like those involving comparisons between instance
1747 methods, or constants. Check their documentation for more info.
Benjamin Petersonba01dd92009-02-20 04:02:38 +00001748
Georg Brandl063f2372010-12-01 15:32:43 +00001749.. [#] The ``%`` operator is also used for string formatting; the same
1750 precedence applies.
Georg Brandlf1d633c2010-09-20 06:29:01 +00001751
Benjamin Petersonba01dd92009-02-20 04:02:38 +00001752.. [#] The power operator ``**`` binds less tightly than an arithmetic or
1753 bitwise unary operator on its right, that is, ``2**-1`` is ``0.5``.