blob: f22af8b44a11277801a85ae315ba36e952920f49 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001.. _compound:
2
3*******************
4Compound statements
5*******************
6
7.. index:: pair: compound; statement
8
9Compound statements contain (groups of) other statements; they affect or control
10the execution of those other statements in some way. In general, compound
11statements span multiple lines, although in simple incarnations a whole compound
12statement may be contained in one line.
13
14The :keyword:`if`, :keyword:`while` and :keyword:`for` statements implement
15traditional control flow constructs. :keyword:`try` specifies exception
Georg Brandl02c30562007-09-07 17:52:53 +000016handlers and/or cleanup code for a group of statements, while the
17:keyword:`with` statement allows the execution of initialization and
18finalization code around a block of code. Function and class definitions are
19also syntactically compound statements.
Georg Brandl116aa622007-08-15 14:28:22 +000020
21.. index::
22 single: clause
23 single: suite
Serhiy Storchaka913876d2018-10-28 13:41:26 +020024 single: ; (semicolon)
Georg Brandl116aa622007-08-15 14:28:22 +000025
Raymond Hettingeraa7886d2014-05-26 22:20:37 -070026A compound statement consists of one or more 'clauses.' A clause consists of a
Georg Brandl116aa622007-08-15 14:28:22 +000027header and a 'suite.' The clause headers of a particular compound statement are
28all at the same indentation level. Each clause header begins with a uniquely
29identifying keyword and ends with a colon. A suite is a group of statements
30controlled by a clause. A suite can be one or more semicolon-separated simple
31statements on the same line as the header, following the header's colon, or it
32can be one or more indented statements on subsequent lines. Only the latter
Raymond Hettingeraa7886d2014-05-26 22:20:37 -070033form of a suite can contain nested compound statements; the following is illegal,
Georg Brandl116aa622007-08-15 14:28:22 +000034mostly because it wouldn't be clear to which :keyword:`if` clause a following
Georg Brandl02c30562007-09-07 17:52:53 +000035:keyword:`else` clause would belong::
Georg Brandl116aa622007-08-15 14:28:22 +000036
Georg Brandl6911e3c2007-09-04 07:15:32 +000037 if test1: if test2: print(x)
Georg Brandl116aa622007-08-15 14:28:22 +000038
39Also note that the semicolon binds tighter than the colon in this context, so
Georg Brandl6911e3c2007-09-04 07:15:32 +000040that in the following example, either all or none of the :func:`print` calls are
41executed::
Georg Brandl116aa622007-08-15 14:28:22 +000042
Georg Brandl6911e3c2007-09-04 07:15:32 +000043 if x < y < z: print(x); print(y); print(z)
Georg Brandl116aa622007-08-15 14:28:22 +000044
45Summarizing:
46
Victor Stinner8af239e2020-09-18 09:10:15 +020047
48.. productionlist:: python-grammar
Georg Brandl116aa622007-08-15 14:28:22 +000049 compound_stmt: `if_stmt`
50 : | `while_stmt`
51 : | `for_stmt`
52 : | `try_stmt`
53 : | `with_stmt`
54 : | `funcdef`
55 : | `classdef`
Yury Selivanovf3e40fa2015-05-21 11:50:30 -040056 : | `async_with_stmt`
57 : | `async_for_stmt`
58 : | `async_funcdef`
Georg Brandl116aa622007-08-15 14:28:22 +000059 suite: `stmt_list` NEWLINE | NEWLINE INDENT `statement`+ DEDENT
60 statement: `stmt_list` NEWLINE | `compound_stmt`
61 stmt_list: `simple_stmt` (";" `simple_stmt`)* [";"]
62
63.. index::
64 single: NEWLINE token
65 single: DEDENT token
66 pair: dangling; else
67
68Note that statements always end in a ``NEWLINE`` possibly followed by a
Georg Brandl02c30562007-09-07 17:52:53 +000069``DEDENT``. Also note that optional continuation clauses always begin with a
Georg Brandl116aa622007-08-15 14:28:22 +000070keyword that cannot start a statement, thus there are no ambiguities (the
71'dangling :keyword:`else`' problem is solved in Python by requiring nested
72:keyword:`if` statements to be indented).
73
74The formatting of the grammar rules in the following sections places each clause
75on a separate line for clarity.
76
77
78.. _if:
Christian Heimes5b5e81c2007-12-31 16:14:33 +000079.. _elif:
80.. _else:
Georg Brandl116aa622007-08-15 14:28:22 +000081
Serhiy Storchaka2b57c432018-12-19 08:09:46 +020082The :keyword:`!if` statement
83============================
Georg Brandl116aa622007-08-15 14:28:22 +000084
Christian Heimesfaf2f632008-01-06 16:59:19 +000085.. index::
Serhiy Storchaka2b57c432018-12-19 08:09:46 +020086 ! statement: if
Christian Heimesfaf2f632008-01-06 16:59:19 +000087 keyword: elif
88 keyword: else
Serhiy Storchaka913876d2018-10-28 13:41:26 +020089 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +000090
91The :keyword:`if` statement is used for conditional execution:
92
Victor Stinner8af239e2020-09-18 09:10:15 +020093.. productionlist:: python-grammar
Brandt Bucher8bae2192020-03-05 21:19:22 -080094 if_stmt: "if" `assignment_expression` ":" `suite`
95 : ("elif" `assignment_expression` ":" `suite`)*
Georg Brandl116aa622007-08-15 14:28:22 +000096 : ["else" ":" `suite`]
97
Georg Brandl116aa622007-08-15 14:28:22 +000098It selects exactly one of the suites by evaluating the expressions one by one
99until one is found to be true (see section :ref:`booleans` for the definition of
100true and false); then that suite is executed (and no other part of the
101:keyword:`if` statement is executed or evaluated). If all expressions are
102false, the suite of the :keyword:`else` clause, if present, is executed.
103
104
105.. _while:
106
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200107The :keyword:`!while` statement
108===============================
Georg Brandl116aa622007-08-15 14:28:22 +0000109
110.. index::
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200111 ! statement: while
Georg Brandl02c30562007-09-07 17:52:53 +0000112 keyword: else
Georg Brandl116aa622007-08-15 14:28:22 +0000113 pair: loop; statement
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200114 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +0000115
116The :keyword:`while` statement is used for repeated execution as long as an
117expression is true:
118
Victor Stinner8af239e2020-09-18 09:10:15 +0200119.. productionlist:: python-grammar
Brandt Bucher8bae2192020-03-05 21:19:22 -0800120 while_stmt: "while" `assignment_expression` ":" `suite`
Georg Brandl116aa622007-08-15 14:28:22 +0000121 : ["else" ":" `suite`]
122
Georg Brandl116aa622007-08-15 14:28:22 +0000123This repeatedly tests the expression and, if it is true, executes the first
124suite; if the expression is false (which may be the first time it is tested) the
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200125suite of the :keyword:`!else` clause, if present, is executed and the loop
Georg Brandl116aa622007-08-15 14:28:22 +0000126terminates.
127
128.. index::
129 statement: break
130 statement: continue
131
132A :keyword:`break` statement executed in the first suite terminates the loop
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200133without executing the :keyword:`!else` clause's suite. A :keyword:`continue`
Georg Brandl116aa622007-08-15 14:28:22 +0000134statement executed in the first suite skips the rest of the suite and goes back
135to testing the expression.
136
137
138.. _for:
139
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200140The :keyword:`!for` statement
141=============================
Georg Brandl116aa622007-08-15 14:28:22 +0000142
143.. index::
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200144 ! statement: for
Georg Brandl02c30562007-09-07 17:52:53 +0000145 keyword: in
146 keyword: else
147 pair: target; list
Georg Brandl116aa622007-08-15 14:28:22 +0000148 pair: loop; statement
Georg Brandl02c30562007-09-07 17:52:53 +0000149 object: sequence
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200150 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +0000151
152The :keyword:`for` statement is used to iterate over the elements of a sequence
153(such as a string, tuple or list) or other iterable object:
154
Victor Stinner8af239e2020-09-18 09:10:15 +0200155.. productionlist:: python-grammar
Georg Brandl116aa622007-08-15 14:28:22 +0000156 for_stmt: "for" `target_list` "in" `expression_list` ":" `suite`
157 : ["else" ":" `suite`]
158
Georg Brandl116aa622007-08-15 14:28:22 +0000159The expression list is evaluated once; it should yield an iterable object. An
160iterator is created for the result of the ``expression_list``. The suite is
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700161then executed once for each item provided by the iterator, in the order returned
162by the iterator. Each item in turn is assigned to the target list using the
Georg Brandl02c30562007-09-07 17:52:53 +0000163standard rules for assignments (see :ref:`assignment`), and then the suite is
164executed. When the items are exhausted (which is immediately when the sequence
165is empty or an iterator raises a :exc:`StopIteration` exception), the suite in
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200166the :keyword:`!else` clause, if present, is executed, and the loop terminates.
Georg Brandl116aa622007-08-15 14:28:22 +0000167
168.. index::
169 statement: break
170 statement: continue
171
172A :keyword:`break` statement executed in the first suite terminates the loop
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200173without executing the :keyword:`!else` clause's suite. A :keyword:`continue`
Georg Brandl116aa622007-08-15 14:28:22 +0000174statement executed in the first suite skips the rest of the suite and continues
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200175with the next item, or with the :keyword:`!else` clause if there is no next
Georg Brandl116aa622007-08-15 14:28:22 +0000176item.
177
Andrés Delfinoe42b7052018-07-26 12:35:23 -0300178The for-loop makes assignments to the variables in the target list.
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700179This overwrites all previous assignments to those variables including
180those made in the suite of the for-loop::
181
182 for i in range(10):
183 print(i)
184 i = 5 # this will not affect the for-loop
Zachary Ware2f78b842014-06-03 09:32:40 -0500185 # because i will be overwritten with the next
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700186 # index in the range
187
Georg Brandl116aa622007-08-15 14:28:22 +0000188
189.. index::
190 builtin: range
Georg Brandl116aa622007-08-15 14:28:22 +0000191
Georg Brandl02c30562007-09-07 17:52:53 +0000192Names in the target list are not deleted when the loop is finished, but if the
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700193sequence is empty, they will not have been assigned to at all by the loop. Hint:
Georg Brandl02c30562007-09-07 17:52:53 +0000194the built-in function :func:`range` returns an iterator of integers suitable to
Benjamin Peterson3db5e7b2009-06-03 03:13:30 +0000195emulate the effect of Pascal's ``for i := a to b do``; e.g., ``list(range(3))``
Georg Brandl02c30562007-09-07 17:52:53 +0000196returns the list ``[0, 1, 2]``.
Georg Brandl116aa622007-08-15 14:28:22 +0000197
Georg Brandle720c0a2009-04-27 16:20:50 +0000198.. note::
Georg Brandl116aa622007-08-15 14:28:22 +0000199
200 .. index::
201 single: loop; over mutable sequence
202 single: mutable sequence; loop over
203
204 There is a subtlety when the sequence is being modified by the loop (this can
Andrés Delfino6921ef72018-07-30 15:44:35 -0300205 only occur for mutable sequences, e.g. lists). An internal counter is used
Georg Brandl02c30562007-09-07 17:52:53 +0000206 to keep track of which item is used next, and this is incremented on each
Georg Brandl116aa622007-08-15 14:28:22 +0000207 iteration. When this counter has reached the length of the sequence the loop
208 terminates. This means that if the suite deletes the current (or a previous)
Georg Brandl02c30562007-09-07 17:52:53 +0000209 item from the sequence, the next item will be skipped (since it gets the
210 index of the current item which has already been treated). Likewise, if the
211 suite inserts an item in the sequence before the current item, the current
212 item will be treated again the next time through the loop. This can lead to
213 nasty bugs that can be avoided by making a temporary copy using a slice of
214 the whole sequence, e.g., ::
Georg Brandl116aa622007-08-15 14:28:22 +0000215
Georg Brandl02c30562007-09-07 17:52:53 +0000216 for x in a[:]:
217 if x < 0: a.remove(x)
Georg Brandl116aa622007-08-15 14:28:22 +0000218
219
220.. _try:
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000221.. _except:
222.. _finally:
Georg Brandl116aa622007-08-15 14:28:22 +0000223
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200224The :keyword:`!try` statement
225=============================
Georg Brandl116aa622007-08-15 14:28:22 +0000226
Christian Heimesfaf2f632008-01-06 16:59:19 +0000227.. index::
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200228 ! statement: try
Christian Heimesfaf2f632008-01-06 16:59:19 +0000229 keyword: except
230 keyword: finally
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300231 keyword: else
232 keyword: as
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200233 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +0000234
235The :keyword:`try` statement specifies exception handlers and/or cleanup code
236for a group of statements:
237
Victor Stinner8af239e2020-09-18 09:10:15 +0200238.. productionlist:: python-grammar
Andrés Delfinocaccca782018-07-07 17:24:46 -0300239 try_stmt: `try1_stmt` | `try2_stmt`
Georg Brandl116aa622007-08-15 14:28:22 +0000240 try1_stmt: "try" ":" `suite`
Terry Jan Reedy65e3ecb2014-08-23 19:29:47 -0400241 : ("except" [`expression` ["as" `identifier`]] ":" `suite`)+
Georg Brandl116aa622007-08-15 14:28:22 +0000242 : ["else" ":" `suite`]
243 : ["finally" ":" `suite`]
244 try2_stmt: "try" ":" `suite`
245 : "finally" ":" `suite`
246
Christian Heimesfaf2f632008-01-06 16:59:19 +0000247
248The :keyword:`except` clause(s) specify one or more exception handlers. When no
Georg Brandl116aa622007-08-15 14:28:22 +0000249exception occurs in the :keyword:`try` clause, no exception handler is executed.
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200250When an exception occurs in the :keyword:`!try` suite, a search for an exception
Georg Brandl116aa622007-08-15 14:28:22 +0000251handler is started. This search inspects the except clauses in turn until one
252is found that matches the exception. An expression-less except clause, if
253present, must be last; it matches any exception. For an except clause with an
254expression, that expression is evaluated, and the clause matches the exception
255if the resulting object is "compatible" with the exception. An object is
256compatible with an exception if it is the class or a base class of the exception
Colin Watsonc95f8bc2020-12-20 18:24:10 +0000257object, or a tuple containing an item that is the class or a base class of
258the exception object.
Georg Brandl116aa622007-08-15 14:28:22 +0000259
260If no except clause matches the exception, the search for an exception handler
261continues in the surrounding code and on the invocation stack. [#]_
262
263If the evaluation of an expression in the header of an except clause raises an
264exception, the original search for a handler is canceled and a search starts for
265the new exception in the surrounding code and on the call stack (it is treated
266as if the entire :keyword:`try` statement raised the exception).
267
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300268.. index:: single: as; except clause
269
Georg Brandl116aa622007-08-15 14:28:22 +0000270When a matching except clause is found, the exception is assigned to the target
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200271specified after the :keyword:`!as` keyword in that except clause, if present, and
Georg Brandl02c30562007-09-07 17:52:53 +0000272the except clause's suite is executed. All except clauses must have an
273executable block. When the end of this block is reached, execution continues
274normally after the entire try statement. (This means that if two nested
275handlers exist for the same exception, and the exception occurs in the try
276clause of the inner handler, the outer handler will not handle the exception.)
277
278When an exception has been assigned using ``as target``, it is cleared at the
279end of the except clause. This is as if ::
280
281 except E as N:
282 foo
283
284was translated to ::
285
286 except E as N:
287 try:
288 foo
289 finally:
Georg Brandl02c30562007-09-07 17:52:53 +0000290 del N
291
Benjamin Petersonfb288da2010-06-29 01:27:35 +0000292This means the exception must be assigned to a different name to be able to
293refer to it after the except clause. Exceptions are cleared because with the
294traceback attached to them, they form a reference cycle with the stack frame,
295keeping all locals in that frame alive until the next garbage collection occurs.
Georg Brandl116aa622007-08-15 14:28:22 +0000296
297.. index::
298 module: sys
299 object: traceback
300
301Before an except clause's suite is executed, details about the exception are
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700302stored in the :mod:`sys` module and can be accessed via :func:`sys.exc_info`.
Georg Brandlb30f3302011-01-06 09:23:56 +0000303:func:`sys.exc_info` returns a 3-tuple consisting of the exception class, the
304exception instance and a traceback object (see section :ref:`types`) identifying
Géry Ogamd515c612020-12-21 14:13:08 +0100305the point in the program where the exception occurred. The details about the
306exception accessed via :func:`sys.exc_info` are restored to their previous values
307when leaving an exception handler::
308
309 >>> print(sys.exc_info())
310 (None, None, None)
311 >>> try:
312 ... raise TypeError
313 ... except:
314 ... print(sys.exc_info())
315 ... try:
316 ... raise ValueError
317 ... except:
318 ... print(sys.exc_info())
319 ... print(sys.exc_info())
320 ...
321 (<class 'TypeError'>, TypeError(), <traceback object at 0x10efad080>)
322 (<class 'ValueError'>, ValueError(), <traceback object at 0x10efad040>)
323 (<class 'TypeError'>, TypeError(), <traceback object at 0x10efad080>)
324 >>> print(sys.exc_info())
325 (None, None, None)
Georg Brandl116aa622007-08-15 14:28:22 +0000326
327.. index::
328 keyword: else
329 statement: return
330 statement: break
331 statement: continue
332
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200333The optional :keyword:`!else` clause is executed if the control flow leaves the
Andrés Delfinob086c8a2018-11-11 16:33:51 -0300334:keyword:`try` suite, no exception was raised, and no :keyword:`return`,
335:keyword:`continue`, or :keyword:`break` statement was executed. Exceptions in
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200336the :keyword:`!else` clause are not handled by the preceding :keyword:`except`
Andrés Delfinob086c8a2018-11-11 16:33:51 -0300337clauses.
Georg Brandl116aa622007-08-15 14:28:22 +0000338
339.. index:: keyword: finally
340
341If :keyword:`finally` is present, it specifies a 'cleanup' handler. The
342:keyword:`try` clause is executed, including any :keyword:`except` and
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200343:keyword:`!else` clauses. If an exception occurs in any of the clauses and is
344not handled, the exception is temporarily saved. The :keyword:`!finally` clause
Mark Dickinson05ee5812012-09-24 20:16:38 +0100345is executed. If there is a saved exception it is re-raised at the end of the
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200346:keyword:`!finally` clause. If the :keyword:`!finally` clause raises another
Mark Dickinson05ee5812012-09-24 20:16:38 +0100347exception, the saved exception is set as the context of the new exception.
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200348If the :keyword:`!finally` clause executes a :keyword:`return`, :keyword:`break`
Serhiy Storchakafe2bbb12018-03-18 09:56:52 +0200349or :keyword:`continue` statement, the saved exception is discarded::
Andrew Svetlovf158d862012-08-14 15:38:15 +0300350
Zachary Ware9fafc9f2014-05-06 09:18:17 -0500351 >>> def f():
352 ... try:
353 ... 1/0
354 ... finally:
355 ... return 42
356 ...
357 >>> f()
358 42
Andrew Svetlovf158d862012-08-14 15:38:15 +0300359
360The exception information is not available to the program during execution of
361the :keyword:`finally` clause.
Georg Brandl116aa622007-08-15 14:28:22 +0000362
363.. index::
364 statement: return
365 statement: break
366 statement: continue
367
368When a :keyword:`return`, :keyword:`break` or :keyword:`continue` statement is
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200369executed in the :keyword:`try` suite of a :keyword:`!try`...\ :keyword:`!finally`
Serhiy Storchakafe2bbb12018-03-18 09:56:52 +0200370statement, the :keyword:`finally` clause is also executed 'on the way out.'
Georg Brandl116aa622007-08-15 14:28:22 +0000371
Zachary Ware8edd5322014-05-06 09:07:13 -0500372The return value of a function is determined by the last :keyword:`return`
373statement executed. Since the :keyword:`finally` clause always executes, a
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200374:keyword:`!return` statement executed in the :keyword:`!finally` clause will
Zachary Ware8edd5322014-05-06 09:07:13 -0500375always be the last one executed::
376
377 >>> def foo():
378 ... try:
379 ... return 'try'
380 ... finally:
381 ... return 'finally'
382 ...
383 >>> foo()
384 'finally'
385
Georg Brandl116aa622007-08-15 14:28:22 +0000386Additional information on exceptions can be found in section :ref:`exceptions`,
387and information on using the :keyword:`raise` statement to generate exceptions
388may be found in section :ref:`raise`.
389
Serhiy Storchakafe2bbb12018-03-18 09:56:52 +0200390.. versionchanged:: 3.8
391 Prior to Python 3.8, a :keyword:`continue` statement was illegal in the
392 :keyword:`finally` clause due to a problem with the implementation.
393
Georg Brandl116aa622007-08-15 14:28:22 +0000394
395.. _with:
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000396.. _as:
Georg Brandl116aa622007-08-15 14:28:22 +0000397
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200398The :keyword:`!with` statement
399==============================
Georg Brandl116aa622007-08-15 14:28:22 +0000400
Terry Jan Reedy7c895ed2014-04-29 00:58:56 -0400401.. index::
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200402 ! statement: with
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300403 keyword: as
404 single: as; with statement
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200405 single: , (comma); with statement
406 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +0000407
Georg Brandl116aa622007-08-15 14:28:22 +0000408The :keyword:`with` statement is used to wrap the execution of a block with
Georg Brandl02c30562007-09-07 17:52:53 +0000409methods defined by a context manager (see section :ref:`context-managers`).
410This allows common :keyword:`try`...\ :keyword:`except`...\ :keyword:`finally`
411usage patterns to be encapsulated for convenient reuse.
Georg Brandl116aa622007-08-15 14:28:22 +0000412
Victor Stinner8af239e2020-09-18 09:10:15 +0200413.. productionlist:: python-grammar
Pablo Galindo7c8e0b02021-01-25 23:15:51 +0000414 with_stmt: "with" ( "(" `with_stmt_contents` ","? ")" | `with_stmt_contents` ) ":" `suite`
415 with_stmt_contents: `with_item` ("," `with_item`)*
Georg Brandl0c315622009-05-25 21:10:36 +0000416 with_item: `expression` ["as" `target`]
Georg Brandl116aa622007-08-15 14:28:22 +0000417
Georg Brandl0c315622009-05-25 21:10:36 +0000418The execution of the :keyword:`with` statement with one "item" proceeds as follows:
Georg Brandl116aa622007-08-15 14:28:22 +0000419
Georg Brandl3387f482010-09-03 22:40:02 +0000420#. The context expression (the expression given in the :token:`with_item`) is
421 evaluated to obtain a context manager.
Georg Brandl116aa622007-08-15 14:28:22 +0000422
Géry Ogam226e6e72019-12-30 05:24:51 +0000423#. The context manager's :meth:`__enter__` is loaded for later use.
424
Benjamin Peterson876b2f22009-06-28 03:18:59 +0000425#. The context manager's :meth:`__exit__` is loaded for later use.
426
Georg Brandl116aa622007-08-15 14:28:22 +0000427#. The context manager's :meth:`__enter__` method is invoked.
428
429#. If a target was included in the :keyword:`with` statement, the return value
430 from :meth:`__enter__` is assigned to it.
431
432 .. note::
433
Georg Brandl02c30562007-09-07 17:52:53 +0000434 The :keyword:`with` statement guarantees that if the :meth:`__enter__`
435 method returns without an error, then :meth:`__exit__` will always be
Benjamin Peterson876b2f22009-06-28 03:18:59 +0000436 called. Thus, if an error occurs during the assignment to the target list,
437 it will be treated the same as an error occurring within the suite would
438 be. See step 6 below.
Georg Brandl116aa622007-08-15 14:28:22 +0000439
440#. The suite is executed.
441
Georg Brandl02c30562007-09-07 17:52:53 +0000442#. The context manager's :meth:`__exit__` method is invoked. If an exception
Georg Brandl116aa622007-08-15 14:28:22 +0000443 caused the suite to be exited, its type, value, and traceback are passed as
444 arguments to :meth:`__exit__`. Otherwise, three :const:`None` arguments are
445 supplied.
446
447 If the suite was exited due to an exception, and the return value from the
Georg Brandl02c30562007-09-07 17:52:53 +0000448 :meth:`__exit__` method was false, the exception is reraised. If the return
Georg Brandl116aa622007-08-15 14:28:22 +0000449 value was true, the exception is suppressed, and execution continues with the
450 statement following the :keyword:`with` statement.
451
Georg Brandl02c30562007-09-07 17:52:53 +0000452 If the suite was exited for any reason other than an exception, the return
453 value from :meth:`__exit__` is ignored, and execution proceeds at the normal
454 location for the kind of exit that was taken.
Georg Brandl116aa622007-08-15 14:28:22 +0000455
Géry Ogam226e6e72019-12-30 05:24:51 +0000456The following code::
457
458 with EXPRESSION as TARGET:
459 SUITE
460
461is semantically equivalent to::
462
463 manager = (EXPRESSION)
464 enter = type(manager).__enter__
465 exit = type(manager).__exit__
466 value = enter(manager)
467 hit_except = False
468
469 try:
470 TARGET = value
471 SUITE
472 except:
473 hit_except = True
474 if not exit(manager, *sys.exc_info()):
475 raise
476 finally:
477 if not hit_except:
478 exit(manager, None, None, None)
479
Georg Brandl0c315622009-05-25 21:10:36 +0000480With more than one item, the context managers are processed as if multiple
481:keyword:`with` statements were nested::
482
483 with A() as a, B() as b:
Géry Ogam226e6e72019-12-30 05:24:51 +0000484 SUITE
Georg Brandl0c315622009-05-25 21:10:36 +0000485
Géry Ogam226e6e72019-12-30 05:24:51 +0000486is semantically equivalent to::
Georg Brandl0c315622009-05-25 21:10:36 +0000487
488 with A() as a:
489 with B() as b:
Géry Ogam226e6e72019-12-30 05:24:51 +0000490 SUITE
Georg Brandl0c315622009-05-25 21:10:36 +0000491
Pablo Galindo7c8e0b02021-01-25 23:15:51 +0000492You can also write multi-item context managers in multiple lines if
493the items are surrounded by parentheses. For example::
494
495 with (
496 A() as a,
497 B() as b,
498 ):
499 SUITE
500
Georg Brandl0c315622009-05-25 21:10:36 +0000501.. versionchanged:: 3.1
502 Support for multiple context expressions.
503
Pablo Galindo7c8e0b02021-01-25 23:15:51 +0000504.. versionchanged:: 3.10
505 Support for using grouping parentheses to break the statement in multiple lines.
506
Georg Brandl116aa622007-08-15 14:28:22 +0000507.. seealso::
508
Serhiy Storchakae4ba8722016-03-31 15:30:54 +0300509 :pep:`343` - The "with" statement
Georg Brandl116aa622007-08-15 14:28:22 +0000510 The specification, background, and examples for the Python :keyword:`with`
511 statement.
512
513
Chris Jerdonekb4309942012-12-25 14:54:44 -0800514.. index::
515 single: parameter; function definition
516
Georg Brandl116aa622007-08-15 14:28:22 +0000517.. _function:
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000518.. _def:
Georg Brandl116aa622007-08-15 14:28:22 +0000519
520Function definitions
521====================
522
523.. index::
Georg Brandl116aa622007-08-15 14:28:22 +0000524 statement: def
Christian Heimesfaf2f632008-01-06 16:59:19 +0000525 pair: function; definition
526 pair: function; name
527 pair: name; binding
Georg Brandl116aa622007-08-15 14:28:22 +0000528 object: user-defined function
529 object: function
Georg Brandl02c30562007-09-07 17:52:53 +0000530 pair: function; name
531 pair: name; binding
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200532 single: () (parentheses); function definition
533 single: , (comma); parameter list
534 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +0000535
536A function definition defines a user-defined function object (see section
537:ref:`types`):
538
Victor Stinner8af239e2020-09-18 09:10:15 +0200539.. productionlist:: python-grammar
Andrés Delfinocaccca782018-07-07 17:24:46 -0300540 funcdef: [`decorators`] "def" `funcname` "(" [`parameter_list`] ")"
541 : ["->" `expression`] ":" `suite`
Georg Brandl116aa622007-08-15 14:28:22 +0000542 decorators: `decorator`+
Brandt Bucher8f130532020-03-07 10:23:49 -0800543 decorator: "@" `assignment_expression` NEWLINE
Georg Brandl116aa622007-08-15 14:28:22 +0000544 dotted_name: `identifier` ("." `identifier`)*
Pablo Galindo29cb21d2019-05-29 22:59:00 +0100545 parameter_list: `defparameter` ("," `defparameter`)* "," "/" ["," [`parameter_list_no_posonly`]]
Pablo Galindob76302d2019-05-29 00:45:32 +0100546 : | `parameter_list_no_posonly`
547 parameter_list_no_posonly: `defparameter` ("," `defparameter`)* ["," [`parameter_list_starargs`]]
548 : | `parameter_list_starargs`
Robert Collinsdf395992015-08-12 08:00:06 +1200549 parameter_list_starargs: "*" [`parameter`] ("," `defparameter`)* ["," ["**" `parameter` [","]]]
Andrés Delfinocaccca782018-07-07 17:24:46 -0300550 : | "**" `parameter` [","]
Georg Brandl116aa622007-08-15 14:28:22 +0000551 parameter: `identifier` [":" `expression`]
552 defparameter: `parameter` ["=" `expression`]
553 funcname: `identifier`
554
Georg Brandl116aa622007-08-15 14:28:22 +0000555
556A function definition is an executable statement. Its execution binds the
557function name in the current local namespace to a function object (a wrapper
558around the executable code for the function). This function object contains a
559reference to the current global namespace as the global namespace to be used
560when the function is called.
561
562The function definition does not execute the function body; this gets executed
Georg Brandl3dbca812008-07-23 16:10:53 +0000563only when the function is called. [#]_
Georg Brandl116aa622007-08-15 14:28:22 +0000564
Christian Heimesdae2a892008-04-19 00:55:37 +0000565.. index::
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200566 single: @ (at); function definition
Christian Heimesdae2a892008-04-19 00:55:37 +0000567
Christian Heimesd8654cf2007-12-02 15:22:16 +0000568A function definition may be wrapped by one or more :term:`decorator` expressions.
Georg Brandl116aa622007-08-15 14:28:22 +0000569Decorator expressions are evaluated when the function is defined, in the scope
570that contains the function definition. The result must be a callable, which is
571invoked with the function object as the only argument. The returned value is
572bound to the function name instead of the function object. Multiple decorators
Georg Brandl02c30562007-09-07 17:52:53 +0000573are applied in nested fashion. For example, the following code ::
Georg Brandl116aa622007-08-15 14:28:22 +0000574
575 @f1(arg)
576 @f2
577 def func(): pass
578
Berker Peksag6cafece2016-08-03 10:17:21 +0300579is roughly equivalent to ::
Georg Brandl116aa622007-08-15 14:28:22 +0000580
581 def func(): pass
582 func = f1(arg)(f2(func))
583
Berker Peksag6cafece2016-08-03 10:17:21 +0300584except that the original function is not temporarily bound to the name ``func``.
585
Brandt Bucher8f130532020-03-07 10:23:49 -0800586.. versionchanged:: 3.9
587 Functions may be decorated with any valid :token:`assignment_expression`.
588 Previously, the grammar was much more restrictive; see :pep:`614` for
589 details.
590
Chris Jerdonekb4309942012-12-25 14:54:44 -0800591.. index::
592 triple: default; parameter; value
593 single: argument; function definition
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200594 single: = (equals); function definition
Georg Brandl116aa622007-08-15 14:28:22 +0000595
Chris Jerdonekb4309942012-12-25 14:54:44 -0800596When one or more :term:`parameters <parameter>` have the form *parameter* ``=``
597*expression*, the function is said to have "default parameter values." For a
598parameter with a default value, the corresponding :term:`argument` may be
599omitted from a call, in which
Georg Brandl116aa622007-08-15 14:28:22 +0000600case the parameter's default value is substituted. If a parameter has a default
Georg Brandl02c30562007-09-07 17:52:53 +0000601value, all following parameters up until the "``*``" must also have a default
602value --- this is a syntactic restriction that is not expressed by the grammar.
Georg Brandl116aa622007-08-15 14:28:22 +0000603
Benjamin Peterson1ef876c2013-02-10 09:29:59 -0500604**Default parameter values are evaluated from left to right when the function
605definition is executed.** This means that the expression is evaluated once, when
606the function is defined, and that the same "pre-computed" value is used for each
Andre Delfinob9f6ac92020-07-22 20:58:19 -0300607call. This is especially important to understand when a default parameter value is a
Benjamin Peterson1ef876c2013-02-10 09:29:59 -0500608mutable object, such as a list or a dictionary: if the function modifies the
Andre Delfinob9f6ac92020-07-22 20:58:19 -0300609object (e.g. by appending an item to a list), the default parameter value is in effect
Benjamin Peterson1ef876c2013-02-10 09:29:59 -0500610modified. This is generally not what was intended. A way around this is to use
611``None`` as the default, and explicitly test for it in the body of the function,
612e.g.::
Georg Brandl116aa622007-08-15 14:28:22 +0000613
614 def whats_on_the_telly(penguin=None):
615 if penguin is None:
616 penguin = []
617 penguin.append("property of the zoo")
618 return penguin
619
Christian Heimesdae2a892008-04-19 00:55:37 +0000620.. index::
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200621 single: * (asterisk); function definition
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300622 single: **; function definition
Christian Heimesdae2a892008-04-19 00:55:37 +0000623
624Function call semantics are described in more detail in section :ref:`calls`. A
Georg Brandl116aa622007-08-15 14:28:22 +0000625function call always assigns values to all parameters mentioned in the parameter
626list, either from position arguments, from keyword arguments, or from default
627values. If the form "``*identifier``" is present, it is initialized to a tuple
Eric Snowb957b0c2016-09-08 13:59:58 -0700628receiving any excess positional parameters, defaulting to the empty tuple.
629If the form "``**identifier``" is present, it is initialized to a new
630ordered mapping receiving any excess keyword arguments, defaulting to a
631new empty mapping of the same type. Parameters after "``*``" or
632"``*identifier``" are keyword-only parameters and may only be passed
633used keyword arguments.
Georg Brandl116aa622007-08-15 14:28:22 +0000634
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300635.. index::
636 pair: function; annotations
637 single: ->; function annotations
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200638 single: : (colon); function annotations
Georg Brandl116aa622007-08-15 14:28:22 +0000639
Cheryl Sabellab7105c92018-12-24 00:09:09 -0500640Parameters may have an :term:`annotation <function annotation>` of the form "``: expression``"
641following the parameter name. Any parameter may have an annotation, even those of the form
Georg Brandl02c30562007-09-07 17:52:53 +0000642``*identifier`` or ``**identifier``. Functions may have "return" annotation of
643the form "``-> expression``" after the parameter list. These annotations can be
Guido van Rossum95e4d582018-01-26 08:20:18 -0800644any valid Python expression. The presence of annotations does not change the
Batuhan Taskaya044a1042020-10-06 23:03:02 +0300645semantics of a function. The annotation values are available as string values
646in a dictionary keyed by the parameters' names in the :attr:`__annotations__`
647attribute of the function object.
Georg Brandl116aa622007-08-15 14:28:22 +0000648
Georg Brandl242e6a02013-10-06 10:28:39 +0200649.. index:: pair: lambda; expression
Georg Brandl116aa622007-08-15 14:28:22 +0000650
651It is also possible to create anonymous functions (functions not bound to a
Georg Brandl242e6a02013-10-06 10:28:39 +0200652name), for immediate use in expressions. This uses lambda expressions, described in
653section :ref:`lambda`. Note that the lambda expression is merely a shorthand for a
Georg Brandl116aa622007-08-15 14:28:22 +0000654simplified function definition; a function defined in a ":keyword:`def`"
655statement can be passed around or assigned to another name just like a function
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200656defined by a lambda expression. The ":keyword:`!def`" form is actually more powerful
Georg Brandl116aa622007-08-15 14:28:22 +0000657since it allows the execution of multiple statements and annotations.
658
Georg Brandl242e6a02013-10-06 10:28:39 +0200659**Programmer's note:** Functions are first-class objects. A "``def``" statement
Georg Brandl116aa622007-08-15 14:28:22 +0000660executed inside a function definition defines a local function that can be
661returned or passed around. Free variables used in the nested function can
662access the local variables of the function containing the def. See section
663:ref:`naming` for details.
664
Georg Brandl64a40942012-03-10 09:22:47 +0100665.. seealso::
666
667 :pep:`3107` - Function Annotations
668 The original specification for function annotations.
669
Guido van Rossum95e4d582018-01-26 08:20:18 -0800670 :pep:`484` - Type Hints
671 Definition of a standard meaning for annotations: type hints.
672
673 :pep:`526` - Syntax for Variable Annotations
674 Ability to type hint variable declarations, including class
675 variables and instance variables
676
677 :pep:`563` - Postponed Evaluation of Annotations
678 Support for forward references within annotations by preserving
679 annotations in a string form at runtime instead of eager evaluation.
680
Georg Brandl116aa622007-08-15 14:28:22 +0000681
682.. _class:
683
684Class definitions
685=================
686
687.. index::
Georg Brandl02c30562007-09-07 17:52:53 +0000688 object: class
Christian Heimesfaf2f632008-01-06 16:59:19 +0000689 statement: class
690 pair: class; definition
Georg Brandl116aa622007-08-15 14:28:22 +0000691 pair: class; name
692 pair: name; binding
693 pair: execution; frame
Christian Heimesfaf2f632008-01-06 16:59:19 +0000694 single: inheritance
Georg Brandl3dbca812008-07-23 16:10:53 +0000695 single: docstring
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200696 single: () (parentheses); class definition
697 single: , (comma); expression list
698 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +0000699
Georg Brandl02c30562007-09-07 17:52:53 +0000700A class definition defines a class object (see section :ref:`types`):
701
Victor Stinner8af239e2020-09-18 09:10:15 +0200702.. productionlist:: python-grammar
Georg Brandl02c30562007-09-07 17:52:53 +0000703 classdef: [`decorators`] "class" `classname` [`inheritance`] ":" `suite`
Benjamin Peterson54044d62016-05-16 23:20:22 -0700704 inheritance: "(" [`argument_list`] ")"
Georg Brandl02c30562007-09-07 17:52:53 +0000705 classname: `identifier`
706
Georg Brandl65e5f802010-08-02 18:10:13 +0000707A class definition is an executable statement. The inheritance list usually
708gives a list of base classes (see :ref:`metaclasses` for more advanced uses), so
709each item in the list should evaluate to a class object which allows
Éric Araujo28053fb2010-11-22 03:09:19 +0000710subclassing. Classes without an inheritance list inherit, by default, from the
711base class :class:`object`; hence, ::
712
713 class Foo:
714 pass
715
716is equivalent to ::
717
718 class Foo(object):
719 pass
Georg Brandl65e5f802010-08-02 18:10:13 +0000720
721The class's suite is then executed in a new execution frame (see :ref:`naming`),
722using a newly created local namespace and the original global namespace.
723(Usually, the suite contains mostly function definitions.) When the class's
724suite finishes execution, its execution frame is discarded but its local
725namespace is saved. [#]_ A class object is then created using the inheritance
726list for the base classes and the saved local namespace for the attribute
727dictionary. The class name is bound to this class object in the original local
728namespace.
729
Eric Snow92a6c172016-09-05 14:50:11 -0700730The order in which attributes are defined in the class body is preserved
Eric Snow4f29e752016-09-08 15:11:11 -0700731in the new class's ``__dict__``. Note that this is reliable only right
732after the class is created and only for classes that were defined using
733the definition syntax.
Eric Snow92a6c172016-09-05 14:50:11 -0700734
Georg Brandl65e5f802010-08-02 18:10:13 +0000735Class creation can be customized heavily using :ref:`metaclasses <metaclasses>`.
Georg Brandl116aa622007-08-15 14:28:22 +0000736
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300737.. index::
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200738 single: @ (at); class definition
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300739
Georg Brandlf4142722010-10-17 10:38:20 +0000740Classes can also be decorated: just like when decorating functions, ::
Georg Brandl02c30562007-09-07 17:52:53 +0000741
742 @f1(arg)
743 @f2
744 class Foo: pass
745
Berker Peksag6cafece2016-08-03 10:17:21 +0300746is roughly equivalent to ::
Georg Brandl02c30562007-09-07 17:52:53 +0000747
748 class Foo: pass
749 Foo = f1(arg)(f2(Foo))
750
Georg Brandlf4142722010-10-17 10:38:20 +0000751The evaluation rules for the decorator expressions are the same as for function
Berker Peksag6cafece2016-08-03 10:17:21 +0300752decorators. The result is then bound to the class name.
Georg Brandlf4142722010-10-17 10:38:20 +0000753
Brandt Bucher8f130532020-03-07 10:23:49 -0800754.. versionchanged:: 3.9
755 Classes may be decorated with any valid :token:`assignment_expression`.
756 Previously, the grammar was much more restrictive; see :pep:`614` for
757 details.
758
Georg Brandl116aa622007-08-15 14:28:22 +0000759**Programmer's note:** Variables defined in the class definition are class
Georg Brandl65e5f802010-08-02 18:10:13 +0000760attributes; they are shared by instances. Instance attributes can be set in a
761method with ``self.name = value``. Both class and instance attributes are
762accessible through the notation "``self.name``", and an instance attribute hides
763a class attribute with the same name when accessed in this way. Class
764attributes can be used as defaults for instance attributes, but using mutable
765values there can lead to unexpected results. :ref:`Descriptors <descriptors>`
766can be used to create instance variables with different implementation details.
Georg Brandl85eb8c12007-08-31 16:33:38 +0000767
Georg Brandl116aa622007-08-15 14:28:22 +0000768
Georg Brandl02c30562007-09-07 17:52:53 +0000769.. seealso::
770
Andrés Delfino0f14fc12018-10-19 20:31:15 -0300771 :pep:`3115` - Metaclasses in Python 3000
772 The proposal that changed the declaration of metaclasses to the current
773 syntax, and the semantics for how classes with metaclasses are
774 constructed.
775
Georg Brandl02c30562007-09-07 17:52:53 +0000776 :pep:`3129` - Class Decorators
Andrés Delfino0f14fc12018-10-19 20:31:15 -0300777 The proposal that added class decorators. Function and method decorators
778 were introduced in :pep:`318`.
Georg Brandl02c30562007-09-07 17:52:53 +0000779
Georg Brandl02c30562007-09-07 17:52:53 +0000780
Elvis Pranskevichus63536bd2018-05-19 23:15:06 -0400781.. _async:
782
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400783Coroutines
784==========
785
Yury Selivanov5376ba92015-06-22 12:19:30 -0400786.. versionadded:: 3.5
787
Yury Selivanov66f88282015-06-24 11:04:15 -0400788.. index:: statement: async def
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400789.. _`async def`:
790
791Coroutine function definition
792-----------------------------
793
Victor Stinner8af239e2020-09-18 09:10:15 +0200794.. productionlist:: python-grammar
Andrés Delfinocaccca782018-07-07 17:24:46 -0300795 async_funcdef: [`decorators`] "async" "def" `funcname` "(" [`parameter_list`] ")"
796 : ["->" `expression`] ":" `suite`
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400797
Yury Selivanov66f88282015-06-24 11:04:15 -0400798.. index::
799 keyword: async
800 keyword: await
801
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400802Execution of Python coroutines can be suspended and resumed at many points
Andre Delfino8adf8d12020-10-12 10:52:30 -0300803(see :term:`coroutine`). :keyword:`await` expressions, :keyword:`async for` and
804:keyword:`async with` can only be used in the body of a coroutine function.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400805
806Functions defined with ``async def`` syntax are always coroutine functions,
807even if they do not contain ``await`` or ``async`` keywords.
808
Andrés Delfino95f68b12018-10-28 07:41:57 -0300809It is a :exc:`SyntaxError` to use a ``yield from`` expression inside the body
810of a coroutine function.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400811
Yury Selivanov5376ba92015-06-22 12:19:30 -0400812An example of a coroutine function::
813
814 async def func(param1, param2):
815 do_stuff()
816 await some_coroutine()
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400817
Andre Delfino8adf8d12020-10-12 10:52:30 -0300818.. versionchanged:: 3.7
819 ``await`` and ``async`` are now keywords; previously they were only
820 treated as such inside the body of a coroutine function.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400821
Yury Selivanov66f88282015-06-24 11:04:15 -0400822.. index:: statement: async for
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400823.. _`async for`:
824
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200825The :keyword:`!async for` statement
826-----------------------------------
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400827
Victor Stinner8af239e2020-09-18 09:10:15 +0200828.. productionlist:: python-grammar
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400829 async_for_stmt: "async" `for_stmt`
830
Nick Gaya4b8cdfc2020-12-11 00:27:35 -0800831An :term:`asynchronous iterable` provides an ``__aiter__`` method that directly
832returns an :term:`asynchronous iterator`, which can call asynchronous code in
833its ``__anext__`` method.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400834
835The ``async for`` statement allows convenient iteration over asynchronous
Nick Gaya4b8cdfc2020-12-11 00:27:35 -0800836iterables.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400837
838The following code::
839
840 async for TARGET in ITER:
Géry Ogam226e6e72019-12-30 05:24:51 +0000841 SUITE
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400842 else:
Géry Ogam226e6e72019-12-30 05:24:51 +0000843 SUITE2
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400844
845Is semantically equivalent to::
846
847 iter = (ITER)
Yury Selivanova6f6edb2016-06-09 15:08:31 -0400848 iter = type(iter).__aiter__(iter)
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400849 running = True
Géry Ogam226e6e72019-12-30 05:24:51 +0000850
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400851 while running:
852 try:
853 TARGET = await type(iter).__anext__(iter)
854 except StopAsyncIteration:
855 running = False
856 else:
Géry Ogam226e6e72019-12-30 05:24:51 +0000857 SUITE
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400858 else:
Géry Ogam226e6e72019-12-30 05:24:51 +0000859 SUITE2
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400860
861See also :meth:`__aiter__` and :meth:`__anext__` for details.
862
Andrés Delfino95f68b12018-10-28 07:41:57 -0300863It is a :exc:`SyntaxError` to use an ``async for`` statement outside the
864body of a coroutine function.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400865
866
Yury Selivanov66f88282015-06-24 11:04:15 -0400867.. index:: statement: async with
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400868.. _`async with`:
869
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200870The :keyword:`!async with` statement
871------------------------------------
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400872
Victor Stinner8af239e2020-09-18 09:10:15 +0200873.. productionlist:: python-grammar
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400874 async_with_stmt: "async" `with_stmt`
875
876An :term:`asynchronous context manager` is a :term:`context manager` that is
877able to suspend execution in its *enter* and *exit* methods.
878
879The following code::
880
Géry Ogam226e6e72019-12-30 05:24:51 +0000881 async with EXPRESSION as TARGET:
882 SUITE
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400883
Géry Ogam226e6e72019-12-30 05:24:51 +0000884is semantically equivalent to::
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400885
Géry Ogam226e6e72019-12-30 05:24:51 +0000886 manager = (EXPRESSION)
Géry Ogam226e6e72019-12-30 05:24:51 +0000887 aenter = type(manager).__aenter__
Géry Ogam1d1b97a2020-01-14 12:58:29 +0100888 aexit = type(manager).__aexit__
Géry Ogam226e6e72019-12-30 05:24:51 +0000889 value = await aenter(manager)
890 hit_except = False
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400891
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400892 try:
Géry Ogam226e6e72019-12-30 05:24:51 +0000893 TARGET = value
894 SUITE
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400895 except:
Géry Ogam226e6e72019-12-30 05:24:51 +0000896 hit_except = True
897 if not await aexit(manager, *sys.exc_info()):
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400898 raise
Géry Ogam226e6e72019-12-30 05:24:51 +0000899 finally:
900 if not hit_except:
901 await aexit(manager, None, None, None)
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400902
903See also :meth:`__aenter__` and :meth:`__aexit__` for details.
904
Andrés Delfino95f68b12018-10-28 07:41:57 -0300905It is a :exc:`SyntaxError` to use an ``async with`` statement outside the
906body of a coroutine function.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400907
908.. seealso::
909
910 :pep:`492` - Coroutines with async and await syntax
Andrés Delfino0f14fc12018-10-19 20:31:15 -0300911 The proposal that made coroutines a proper standalone concept in Python,
912 and added supporting syntax.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400913
914
Georg Brandl116aa622007-08-15 14:28:22 +0000915.. rubric:: Footnotes
916
Ezio Melottifc3db8a2011-06-26 11:25:28 +0300917.. [#] The exception is propagated to the invocation stack unless
918 there is a :keyword:`finally` clause which happens to raise another
919 exception. That new exception causes the old one to be lost.
Georg Brandl116aa622007-08-15 14:28:22 +0000920
Georg Brandl3dbca812008-07-23 16:10:53 +0000921.. [#] A string literal appearing as the first statement in the function body is
922 transformed into the function's ``__doc__`` attribute and therefore the
923 function's :term:`docstring`.
924
925.. [#] A string literal appearing as the first statement in the class body is
926 transformed into the namespace's ``__doc__`` item and therefore the class's
927 :term:`docstring`.