blob: 62986cb151964a88f26bd46d89cc436068ad3f66 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001.. _compound:
2
3*******************
4Compound statements
5*******************
6
7.. index:: pair: compound; statement
8
9Compound statements contain (groups of) other statements; they affect or control
10the execution of those other statements in some way. In general, compound
11statements span multiple lines, although in simple incarnations a whole compound
12statement may be contained in one line.
13
14The :keyword:`if`, :keyword:`while` and :keyword:`for` statements implement
15traditional control flow constructs. :keyword:`try` specifies exception
Georg Brandl02c30562007-09-07 17:52:53 +000016handlers and/or cleanup code for a group of statements, while the
17:keyword:`with` statement allows the execution of initialization and
18finalization code around a block of code. Function and class definitions are
19also syntactically compound statements.
Georg Brandl116aa622007-08-15 14:28:22 +000020
21.. index::
22 single: clause
23 single: suite
Serhiy Storchaka913876d2018-10-28 13:41:26 +020024 single: ; (semicolon)
Georg Brandl116aa622007-08-15 14:28:22 +000025
Raymond Hettingeraa7886d2014-05-26 22:20:37 -070026A compound statement consists of one or more 'clauses.' A clause consists of a
Georg Brandl116aa622007-08-15 14:28:22 +000027header and a 'suite.' The clause headers of a particular compound statement are
28all at the same indentation level. Each clause header begins with a uniquely
29identifying keyword and ends with a colon. A suite is a group of statements
30controlled by a clause. A suite can be one or more semicolon-separated simple
31statements on the same line as the header, following the header's colon, or it
32can be one or more indented statements on subsequent lines. Only the latter
Raymond Hettingeraa7886d2014-05-26 22:20:37 -070033form of a suite can contain nested compound statements; the following is illegal,
Georg Brandl116aa622007-08-15 14:28:22 +000034mostly because it wouldn't be clear to which :keyword:`if` clause a following
Georg Brandl02c30562007-09-07 17:52:53 +000035:keyword:`else` clause would belong::
Georg Brandl116aa622007-08-15 14:28:22 +000036
Georg Brandl6911e3c2007-09-04 07:15:32 +000037 if test1: if test2: print(x)
Georg Brandl116aa622007-08-15 14:28:22 +000038
39Also note that the semicolon binds tighter than the colon in this context, so
Georg Brandl6911e3c2007-09-04 07:15:32 +000040that in the following example, either all or none of the :func:`print` calls are
41executed::
Georg Brandl116aa622007-08-15 14:28:22 +000042
Georg Brandl6911e3c2007-09-04 07:15:32 +000043 if x < y < z: print(x); print(y); print(z)
Georg Brandl116aa622007-08-15 14:28:22 +000044
45Summarizing:
46
Victor Stinner8af239e2020-09-18 09:10:15 +020047
48.. productionlist:: python-grammar
Georg Brandl116aa622007-08-15 14:28:22 +000049 compound_stmt: `if_stmt`
50 : | `while_stmt`
51 : | `for_stmt`
52 : | `try_stmt`
53 : | `with_stmt`
54 : | `funcdef`
55 : | `classdef`
Yury Selivanovf3e40fa2015-05-21 11:50:30 -040056 : | `async_with_stmt`
57 : | `async_for_stmt`
58 : | `async_funcdef`
Georg Brandl116aa622007-08-15 14:28:22 +000059 suite: `stmt_list` NEWLINE | NEWLINE INDENT `statement`+ DEDENT
60 statement: `stmt_list` NEWLINE | `compound_stmt`
61 stmt_list: `simple_stmt` (";" `simple_stmt`)* [";"]
62
63.. index::
64 single: NEWLINE token
65 single: DEDENT token
66 pair: dangling; else
67
68Note that statements always end in a ``NEWLINE`` possibly followed by a
Georg Brandl02c30562007-09-07 17:52:53 +000069``DEDENT``. Also note that optional continuation clauses always begin with a
Georg Brandl116aa622007-08-15 14:28:22 +000070keyword that cannot start a statement, thus there are no ambiguities (the
71'dangling :keyword:`else`' problem is solved in Python by requiring nested
72:keyword:`if` statements to be indented).
73
74The formatting of the grammar rules in the following sections places each clause
75on a separate line for clarity.
76
77
78.. _if:
Christian Heimes5b5e81c2007-12-31 16:14:33 +000079.. _elif:
80.. _else:
Georg Brandl116aa622007-08-15 14:28:22 +000081
Serhiy Storchaka2b57c432018-12-19 08:09:46 +020082The :keyword:`!if` statement
83============================
Georg Brandl116aa622007-08-15 14:28:22 +000084
Christian Heimesfaf2f632008-01-06 16:59:19 +000085.. index::
Serhiy Storchaka2b57c432018-12-19 08:09:46 +020086 ! statement: if
Christian Heimesfaf2f632008-01-06 16:59:19 +000087 keyword: elif
88 keyword: else
Serhiy Storchaka913876d2018-10-28 13:41:26 +020089 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +000090
91The :keyword:`if` statement is used for conditional execution:
92
Victor Stinner8af239e2020-09-18 09:10:15 +020093.. productionlist:: python-grammar
Brandt Bucher8bae2192020-03-05 21:19:22 -080094 if_stmt: "if" `assignment_expression` ":" `suite`
95 : ("elif" `assignment_expression` ":" `suite`)*
Georg Brandl116aa622007-08-15 14:28:22 +000096 : ["else" ":" `suite`]
97
Georg Brandl116aa622007-08-15 14:28:22 +000098It selects exactly one of the suites by evaluating the expressions one by one
99until one is found to be true (see section :ref:`booleans` for the definition of
100true and false); then that suite is executed (and no other part of the
101:keyword:`if` statement is executed or evaluated). If all expressions are
102false, the suite of the :keyword:`else` clause, if present, is executed.
103
104
105.. _while:
106
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200107The :keyword:`!while` statement
108===============================
Georg Brandl116aa622007-08-15 14:28:22 +0000109
110.. index::
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200111 ! statement: while
Georg Brandl02c30562007-09-07 17:52:53 +0000112 keyword: else
Georg Brandl116aa622007-08-15 14:28:22 +0000113 pair: loop; statement
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200114 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +0000115
116The :keyword:`while` statement is used for repeated execution as long as an
117expression is true:
118
Victor Stinner8af239e2020-09-18 09:10:15 +0200119.. productionlist:: python-grammar
Brandt Bucher8bae2192020-03-05 21:19:22 -0800120 while_stmt: "while" `assignment_expression` ":" `suite`
Georg Brandl116aa622007-08-15 14:28:22 +0000121 : ["else" ":" `suite`]
122
Georg Brandl116aa622007-08-15 14:28:22 +0000123This repeatedly tests the expression and, if it is true, executes the first
124suite; if the expression is false (which may be the first time it is tested) the
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200125suite of the :keyword:`!else` clause, if present, is executed and the loop
Georg Brandl116aa622007-08-15 14:28:22 +0000126terminates.
127
128.. index::
129 statement: break
130 statement: continue
131
132A :keyword:`break` statement executed in the first suite terminates the loop
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200133without executing the :keyword:`!else` clause's suite. A :keyword:`continue`
Georg Brandl116aa622007-08-15 14:28:22 +0000134statement executed in the first suite skips the rest of the suite and goes back
135to testing the expression.
136
137
138.. _for:
139
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200140The :keyword:`!for` statement
141=============================
Georg Brandl116aa622007-08-15 14:28:22 +0000142
143.. index::
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200144 ! statement: for
Georg Brandl02c30562007-09-07 17:52:53 +0000145 keyword: in
146 keyword: else
147 pair: target; list
Georg Brandl116aa622007-08-15 14:28:22 +0000148 pair: loop; statement
Georg Brandl02c30562007-09-07 17:52:53 +0000149 object: sequence
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200150 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +0000151
152The :keyword:`for` statement is used to iterate over the elements of a sequence
153(such as a string, tuple or list) or other iterable object:
154
Victor Stinner8af239e2020-09-18 09:10:15 +0200155.. productionlist:: python-grammar
Georg Brandl116aa622007-08-15 14:28:22 +0000156 for_stmt: "for" `target_list` "in" `expression_list` ":" `suite`
157 : ["else" ":" `suite`]
158
Georg Brandl116aa622007-08-15 14:28:22 +0000159The expression list is evaluated once; it should yield an iterable object. An
160iterator is created for the result of the ``expression_list``. The suite is
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700161then executed once for each item provided by the iterator, in the order returned
162by the iterator. Each item in turn is assigned to the target list using the
Georg Brandl02c30562007-09-07 17:52:53 +0000163standard rules for assignments (see :ref:`assignment`), and then the suite is
164executed. When the items are exhausted (which is immediately when the sequence
165is empty or an iterator raises a :exc:`StopIteration` exception), the suite in
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200166the :keyword:`!else` clause, if present, is executed, and the loop terminates.
Georg Brandl116aa622007-08-15 14:28:22 +0000167
168.. index::
169 statement: break
170 statement: continue
171
172A :keyword:`break` statement executed in the first suite terminates the loop
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200173without executing the :keyword:`!else` clause's suite. A :keyword:`continue`
Georg Brandl116aa622007-08-15 14:28:22 +0000174statement executed in the first suite skips the rest of the suite and continues
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200175with the next item, or with the :keyword:`!else` clause if there is no next
Georg Brandl116aa622007-08-15 14:28:22 +0000176item.
177
Andrés Delfinoe42b7052018-07-26 12:35:23 -0300178The for-loop makes assignments to the variables in the target list.
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700179This overwrites all previous assignments to those variables including
180those made in the suite of the for-loop::
181
182 for i in range(10):
183 print(i)
184 i = 5 # this will not affect the for-loop
Zachary Ware2f78b842014-06-03 09:32:40 -0500185 # because i will be overwritten with the next
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700186 # index in the range
187
Georg Brandl116aa622007-08-15 14:28:22 +0000188
189.. index::
190 builtin: range
Georg Brandl116aa622007-08-15 14:28:22 +0000191
Georg Brandl02c30562007-09-07 17:52:53 +0000192Names in the target list are not deleted when the loop is finished, but if the
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700193sequence is empty, they will not have been assigned to at all by the loop. Hint:
Georg Brandl02c30562007-09-07 17:52:53 +0000194the built-in function :func:`range` returns an iterator of integers suitable to
Benjamin Peterson3db5e7b2009-06-03 03:13:30 +0000195emulate the effect of Pascal's ``for i := a to b do``; e.g., ``list(range(3))``
Georg Brandl02c30562007-09-07 17:52:53 +0000196returns the list ``[0, 1, 2]``.
Georg Brandl116aa622007-08-15 14:28:22 +0000197
Georg Brandle720c0a2009-04-27 16:20:50 +0000198.. note::
Georg Brandl116aa622007-08-15 14:28:22 +0000199
200 .. index::
201 single: loop; over mutable sequence
202 single: mutable sequence; loop over
203
204 There is a subtlety when the sequence is being modified by the loop (this can
Andrés Delfino6921ef72018-07-30 15:44:35 -0300205 only occur for mutable sequences, e.g. lists). An internal counter is used
Georg Brandl02c30562007-09-07 17:52:53 +0000206 to keep track of which item is used next, and this is incremented on each
Georg Brandl116aa622007-08-15 14:28:22 +0000207 iteration. When this counter has reached the length of the sequence the loop
208 terminates. This means that if the suite deletes the current (or a previous)
Georg Brandl02c30562007-09-07 17:52:53 +0000209 item from the sequence, the next item will be skipped (since it gets the
210 index of the current item which has already been treated). Likewise, if the
211 suite inserts an item in the sequence before the current item, the current
212 item will be treated again the next time through the loop. This can lead to
213 nasty bugs that can be avoided by making a temporary copy using a slice of
214 the whole sequence, e.g., ::
Georg Brandl116aa622007-08-15 14:28:22 +0000215
Georg Brandl02c30562007-09-07 17:52:53 +0000216 for x in a[:]:
217 if x < 0: a.remove(x)
Georg Brandl116aa622007-08-15 14:28:22 +0000218
219
220.. _try:
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000221.. _except:
222.. _finally:
Georg Brandl116aa622007-08-15 14:28:22 +0000223
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200224The :keyword:`!try` statement
225=============================
Georg Brandl116aa622007-08-15 14:28:22 +0000226
Christian Heimesfaf2f632008-01-06 16:59:19 +0000227.. index::
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200228 ! statement: try
Christian Heimesfaf2f632008-01-06 16:59:19 +0000229 keyword: except
230 keyword: finally
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300231 keyword: else
232 keyword: as
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200233 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +0000234
235The :keyword:`try` statement specifies exception handlers and/or cleanup code
236for a group of statements:
237
Victor Stinner8af239e2020-09-18 09:10:15 +0200238.. productionlist:: python-grammar
Andrés Delfinocaccca782018-07-07 17:24:46 -0300239 try_stmt: `try1_stmt` | `try2_stmt`
Georg Brandl116aa622007-08-15 14:28:22 +0000240 try1_stmt: "try" ":" `suite`
Terry Jan Reedy65e3ecb2014-08-23 19:29:47 -0400241 : ("except" [`expression` ["as" `identifier`]] ":" `suite`)+
Georg Brandl116aa622007-08-15 14:28:22 +0000242 : ["else" ":" `suite`]
243 : ["finally" ":" `suite`]
244 try2_stmt: "try" ":" `suite`
245 : "finally" ":" `suite`
246
Christian Heimesfaf2f632008-01-06 16:59:19 +0000247
248The :keyword:`except` clause(s) specify one or more exception handlers. When no
Georg Brandl116aa622007-08-15 14:28:22 +0000249exception occurs in the :keyword:`try` clause, no exception handler is executed.
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200250When an exception occurs in the :keyword:`!try` suite, a search for an exception
Georg Brandl116aa622007-08-15 14:28:22 +0000251handler is started. This search inspects the except clauses in turn until one
252is found that matches the exception. An expression-less except clause, if
253present, must be last; it matches any exception. For an except clause with an
254expression, that expression is evaluated, and the clause matches the exception
255if the resulting object is "compatible" with the exception. An object is
256compatible with an exception if it is the class or a base class of the exception
257object or a tuple containing an item compatible with the exception.
258
259If no except clause matches the exception, the search for an exception handler
260continues in the surrounding code and on the invocation stack. [#]_
261
262If the evaluation of an expression in the header of an except clause raises an
263exception, the original search for a handler is canceled and a search starts for
264the new exception in the surrounding code and on the call stack (it is treated
265as if the entire :keyword:`try` statement raised the exception).
266
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300267.. index:: single: as; except clause
268
Georg Brandl116aa622007-08-15 14:28:22 +0000269When a matching except clause is found, the exception is assigned to the target
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200270specified after the :keyword:`!as` keyword in that except clause, if present, and
Georg Brandl02c30562007-09-07 17:52:53 +0000271the except clause's suite is executed. All except clauses must have an
272executable block. When the end of this block is reached, execution continues
273normally after the entire try statement. (This means that if two nested
274handlers exist for the same exception, and the exception occurs in the try
275clause of the inner handler, the outer handler will not handle the exception.)
276
277When an exception has been assigned using ``as target``, it is cleared at the
278end of the except clause. This is as if ::
279
280 except E as N:
281 foo
282
283was translated to ::
284
285 except E as N:
286 try:
287 foo
288 finally:
Georg Brandl02c30562007-09-07 17:52:53 +0000289 del N
290
Benjamin Petersonfb288da2010-06-29 01:27:35 +0000291This means the exception must be assigned to a different name to be able to
292refer to it after the except clause. Exceptions are cleared because with the
293traceback attached to them, they form a reference cycle with the stack frame,
294keeping all locals in that frame alive until the next garbage collection occurs.
Georg Brandl116aa622007-08-15 14:28:22 +0000295
296.. index::
297 module: sys
298 object: traceback
299
300Before an except clause's suite is executed, details about the exception are
Raymond Hettingeraa7886d2014-05-26 22:20:37 -0700301stored in the :mod:`sys` module and can be accessed via :func:`sys.exc_info`.
Georg Brandlb30f3302011-01-06 09:23:56 +0000302:func:`sys.exc_info` returns a 3-tuple consisting of the exception class, the
303exception instance and a traceback object (see section :ref:`types`) identifying
304the point in the program where the exception occurred. :func:`sys.exc_info`
305values are restored to their previous values (before the call) when returning
306from a function that handled an exception.
Georg Brandl116aa622007-08-15 14:28:22 +0000307
308.. index::
309 keyword: else
310 statement: return
311 statement: break
312 statement: continue
313
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200314The optional :keyword:`!else` clause is executed if the control flow leaves the
Andrés Delfinob086c8a2018-11-11 16:33:51 -0300315:keyword:`try` suite, no exception was raised, and no :keyword:`return`,
316:keyword:`continue`, or :keyword:`break` statement was executed. Exceptions in
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200317the :keyword:`!else` clause are not handled by the preceding :keyword:`except`
Andrés Delfinob086c8a2018-11-11 16:33:51 -0300318clauses.
Georg Brandl116aa622007-08-15 14:28:22 +0000319
320.. index:: keyword: finally
321
322If :keyword:`finally` is present, it specifies a 'cleanup' handler. The
323:keyword:`try` clause is executed, including any :keyword:`except` and
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200324:keyword:`!else` clauses. If an exception occurs in any of the clauses and is
325not handled, the exception is temporarily saved. The :keyword:`!finally` clause
Mark Dickinson05ee5812012-09-24 20:16:38 +0100326is executed. If there is a saved exception it is re-raised at the end of the
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200327:keyword:`!finally` clause. If the :keyword:`!finally` clause raises another
Mark Dickinson05ee5812012-09-24 20:16:38 +0100328exception, the saved exception is set as the context of the new exception.
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200329If the :keyword:`!finally` clause executes a :keyword:`return`, :keyword:`break`
Serhiy Storchakafe2bbb12018-03-18 09:56:52 +0200330or :keyword:`continue` statement, the saved exception is discarded::
Andrew Svetlovf158d862012-08-14 15:38:15 +0300331
Zachary Ware9fafc9f2014-05-06 09:18:17 -0500332 >>> def f():
333 ... try:
334 ... 1/0
335 ... finally:
336 ... return 42
337 ...
338 >>> f()
339 42
Andrew Svetlovf158d862012-08-14 15:38:15 +0300340
341The exception information is not available to the program during execution of
342the :keyword:`finally` clause.
Georg Brandl116aa622007-08-15 14:28:22 +0000343
344.. index::
345 statement: return
346 statement: break
347 statement: continue
348
349When a :keyword:`return`, :keyword:`break` or :keyword:`continue` statement is
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200350executed in the :keyword:`try` suite of a :keyword:`!try`...\ :keyword:`!finally`
Serhiy Storchakafe2bbb12018-03-18 09:56:52 +0200351statement, the :keyword:`finally` clause is also executed 'on the way out.'
Georg Brandl116aa622007-08-15 14:28:22 +0000352
Zachary Ware8edd5322014-05-06 09:07:13 -0500353The return value of a function is determined by the last :keyword:`return`
354statement executed. Since the :keyword:`finally` clause always executes, a
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200355:keyword:`!return` statement executed in the :keyword:`!finally` clause will
Zachary Ware8edd5322014-05-06 09:07:13 -0500356always be the last one executed::
357
358 >>> def foo():
359 ... try:
360 ... return 'try'
361 ... finally:
362 ... return 'finally'
363 ...
364 >>> foo()
365 'finally'
366
Georg Brandl116aa622007-08-15 14:28:22 +0000367Additional information on exceptions can be found in section :ref:`exceptions`,
368and information on using the :keyword:`raise` statement to generate exceptions
369may be found in section :ref:`raise`.
370
Serhiy Storchakafe2bbb12018-03-18 09:56:52 +0200371.. versionchanged:: 3.8
372 Prior to Python 3.8, a :keyword:`continue` statement was illegal in the
373 :keyword:`finally` clause due to a problem with the implementation.
374
Georg Brandl116aa622007-08-15 14:28:22 +0000375
376.. _with:
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000377.. _as:
Georg Brandl116aa622007-08-15 14:28:22 +0000378
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200379The :keyword:`!with` statement
380==============================
Georg Brandl116aa622007-08-15 14:28:22 +0000381
Terry Jan Reedy7c895ed2014-04-29 00:58:56 -0400382.. index::
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200383 ! statement: with
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300384 keyword: as
385 single: as; with statement
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200386 single: , (comma); with statement
387 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +0000388
Georg Brandl116aa622007-08-15 14:28:22 +0000389The :keyword:`with` statement is used to wrap the execution of a block with
Georg Brandl02c30562007-09-07 17:52:53 +0000390methods defined by a context manager (see section :ref:`context-managers`).
391This allows common :keyword:`try`...\ :keyword:`except`...\ :keyword:`finally`
392usage patterns to be encapsulated for convenient reuse.
Georg Brandl116aa622007-08-15 14:28:22 +0000393
Victor Stinner8af239e2020-09-18 09:10:15 +0200394.. productionlist:: python-grammar
Andrés Delfinocaccca782018-07-07 17:24:46 -0300395 with_stmt: "with" `with_item` ("," `with_item`)* ":" `suite`
Georg Brandl0c315622009-05-25 21:10:36 +0000396 with_item: `expression` ["as" `target`]
Georg Brandl116aa622007-08-15 14:28:22 +0000397
Georg Brandl0c315622009-05-25 21:10:36 +0000398The execution of the :keyword:`with` statement with one "item" proceeds as follows:
Georg Brandl116aa622007-08-15 14:28:22 +0000399
Georg Brandl3387f482010-09-03 22:40:02 +0000400#. The context expression (the expression given in the :token:`with_item`) is
401 evaluated to obtain a context manager.
Georg Brandl116aa622007-08-15 14:28:22 +0000402
Géry Ogam226e6e72019-12-30 05:24:51 +0000403#. The context manager's :meth:`__enter__` is loaded for later use.
404
Benjamin Peterson876b2f22009-06-28 03:18:59 +0000405#. The context manager's :meth:`__exit__` is loaded for later use.
406
Georg Brandl116aa622007-08-15 14:28:22 +0000407#. The context manager's :meth:`__enter__` method is invoked.
408
409#. If a target was included in the :keyword:`with` statement, the return value
410 from :meth:`__enter__` is assigned to it.
411
412 .. note::
413
Georg Brandl02c30562007-09-07 17:52:53 +0000414 The :keyword:`with` statement guarantees that if the :meth:`__enter__`
415 method returns without an error, then :meth:`__exit__` will always be
Benjamin Peterson876b2f22009-06-28 03:18:59 +0000416 called. Thus, if an error occurs during the assignment to the target list,
417 it will be treated the same as an error occurring within the suite would
418 be. See step 6 below.
Georg Brandl116aa622007-08-15 14:28:22 +0000419
420#. The suite is executed.
421
Georg Brandl02c30562007-09-07 17:52:53 +0000422#. The context manager's :meth:`__exit__` method is invoked. If an exception
Georg Brandl116aa622007-08-15 14:28:22 +0000423 caused the suite to be exited, its type, value, and traceback are passed as
424 arguments to :meth:`__exit__`. Otherwise, three :const:`None` arguments are
425 supplied.
426
427 If the suite was exited due to an exception, and the return value from the
Georg Brandl02c30562007-09-07 17:52:53 +0000428 :meth:`__exit__` method was false, the exception is reraised. If the return
Georg Brandl116aa622007-08-15 14:28:22 +0000429 value was true, the exception is suppressed, and execution continues with the
430 statement following the :keyword:`with` statement.
431
Georg Brandl02c30562007-09-07 17:52:53 +0000432 If the suite was exited for any reason other than an exception, the return
433 value from :meth:`__exit__` is ignored, and execution proceeds at the normal
434 location for the kind of exit that was taken.
Georg Brandl116aa622007-08-15 14:28:22 +0000435
Géry Ogam226e6e72019-12-30 05:24:51 +0000436The following code::
437
438 with EXPRESSION as TARGET:
439 SUITE
440
441is semantically equivalent to::
442
443 manager = (EXPRESSION)
444 enter = type(manager).__enter__
445 exit = type(manager).__exit__
446 value = enter(manager)
447 hit_except = False
448
449 try:
450 TARGET = value
451 SUITE
452 except:
453 hit_except = True
454 if not exit(manager, *sys.exc_info()):
455 raise
456 finally:
457 if not hit_except:
458 exit(manager, None, None, None)
459
Georg Brandl0c315622009-05-25 21:10:36 +0000460With more than one item, the context managers are processed as if multiple
461:keyword:`with` statements were nested::
462
463 with A() as a, B() as b:
Géry Ogam226e6e72019-12-30 05:24:51 +0000464 SUITE
Georg Brandl0c315622009-05-25 21:10:36 +0000465
Géry Ogam226e6e72019-12-30 05:24:51 +0000466is semantically equivalent to::
Georg Brandl0c315622009-05-25 21:10:36 +0000467
468 with A() as a:
469 with B() as b:
Géry Ogam226e6e72019-12-30 05:24:51 +0000470 SUITE
Georg Brandl0c315622009-05-25 21:10:36 +0000471
472.. versionchanged:: 3.1
473 Support for multiple context expressions.
474
Georg Brandl116aa622007-08-15 14:28:22 +0000475.. seealso::
476
Serhiy Storchakae4ba8722016-03-31 15:30:54 +0300477 :pep:`343` - The "with" statement
Georg Brandl116aa622007-08-15 14:28:22 +0000478 The specification, background, and examples for the Python :keyword:`with`
479 statement.
480
481
Chris Jerdonekb4309942012-12-25 14:54:44 -0800482.. index::
483 single: parameter; function definition
484
Georg Brandl116aa622007-08-15 14:28:22 +0000485.. _function:
Christian Heimes5b5e81c2007-12-31 16:14:33 +0000486.. _def:
Georg Brandl116aa622007-08-15 14:28:22 +0000487
488Function definitions
489====================
490
491.. index::
Georg Brandl116aa622007-08-15 14:28:22 +0000492 statement: def
Christian Heimesfaf2f632008-01-06 16:59:19 +0000493 pair: function; definition
494 pair: function; name
495 pair: name; binding
Georg Brandl116aa622007-08-15 14:28:22 +0000496 object: user-defined function
497 object: function
Georg Brandl02c30562007-09-07 17:52:53 +0000498 pair: function; name
499 pair: name; binding
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200500 single: () (parentheses); function definition
501 single: , (comma); parameter list
502 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +0000503
504A function definition defines a user-defined function object (see section
505:ref:`types`):
506
Victor Stinner8af239e2020-09-18 09:10:15 +0200507.. productionlist:: python-grammar
Andrés Delfinocaccca782018-07-07 17:24:46 -0300508 funcdef: [`decorators`] "def" `funcname` "(" [`parameter_list`] ")"
509 : ["->" `expression`] ":" `suite`
Georg Brandl116aa622007-08-15 14:28:22 +0000510 decorators: `decorator`+
Brandt Bucher8f130532020-03-07 10:23:49 -0800511 decorator: "@" `assignment_expression` NEWLINE
Georg Brandl116aa622007-08-15 14:28:22 +0000512 dotted_name: `identifier` ("." `identifier`)*
Pablo Galindo29cb21d2019-05-29 22:59:00 +0100513 parameter_list: `defparameter` ("," `defparameter`)* "," "/" ["," [`parameter_list_no_posonly`]]
Pablo Galindob76302d2019-05-29 00:45:32 +0100514 : | `parameter_list_no_posonly`
515 parameter_list_no_posonly: `defparameter` ("," `defparameter`)* ["," [`parameter_list_starargs`]]
516 : | `parameter_list_starargs`
Robert Collinsdf395992015-08-12 08:00:06 +1200517 parameter_list_starargs: "*" [`parameter`] ("," `defparameter`)* ["," ["**" `parameter` [","]]]
Andrés Delfinocaccca782018-07-07 17:24:46 -0300518 : | "**" `parameter` [","]
Georg Brandl116aa622007-08-15 14:28:22 +0000519 parameter: `identifier` [":" `expression`]
520 defparameter: `parameter` ["=" `expression`]
521 funcname: `identifier`
522
Georg Brandl116aa622007-08-15 14:28:22 +0000523
524A function definition is an executable statement. Its execution binds the
525function name in the current local namespace to a function object (a wrapper
526around the executable code for the function). This function object contains a
527reference to the current global namespace as the global namespace to be used
528when the function is called.
529
530The function definition does not execute the function body; this gets executed
Georg Brandl3dbca812008-07-23 16:10:53 +0000531only when the function is called. [#]_
Georg Brandl116aa622007-08-15 14:28:22 +0000532
Christian Heimesdae2a892008-04-19 00:55:37 +0000533.. index::
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200534 single: @ (at); function definition
Christian Heimesdae2a892008-04-19 00:55:37 +0000535
Christian Heimesd8654cf2007-12-02 15:22:16 +0000536A function definition may be wrapped by one or more :term:`decorator` expressions.
Georg Brandl116aa622007-08-15 14:28:22 +0000537Decorator expressions are evaluated when the function is defined, in the scope
538that contains the function definition. The result must be a callable, which is
539invoked with the function object as the only argument. The returned value is
540bound to the function name instead of the function object. Multiple decorators
Georg Brandl02c30562007-09-07 17:52:53 +0000541are applied in nested fashion. For example, the following code ::
Georg Brandl116aa622007-08-15 14:28:22 +0000542
543 @f1(arg)
544 @f2
545 def func(): pass
546
Berker Peksag6cafece2016-08-03 10:17:21 +0300547is roughly equivalent to ::
Georg Brandl116aa622007-08-15 14:28:22 +0000548
549 def func(): pass
550 func = f1(arg)(f2(func))
551
Berker Peksag6cafece2016-08-03 10:17:21 +0300552except that the original function is not temporarily bound to the name ``func``.
553
Brandt Bucher8f130532020-03-07 10:23:49 -0800554.. versionchanged:: 3.9
555 Functions may be decorated with any valid :token:`assignment_expression`.
556 Previously, the grammar was much more restrictive; see :pep:`614` for
557 details.
558
Chris Jerdonekb4309942012-12-25 14:54:44 -0800559.. index::
560 triple: default; parameter; value
561 single: argument; function definition
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200562 single: = (equals); function definition
Georg Brandl116aa622007-08-15 14:28:22 +0000563
Chris Jerdonekb4309942012-12-25 14:54:44 -0800564When one or more :term:`parameters <parameter>` have the form *parameter* ``=``
565*expression*, the function is said to have "default parameter values." For a
566parameter with a default value, the corresponding :term:`argument` may be
567omitted from a call, in which
Georg Brandl116aa622007-08-15 14:28:22 +0000568case the parameter's default value is substituted. If a parameter has a default
Georg Brandl02c30562007-09-07 17:52:53 +0000569value, all following parameters up until the "``*``" must also have a default
570value --- this is a syntactic restriction that is not expressed by the grammar.
Georg Brandl116aa622007-08-15 14:28:22 +0000571
Benjamin Peterson1ef876c2013-02-10 09:29:59 -0500572**Default parameter values are evaluated from left to right when the function
573definition is executed.** This means that the expression is evaluated once, when
574the function is defined, and that the same "pre-computed" value is used for each
Andre Delfinob9f6ac92020-07-22 20:58:19 -0300575call. This is especially important to understand when a default parameter value is a
Benjamin Peterson1ef876c2013-02-10 09:29:59 -0500576mutable object, such as a list or a dictionary: if the function modifies the
Andre Delfinob9f6ac92020-07-22 20:58:19 -0300577object (e.g. by appending an item to a list), the default parameter value is in effect
Benjamin Peterson1ef876c2013-02-10 09:29:59 -0500578modified. This is generally not what was intended. A way around this is to use
579``None`` as the default, and explicitly test for it in the body of the function,
580e.g.::
Georg Brandl116aa622007-08-15 14:28:22 +0000581
582 def whats_on_the_telly(penguin=None):
583 if penguin is None:
584 penguin = []
585 penguin.append("property of the zoo")
586 return penguin
587
Christian Heimesdae2a892008-04-19 00:55:37 +0000588.. index::
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200589 single: * (asterisk); function definition
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300590 single: **; function definition
Christian Heimesdae2a892008-04-19 00:55:37 +0000591
592Function call semantics are described in more detail in section :ref:`calls`. A
Georg Brandl116aa622007-08-15 14:28:22 +0000593function call always assigns values to all parameters mentioned in the parameter
594list, either from position arguments, from keyword arguments, or from default
595values. If the form "``*identifier``" is present, it is initialized to a tuple
Eric Snowb957b0c2016-09-08 13:59:58 -0700596receiving any excess positional parameters, defaulting to the empty tuple.
597If the form "``**identifier``" is present, it is initialized to a new
598ordered mapping receiving any excess keyword arguments, defaulting to a
599new empty mapping of the same type. Parameters after "``*``" or
600"``*identifier``" are keyword-only parameters and may only be passed
601used keyword arguments.
Georg Brandl116aa622007-08-15 14:28:22 +0000602
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300603.. index::
604 pair: function; annotations
605 single: ->; function annotations
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200606 single: : (colon); function annotations
Georg Brandl116aa622007-08-15 14:28:22 +0000607
Cheryl Sabellab7105c92018-12-24 00:09:09 -0500608Parameters may have an :term:`annotation <function annotation>` of the form "``: expression``"
609following the parameter name. Any parameter may have an annotation, even those of the form
Georg Brandl02c30562007-09-07 17:52:53 +0000610``*identifier`` or ``**identifier``. Functions may have "return" annotation of
611the form "``-> expression``" after the parameter list. These annotations can be
Guido van Rossum95e4d582018-01-26 08:20:18 -0800612any valid Python expression. The presence of annotations does not change the
Batuhan Taskaya044a1042020-10-06 23:03:02 +0300613semantics of a function. The annotation values are available as string values
614in a dictionary keyed by the parameters' names in the :attr:`__annotations__`
615attribute of the function object.
Georg Brandl116aa622007-08-15 14:28:22 +0000616
Georg Brandl242e6a02013-10-06 10:28:39 +0200617.. index:: pair: lambda; expression
Georg Brandl116aa622007-08-15 14:28:22 +0000618
619It is also possible to create anonymous functions (functions not bound to a
Georg Brandl242e6a02013-10-06 10:28:39 +0200620name), for immediate use in expressions. This uses lambda expressions, described in
621section :ref:`lambda`. Note that the lambda expression is merely a shorthand for a
Georg Brandl116aa622007-08-15 14:28:22 +0000622simplified function definition; a function defined in a ":keyword:`def`"
623statement can be passed around or assigned to another name just like a function
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200624defined by a lambda expression. The ":keyword:`!def`" form is actually more powerful
Georg Brandl116aa622007-08-15 14:28:22 +0000625since it allows the execution of multiple statements and annotations.
626
Georg Brandl242e6a02013-10-06 10:28:39 +0200627**Programmer's note:** Functions are first-class objects. A "``def``" statement
Georg Brandl116aa622007-08-15 14:28:22 +0000628executed inside a function definition defines a local function that can be
629returned or passed around. Free variables used in the nested function can
630access the local variables of the function containing the def. See section
631:ref:`naming` for details.
632
Georg Brandl64a40942012-03-10 09:22:47 +0100633.. seealso::
634
635 :pep:`3107` - Function Annotations
636 The original specification for function annotations.
637
Guido van Rossum95e4d582018-01-26 08:20:18 -0800638 :pep:`484` - Type Hints
639 Definition of a standard meaning for annotations: type hints.
640
641 :pep:`526` - Syntax for Variable Annotations
642 Ability to type hint variable declarations, including class
643 variables and instance variables
644
645 :pep:`563` - Postponed Evaluation of Annotations
646 Support for forward references within annotations by preserving
647 annotations in a string form at runtime instead of eager evaluation.
648
Georg Brandl116aa622007-08-15 14:28:22 +0000649
650.. _class:
651
652Class definitions
653=================
654
655.. index::
Georg Brandl02c30562007-09-07 17:52:53 +0000656 object: class
Christian Heimesfaf2f632008-01-06 16:59:19 +0000657 statement: class
658 pair: class; definition
Georg Brandl116aa622007-08-15 14:28:22 +0000659 pair: class; name
660 pair: name; binding
661 pair: execution; frame
Christian Heimesfaf2f632008-01-06 16:59:19 +0000662 single: inheritance
Georg Brandl3dbca812008-07-23 16:10:53 +0000663 single: docstring
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200664 single: () (parentheses); class definition
665 single: , (comma); expression list
666 single: : (colon); compound statement
Georg Brandl116aa622007-08-15 14:28:22 +0000667
Georg Brandl02c30562007-09-07 17:52:53 +0000668A class definition defines a class object (see section :ref:`types`):
669
Victor Stinner8af239e2020-09-18 09:10:15 +0200670.. productionlist:: python-grammar
Georg Brandl02c30562007-09-07 17:52:53 +0000671 classdef: [`decorators`] "class" `classname` [`inheritance`] ":" `suite`
Benjamin Peterson54044d62016-05-16 23:20:22 -0700672 inheritance: "(" [`argument_list`] ")"
Georg Brandl02c30562007-09-07 17:52:53 +0000673 classname: `identifier`
674
Georg Brandl65e5f802010-08-02 18:10:13 +0000675A class definition is an executable statement. The inheritance list usually
676gives a list of base classes (see :ref:`metaclasses` for more advanced uses), so
677each item in the list should evaluate to a class object which allows
Éric Araujo28053fb2010-11-22 03:09:19 +0000678subclassing. Classes without an inheritance list inherit, by default, from the
679base class :class:`object`; hence, ::
680
681 class Foo:
682 pass
683
684is equivalent to ::
685
686 class Foo(object):
687 pass
Georg Brandl65e5f802010-08-02 18:10:13 +0000688
689The class's suite is then executed in a new execution frame (see :ref:`naming`),
690using a newly created local namespace and the original global namespace.
691(Usually, the suite contains mostly function definitions.) When the class's
692suite finishes execution, its execution frame is discarded but its local
693namespace is saved. [#]_ A class object is then created using the inheritance
694list for the base classes and the saved local namespace for the attribute
695dictionary. The class name is bound to this class object in the original local
696namespace.
697
Eric Snow92a6c172016-09-05 14:50:11 -0700698The order in which attributes are defined in the class body is preserved
Eric Snow4f29e752016-09-08 15:11:11 -0700699in the new class's ``__dict__``. Note that this is reliable only right
700after the class is created and only for classes that were defined using
701the definition syntax.
Eric Snow92a6c172016-09-05 14:50:11 -0700702
Georg Brandl65e5f802010-08-02 18:10:13 +0000703Class creation can be customized heavily using :ref:`metaclasses <metaclasses>`.
Georg Brandl116aa622007-08-15 14:28:22 +0000704
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300705.. index::
Serhiy Storchaka913876d2018-10-28 13:41:26 +0200706 single: @ (at); class definition
Serhiy Storchakaddb961d2018-10-26 09:00:49 +0300707
Georg Brandlf4142722010-10-17 10:38:20 +0000708Classes can also be decorated: just like when decorating functions, ::
Georg Brandl02c30562007-09-07 17:52:53 +0000709
710 @f1(arg)
711 @f2
712 class Foo: pass
713
Berker Peksag6cafece2016-08-03 10:17:21 +0300714is roughly equivalent to ::
Georg Brandl02c30562007-09-07 17:52:53 +0000715
716 class Foo: pass
717 Foo = f1(arg)(f2(Foo))
718
Georg Brandlf4142722010-10-17 10:38:20 +0000719The evaluation rules for the decorator expressions are the same as for function
Berker Peksag6cafece2016-08-03 10:17:21 +0300720decorators. The result is then bound to the class name.
Georg Brandlf4142722010-10-17 10:38:20 +0000721
Brandt Bucher8f130532020-03-07 10:23:49 -0800722.. versionchanged:: 3.9
723 Classes may be decorated with any valid :token:`assignment_expression`.
724 Previously, the grammar was much more restrictive; see :pep:`614` for
725 details.
726
Georg Brandl116aa622007-08-15 14:28:22 +0000727**Programmer's note:** Variables defined in the class definition are class
Georg Brandl65e5f802010-08-02 18:10:13 +0000728attributes; they are shared by instances. Instance attributes can be set in a
729method with ``self.name = value``. Both class and instance attributes are
730accessible through the notation "``self.name``", and an instance attribute hides
731a class attribute with the same name when accessed in this way. Class
732attributes can be used as defaults for instance attributes, but using mutable
733values there can lead to unexpected results. :ref:`Descriptors <descriptors>`
734can be used to create instance variables with different implementation details.
Georg Brandl85eb8c12007-08-31 16:33:38 +0000735
Georg Brandl116aa622007-08-15 14:28:22 +0000736
Georg Brandl02c30562007-09-07 17:52:53 +0000737.. seealso::
738
Andrés Delfino0f14fc12018-10-19 20:31:15 -0300739 :pep:`3115` - Metaclasses in Python 3000
740 The proposal that changed the declaration of metaclasses to the current
741 syntax, and the semantics for how classes with metaclasses are
742 constructed.
743
Georg Brandl02c30562007-09-07 17:52:53 +0000744 :pep:`3129` - Class Decorators
Andrés Delfino0f14fc12018-10-19 20:31:15 -0300745 The proposal that added class decorators. Function and method decorators
746 were introduced in :pep:`318`.
Georg Brandl02c30562007-09-07 17:52:53 +0000747
Georg Brandl02c30562007-09-07 17:52:53 +0000748
Elvis Pranskevichus63536bd2018-05-19 23:15:06 -0400749.. _async:
750
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400751Coroutines
752==========
753
Yury Selivanov5376ba92015-06-22 12:19:30 -0400754.. versionadded:: 3.5
755
Yury Selivanov66f88282015-06-24 11:04:15 -0400756.. index:: statement: async def
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400757.. _`async def`:
758
759Coroutine function definition
760-----------------------------
761
Victor Stinner8af239e2020-09-18 09:10:15 +0200762.. productionlist:: python-grammar
Andrés Delfinocaccca782018-07-07 17:24:46 -0300763 async_funcdef: [`decorators`] "async" "def" `funcname` "(" [`parameter_list`] ")"
764 : ["->" `expression`] ":" `suite`
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400765
Yury Selivanov66f88282015-06-24 11:04:15 -0400766.. index::
767 keyword: async
768 keyword: await
769
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400770Execution of Python coroutines can be suspended and resumed at many points
Andre Delfino8adf8d12020-10-12 10:52:30 -0300771(see :term:`coroutine`). :keyword:`await` expressions, :keyword:`async for` and
772:keyword:`async with` can only be used in the body of a coroutine function.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400773
774Functions defined with ``async def`` syntax are always coroutine functions,
775even if they do not contain ``await`` or ``async`` keywords.
776
Andrés Delfino95f68b12018-10-28 07:41:57 -0300777It is a :exc:`SyntaxError` to use a ``yield from`` expression inside the body
778of a coroutine function.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400779
Yury Selivanov5376ba92015-06-22 12:19:30 -0400780An example of a coroutine function::
781
782 async def func(param1, param2):
783 do_stuff()
784 await some_coroutine()
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400785
Andre Delfino8adf8d12020-10-12 10:52:30 -0300786.. versionchanged:: 3.7
787 ``await`` and ``async`` are now keywords; previously they were only
788 treated as such inside the body of a coroutine function.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400789
Yury Selivanov66f88282015-06-24 11:04:15 -0400790.. index:: statement: async for
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400791.. _`async for`:
792
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200793The :keyword:`!async for` statement
794-----------------------------------
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400795
Victor Stinner8af239e2020-09-18 09:10:15 +0200796.. productionlist:: python-grammar
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400797 async_for_stmt: "async" `for_stmt`
798
799An :term:`asynchronous iterable` is able to call asynchronous code in its
800*iter* implementation, and :term:`asynchronous iterator` can call asynchronous
801code in its *next* method.
802
803The ``async for`` statement allows convenient iteration over asynchronous
804iterators.
805
806The following code::
807
808 async for TARGET in ITER:
Géry Ogam226e6e72019-12-30 05:24:51 +0000809 SUITE
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400810 else:
Géry Ogam226e6e72019-12-30 05:24:51 +0000811 SUITE2
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400812
813Is semantically equivalent to::
814
815 iter = (ITER)
Yury Selivanova6f6edb2016-06-09 15:08:31 -0400816 iter = type(iter).__aiter__(iter)
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400817 running = True
Géry Ogam226e6e72019-12-30 05:24:51 +0000818
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400819 while running:
820 try:
821 TARGET = await type(iter).__anext__(iter)
822 except StopAsyncIteration:
823 running = False
824 else:
Géry Ogam226e6e72019-12-30 05:24:51 +0000825 SUITE
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400826 else:
Géry Ogam226e6e72019-12-30 05:24:51 +0000827 SUITE2
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400828
829See also :meth:`__aiter__` and :meth:`__anext__` for details.
830
Andrés Delfino95f68b12018-10-28 07:41:57 -0300831It is a :exc:`SyntaxError` to use an ``async for`` statement outside the
832body of a coroutine function.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400833
834
Yury Selivanov66f88282015-06-24 11:04:15 -0400835.. index:: statement: async with
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400836.. _`async with`:
837
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200838The :keyword:`!async with` statement
839------------------------------------
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400840
Victor Stinner8af239e2020-09-18 09:10:15 +0200841.. productionlist:: python-grammar
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400842 async_with_stmt: "async" `with_stmt`
843
844An :term:`asynchronous context manager` is a :term:`context manager` that is
845able to suspend execution in its *enter* and *exit* methods.
846
847The following code::
848
Géry Ogam226e6e72019-12-30 05:24:51 +0000849 async with EXPRESSION as TARGET:
850 SUITE
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400851
Géry Ogam226e6e72019-12-30 05:24:51 +0000852is semantically equivalent to::
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400853
Géry Ogam226e6e72019-12-30 05:24:51 +0000854 manager = (EXPRESSION)
Géry Ogam226e6e72019-12-30 05:24:51 +0000855 aenter = type(manager).__aenter__
Géry Ogam1d1b97a2020-01-14 12:58:29 +0100856 aexit = type(manager).__aexit__
Géry Ogam226e6e72019-12-30 05:24:51 +0000857 value = await aenter(manager)
858 hit_except = False
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400859
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400860 try:
Géry Ogam226e6e72019-12-30 05:24:51 +0000861 TARGET = value
862 SUITE
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400863 except:
Géry Ogam226e6e72019-12-30 05:24:51 +0000864 hit_except = True
865 if not await aexit(manager, *sys.exc_info()):
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400866 raise
Géry Ogam226e6e72019-12-30 05:24:51 +0000867 finally:
868 if not hit_except:
869 await aexit(manager, None, None, None)
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400870
871See also :meth:`__aenter__` and :meth:`__aexit__` for details.
872
Andrés Delfino95f68b12018-10-28 07:41:57 -0300873It is a :exc:`SyntaxError` to use an ``async with`` statement outside the
874body of a coroutine function.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400875
876.. seealso::
877
878 :pep:`492` - Coroutines with async and await syntax
Andrés Delfino0f14fc12018-10-19 20:31:15 -0300879 The proposal that made coroutines a proper standalone concept in Python,
880 and added supporting syntax.
Yury Selivanovf3e40fa2015-05-21 11:50:30 -0400881
882
Georg Brandl116aa622007-08-15 14:28:22 +0000883.. rubric:: Footnotes
884
Ezio Melottifc3db8a2011-06-26 11:25:28 +0300885.. [#] The exception is propagated to the invocation stack unless
886 there is a :keyword:`finally` clause which happens to raise another
887 exception. That new exception causes the old one to be lost.
Georg Brandl116aa622007-08-15 14:28:22 +0000888
Georg Brandl3dbca812008-07-23 16:10:53 +0000889.. [#] A string literal appearing as the first statement in the function body is
890 transformed into the function's ``__doc__`` attribute and therefore the
891 function's :term:`docstring`.
892
893.. [#] A string literal appearing as the first statement in the class body is
894 transformed into the namespace's ``__doc__`` item and therefore the class's
895 :term:`docstring`.