Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 1 | .. _compound: |
| 2 | |
| 3 | ******************* |
| 4 | Compound statements |
| 5 | ******************* |
| 6 | |
| 7 | .. index:: pair: compound; statement |
| 8 | |
| 9 | Compound statements contain (groups of) other statements; they affect or control |
| 10 | the execution of those other statements in some way. In general, compound |
| 11 | statements span multiple lines, although in simple incarnations a whole compound |
| 12 | statement may be contained in one line. |
| 13 | |
| 14 | The :keyword:`if`, :keyword:`while` and :keyword:`for` statements implement |
| 15 | traditional control flow constructs. :keyword:`try` specifies exception |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 16 | handlers and/or cleanup code for a group of statements, while the |
| 17 | :keyword:`with` statement allows the execution of initialization and |
| 18 | finalization code around a block of code. Function and class definitions are |
| 19 | also syntactically compound statements. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 20 | |
| 21 | .. index:: |
| 22 | single: clause |
| 23 | single: suite |
Serhiy Storchaka | 913876d | 2018-10-28 13:41:26 +0200 | [diff] [blame] | 24 | single: ; (semicolon) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 25 | |
Raymond Hettinger | aa7886d | 2014-05-26 22:20:37 -0700 | [diff] [blame] | 26 | A compound statement consists of one or more 'clauses.' A clause consists of a |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 27 | header and a 'suite.' The clause headers of a particular compound statement are |
| 28 | all at the same indentation level. Each clause header begins with a uniquely |
| 29 | identifying keyword and ends with a colon. A suite is a group of statements |
| 30 | controlled by a clause. A suite can be one or more semicolon-separated simple |
| 31 | statements on the same line as the header, following the header's colon, or it |
| 32 | can be one or more indented statements on subsequent lines. Only the latter |
Raymond Hettinger | aa7886d | 2014-05-26 22:20:37 -0700 | [diff] [blame] | 33 | form of a suite can contain nested compound statements; the following is illegal, |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 34 | mostly because it wouldn't be clear to which :keyword:`if` clause a following |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 35 | :keyword:`else` clause would belong:: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 36 | |
Georg Brandl | 6911e3c | 2007-09-04 07:15:32 +0000 | [diff] [blame] | 37 | if test1: if test2: print(x) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 38 | |
| 39 | Also note that the semicolon binds tighter than the colon in this context, so |
Georg Brandl | 6911e3c | 2007-09-04 07:15:32 +0000 | [diff] [blame] | 40 | that in the following example, either all or none of the :func:`print` calls are |
| 41 | executed:: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 42 | |
Georg Brandl | 6911e3c | 2007-09-04 07:15:32 +0000 | [diff] [blame] | 43 | if x < y < z: print(x); print(y); print(z) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 44 | |
| 45 | Summarizing: |
| 46 | |
| 47 | .. productionlist:: |
| 48 | compound_stmt: `if_stmt` |
| 49 | : | `while_stmt` |
| 50 | : | `for_stmt` |
| 51 | : | `try_stmt` |
| 52 | : | `with_stmt` |
| 53 | : | `funcdef` |
| 54 | : | `classdef` |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 55 | : | `async_with_stmt` |
| 56 | : | `async_for_stmt` |
| 57 | : | `async_funcdef` |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 58 | suite: `stmt_list` NEWLINE | NEWLINE INDENT `statement`+ DEDENT |
| 59 | statement: `stmt_list` NEWLINE | `compound_stmt` |
| 60 | stmt_list: `simple_stmt` (";" `simple_stmt`)* [";"] |
| 61 | |
| 62 | .. index:: |
| 63 | single: NEWLINE token |
| 64 | single: DEDENT token |
| 65 | pair: dangling; else |
| 66 | |
| 67 | Note that statements always end in a ``NEWLINE`` possibly followed by a |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 68 | ``DEDENT``. Also note that optional continuation clauses always begin with a |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 69 | keyword that cannot start a statement, thus there are no ambiguities (the |
| 70 | 'dangling :keyword:`else`' problem is solved in Python by requiring nested |
| 71 | :keyword:`if` statements to be indented). |
| 72 | |
| 73 | The formatting of the grammar rules in the following sections places each clause |
| 74 | on a separate line for clarity. |
| 75 | |
| 76 | |
| 77 | .. _if: |
Christian Heimes | 5b5e81c | 2007-12-31 16:14:33 +0000 | [diff] [blame] | 78 | .. _elif: |
| 79 | .. _else: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 80 | |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 81 | The :keyword:`!if` statement |
| 82 | ============================ |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 83 | |
Christian Heimes | faf2f63 | 2008-01-06 16:59:19 +0000 | [diff] [blame] | 84 | .. index:: |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 85 | ! statement: if |
Christian Heimes | faf2f63 | 2008-01-06 16:59:19 +0000 | [diff] [blame] | 86 | keyword: elif |
| 87 | keyword: else |
Serhiy Storchaka | 913876d | 2018-10-28 13:41:26 +0200 | [diff] [blame] | 88 | single: : (colon); compound statement |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 89 | |
| 90 | The :keyword:`if` statement is used for conditional execution: |
| 91 | |
| 92 | .. productionlist:: |
| 93 | if_stmt: "if" `expression` ":" `suite` |
Andrés Delfino | caccca78 | 2018-07-07 17:24:46 -0300 | [diff] [blame] | 94 | : ("elif" `expression` ":" `suite`)* |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 95 | : ["else" ":" `suite`] |
| 96 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 97 | It selects exactly one of the suites by evaluating the expressions one by one |
| 98 | until one is found to be true (see section :ref:`booleans` for the definition of |
| 99 | true and false); then that suite is executed (and no other part of the |
| 100 | :keyword:`if` statement is executed or evaluated). If all expressions are |
| 101 | false, the suite of the :keyword:`else` clause, if present, is executed. |
| 102 | |
| 103 | |
| 104 | .. _while: |
| 105 | |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 106 | The :keyword:`!while` statement |
| 107 | =============================== |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 108 | |
| 109 | .. index:: |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 110 | ! statement: while |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 111 | keyword: else |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 112 | pair: loop; statement |
Serhiy Storchaka | 913876d | 2018-10-28 13:41:26 +0200 | [diff] [blame] | 113 | single: : (colon); compound statement |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 114 | |
| 115 | The :keyword:`while` statement is used for repeated execution as long as an |
| 116 | expression is true: |
| 117 | |
| 118 | .. productionlist:: |
| 119 | while_stmt: "while" `expression` ":" `suite` |
| 120 | : ["else" ":" `suite`] |
| 121 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 122 | This repeatedly tests the expression and, if it is true, executes the first |
| 123 | suite; if the expression is false (which may be the first time it is tested) the |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 124 | suite of the :keyword:`!else` clause, if present, is executed and the loop |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 125 | terminates. |
| 126 | |
| 127 | .. index:: |
| 128 | statement: break |
| 129 | statement: continue |
| 130 | |
| 131 | A :keyword:`break` statement executed in the first suite terminates the loop |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 132 | without executing the :keyword:`!else` clause's suite. A :keyword:`continue` |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 133 | statement executed in the first suite skips the rest of the suite and goes back |
| 134 | to testing the expression. |
| 135 | |
| 136 | |
| 137 | .. _for: |
| 138 | |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 139 | The :keyword:`!for` statement |
| 140 | ============================= |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 141 | |
| 142 | .. index:: |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 143 | ! statement: for |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 144 | keyword: in |
| 145 | keyword: else |
| 146 | pair: target; list |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 147 | pair: loop; statement |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 148 | object: sequence |
Serhiy Storchaka | 913876d | 2018-10-28 13:41:26 +0200 | [diff] [blame] | 149 | single: : (colon); compound statement |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 150 | |
| 151 | The :keyword:`for` statement is used to iterate over the elements of a sequence |
| 152 | (such as a string, tuple or list) or other iterable object: |
| 153 | |
| 154 | .. productionlist:: |
| 155 | for_stmt: "for" `target_list` "in" `expression_list` ":" `suite` |
| 156 | : ["else" ":" `suite`] |
| 157 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 158 | The expression list is evaluated once; it should yield an iterable object. An |
| 159 | iterator is created for the result of the ``expression_list``. The suite is |
Raymond Hettinger | aa7886d | 2014-05-26 22:20:37 -0700 | [diff] [blame] | 160 | then executed once for each item provided by the iterator, in the order returned |
| 161 | by the iterator. Each item in turn is assigned to the target list using the |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 162 | standard rules for assignments (see :ref:`assignment`), and then the suite is |
| 163 | executed. When the items are exhausted (which is immediately when the sequence |
| 164 | is empty or an iterator raises a :exc:`StopIteration` exception), the suite in |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 165 | the :keyword:`!else` clause, if present, is executed, and the loop terminates. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 166 | |
| 167 | .. index:: |
| 168 | statement: break |
| 169 | statement: continue |
| 170 | |
| 171 | A :keyword:`break` statement executed in the first suite terminates the loop |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 172 | without executing the :keyword:`!else` clause's suite. A :keyword:`continue` |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 173 | statement executed in the first suite skips the rest of the suite and continues |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 174 | with the next item, or with the :keyword:`!else` clause if there is no next |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 175 | item. |
| 176 | |
Andrés Delfino | e42b705 | 2018-07-26 12:35:23 -0300 | [diff] [blame] | 177 | The for-loop makes assignments to the variables in the target list. |
Raymond Hettinger | aa7886d | 2014-05-26 22:20:37 -0700 | [diff] [blame] | 178 | This overwrites all previous assignments to those variables including |
| 179 | those made in the suite of the for-loop:: |
| 180 | |
| 181 | for i in range(10): |
| 182 | print(i) |
| 183 | i = 5 # this will not affect the for-loop |
Zachary Ware | 2f78b84 | 2014-06-03 09:32:40 -0500 | [diff] [blame] | 184 | # because i will be overwritten with the next |
Raymond Hettinger | aa7886d | 2014-05-26 22:20:37 -0700 | [diff] [blame] | 185 | # index in the range |
| 186 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 187 | |
| 188 | .. index:: |
| 189 | builtin: range |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 190 | |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 191 | Names in the target list are not deleted when the loop is finished, but if the |
Raymond Hettinger | aa7886d | 2014-05-26 22:20:37 -0700 | [diff] [blame] | 192 | sequence is empty, they will not have been assigned to at all by the loop. Hint: |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 193 | the built-in function :func:`range` returns an iterator of integers suitable to |
Benjamin Peterson | 3db5e7b | 2009-06-03 03:13:30 +0000 | [diff] [blame] | 194 | emulate the effect of Pascal's ``for i := a to b do``; e.g., ``list(range(3))`` |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 195 | returns the list ``[0, 1, 2]``. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 196 | |
Georg Brandl | e720c0a | 2009-04-27 16:20:50 +0000 | [diff] [blame] | 197 | .. note:: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 198 | |
| 199 | .. index:: |
| 200 | single: loop; over mutable sequence |
| 201 | single: mutable sequence; loop over |
| 202 | |
| 203 | There is a subtlety when the sequence is being modified by the loop (this can |
Andrés Delfino | 6921ef7 | 2018-07-30 15:44:35 -0300 | [diff] [blame] | 204 | only occur for mutable sequences, e.g. lists). An internal counter is used |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 205 | to keep track of which item is used next, and this is incremented on each |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 206 | iteration. When this counter has reached the length of the sequence the loop |
| 207 | terminates. This means that if the suite deletes the current (or a previous) |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 208 | item from the sequence, the next item will be skipped (since it gets the |
| 209 | index of the current item which has already been treated). Likewise, if the |
| 210 | suite inserts an item in the sequence before the current item, the current |
| 211 | item will be treated again the next time through the loop. This can lead to |
| 212 | nasty bugs that can be avoided by making a temporary copy using a slice of |
| 213 | the whole sequence, e.g., :: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 214 | |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 215 | for x in a[:]: |
| 216 | if x < 0: a.remove(x) |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 217 | |
| 218 | |
| 219 | .. _try: |
Christian Heimes | 5b5e81c | 2007-12-31 16:14:33 +0000 | [diff] [blame] | 220 | .. _except: |
| 221 | .. _finally: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 222 | |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 223 | The :keyword:`!try` statement |
| 224 | ============================= |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 225 | |
Christian Heimes | faf2f63 | 2008-01-06 16:59:19 +0000 | [diff] [blame] | 226 | .. index:: |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 227 | ! statement: try |
Christian Heimes | faf2f63 | 2008-01-06 16:59:19 +0000 | [diff] [blame] | 228 | keyword: except |
| 229 | keyword: finally |
Serhiy Storchaka | ddb961d | 2018-10-26 09:00:49 +0300 | [diff] [blame] | 230 | keyword: else |
| 231 | keyword: as |
Serhiy Storchaka | 913876d | 2018-10-28 13:41:26 +0200 | [diff] [blame] | 232 | single: : (colon); compound statement |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 233 | |
| 234 | The :keyword:`try` statement specifies exception handlers and/or cleanup code |
| 235 | for a group of statements: |
| 236 | |
| 237 | .. productionlist:: |
Andrés Delfino | caccca78 | 2018-07-07 17:24:46 -0300 | [diff] [blame] | 238 | try_stmt: `try1_stmt` | `try2_stmt` |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 239 | try1_stmt: "try" ":" `suite` |
Terry Jan Reedy | 65e3ecb | 2014-08-23 19:29:47 -0400 | [diff] [blame] | 240 | : ("except" [`expression` ["as" `identifier`]] ":" `suite`)+ |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 241 | : ["else" ":" `suite`] |
| 242 | : ["finally" ":" `suite`] |
| 243 | try2_stmt: "try" ":" `suite` |
| 244 | : "finally" ":" `suite` |
| 245 | |
Christian Heimes | faf2f63 | 2008-01-06 16:59:19 +0000 | [diff] [blame] | 246 | |
| 247 | The :keyword:`except` clause(s) specify one or more exception handlers. When no |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 248 | exception occurs in the :keyword:`try` clause, no exception handler is executed. |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 249 | When an exception occurs in the :keyword:`!try` suite, a search for an exception |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 250 | handler is started. This search inspects the except clauses in turn until one |
| 251 | is found that matches the exception. An expression-less except clause, if |
| 252 | present, must be last; it matches any exception. For an except clause with an |
| 253 | expression, that expression is evaluated, and the clause matches the exception |
| 254 | if the resulting object is "compatible" with the exception. An object is |
| 255 | compatible with an exception if it is the class or a base class of the exception |
| 256 | object or a tuple containing an item compatible with the exception. |
| 257 | |
| 258 | If no except clause matches the exception, the search for an exception handler |
| 259 | continues in the surrounding code and on the invocation stack. [#]_ |
| 260 | |
| 261 | If the evaluation of an expression in the header of an except clause raises an |
| 262 | exception, the original search for a handler is canceled and a search starts for |
| 263 | the new exception in the surrounding code and on the call stack (it is treated |
| 264 | as if the entire :keyword:`try` statement raised the exception). |
| 265 | |
Serhiy Storchaka | ddb961d | 2018-10-26 09:00:49 +0300 | [diff] [blame] | 266 | .. index:: single: as; except clause |
| 267 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 268 | When a matching except clause is found, the exception is assigned to the target |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 269 | specified after the :keyword:`!as` keyword in that except clause, if present, and |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 270 | the except clause's suite is executed. All except clauses must have an |
| 271 | executable block. When the end of this block is reached, execution continues |
| 272 | normally after the entire try statement. (This means that if two nested |
| 273 | handlers exist for the same exception, and the exception occurs in the try |
| 274 | clause of the inner handler, the outer handler will not handle the exception.) |
| 275 | |
| 276 | When an exception has been assigned using ``as target``, it is cleared at the |
| 277 | end of the except clause. This is as if :: |
| 278 | |
| 279 | except E as N: |
| 280 | foo |
| 281 | |
| 282 | was translated to :: |
| 283 | |
| 284 | except E as N: |
| 285 | try: |
| 286 | foo |
| 287 | finally: |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 288 | del N |
| 289 | |
Benjamin Peterson | fb288da | 2010-06-29 01:27:35 +0000 | [diff] [blame] | 290 | This means the exception must be assigned to a different name to be able to |
| 291 | refer to it after the except clause. Exceptions are cleared because with the |
| 292 | traceback attached to them, they form a reference cycle with the stack frame, |
| 293 | keeping all locals in that frame alive until the next garbage collection occurs. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 294 | |
| 295 | .. index:: |
| 296 | module: sys |
| 297 | object: traceback |
| 298 | |
| 299 | Before an except clause's suite is executed, details about the exception are |
Raymond Hettinger | aa7886d | 2014-05-26 22:20:37 -0700 | [diff] [blame] | 300 | stored in the :mod:`sys` module and can be accessed via :func:`sys.exc_info`. |
Georg Brandl | b30f330 | 2011-01-06 09:23:56 +0000 | [diff] [blame] | 301 | :func:`sys.exc_info` returns a 3-tuple consisting of the exception class, the |
| 302 | exception instance and a traceback object (see section :ref:`types`) identifying |
| 303 | the point in the program where the exception occurred. :func:`sys.exc_info` |
| 304 | values are restored to their previous values (before the call) when returning |
| 305 | from a function that handled an exception. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 306 | |
| 307 | .. index:: |
| 308 | keyword: else |
| 309 | statement: return |
| 310 | statement: break |
| 311 | statement: continue |
| 312 | |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 313 | The optional :keyword:`!else` clause is executed if the control flow leaves the |
Andrés Delfino | b086c8a | 2018-11-11 16:33:51 -0300 | [diff] [blame] | 314 | :keyword:`try` suite, no exception was raised, and no :keyword:`return`, |
| 315 | :keyword:`continue`, or :keyword:`break` statement was executed. Exceptions in |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 316 | the :keyword:`!else` clause are not handled by the preceding :keyword:`except` |
Andrés Delfino | b086c8a | 2018-11-11 16:33:51 -0300 | [diff] [blame] | 317 | clauses. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 318 | |
| 319 | .. index:: keyword: finally |
| 320 | |
| 321 | If :keyword:`finally` is present, it specifies a 'cleanup' handler. The |
| 322 | :keyword:`try` clause is executed, including any :keyword:`except` and |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 323 | :keyword:`!else` clauses. If an exception occurs in any of the clauses and is |
| 324 | not handled, the exception is temporarily saved. The :keyword:`!finally` clause |
Mark Dickinson | 05ee581 | 2012-09-24 20:16:38 +0100 | [diff] [blame] | 325 | is executed. If there is a saved exception it is re-raised at the end of the |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 326 | :keyword:`!finally` clause. If the :keyword:`!finally` clause raises another |
Mark Dickinson | 05ee581 | 2012-09-24 20:16:38 +0100 | [diff] [blame] | 327 | exception, the saved exception is set as the context of the new exception. |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 328 | If the :keyword:`!finally` clause executes a :keyword:`return`, :keyword:`break` |
Serhiy Storchaka | fe2bbb1 | 2018-03-18 09:56:52 +0200 | [diff] [blame] | 329 | or :keyword:`continue` statement, the saved exception is discarded:: |
Andrew Svetlov | f158d86 | 2012-08-14 15:38:15 +0300 | [diff] [blame] | 330 | |
Zachary Ware | 9fafc9f | 2014-05-06 09:18:17 -0500 | [diff] [blame] | 331 | >>> def f(): |
| 332 | ... try: |
| 333 | ... 1/0 |
| 334 | ... finally: |
| 335 | ... return 42 |
| 336 | ... |
| 337 | >>> f() |
| 338 | 42 |
Andrew Svetlov | f158d86 | 2012-08-14 15:38:15 +0300 | [diff] [blame] | 339 | |
| 340 | The exception information is not available to the program during execution of |
| 341 | the :keyword:`finally` clause. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 342 | |
| 343 | .. index:: |
| 344 | statement: return |
| 345 | statement: break |
| 346 | statement: continue |
| 347 | |
| 348 | When a :keyword:`return`, :keyword:`break` or :keyword:`continue` statement is |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 349 | executed in the :keyword:`try` suite of a :keyword:`!try`...\ :keyword:`!finally` |
Serhiy Storchaka | fe2bbb1 | 2018-03-18 09:56:52 +0200 | [diff] [blame] | 350 | statement, the :keyword:`finally` clause is also executed 'on the way out.' |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 351 | |
Zachary Ware | 8edd532 | 2014-05-06 09:07:13 -0500 | [diff] [blame] | 352 | The return value of a function is determined by the last :keyword:`return` |
| 353 | statement executed. Since the :keyword:`finally` clause always executes, a |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 354 | :keyword:`!return` statement executed in the :keyword:`!finally` clause will |
Zachary Ware | 8edd532 | 2014-05-06 09:07:13 -0500 | [diff] [blame] | 355 | always be the last one executed:: |
| 356 | |
| 357 | >>> def foo(): |
| 358 | ... try: |
| 359 | ... return 'try' |
| 360 | ... finally: |
| 361 | ... return 'finally' |
| 362 | ... |
| 363 | >>> foo() |
| 364 | 'finally' |
| 365 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 366 | Additional information on exceptions can be found in section :ref:`exceptions`, |
| 367 | and information on using the :keyword:`raise` statement to generate exceptions |
| 368 | may be found in section :ref:`raise`. |
| 369 | |
Serhiy Storchaka | fe2bbb1 | 2018-03-18 09:56:52 +0200 | [diff] [blame] | 370 | .. versionchanged:: 3.8 |
| 371 | Prior to Python 3.8, a :keyword:`continue` statement was illegal in the |
| 372 | :keyword:`finally` clause due to a problem with the implementation. |
| 373 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 374 | |
| 375 | .. _with: |
Christian Heimes | 5b5e81c | 2007-12-31 16:14:33 +0000 | [diff] [blame] | 376 | .. _as: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 377 | |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 378 | The :keyword:`!with` statement |
| 379 | ============================== |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 380 | |
Terry Jan Reedy | 7c895ed | 2014-04-29 00:58:56 -0400 | [diff] [blame] | 381 | .. index:: |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 382 | ! statement: with |
Serhiy Storchaka | ddb961d | 2018-10-26 09:00:49 +0300 | [diff] [blame] | 383 | keyword: as |
| 384 | single: as; with statement |
Serhiy Storchaka | 913876d | 2018-10-28 13:41:26 +0200 | [diff] [blame] | 385 | single: , (comma); with statement |
| 386 | single: : (colon); compound statement |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 387 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 388 | The :keyword:`with` statement is used to wrap the execution of a block with |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 389 | methods defined by a context manager (see section :ref:`context-managers`). |
| 390 | This allows common :keyword:`try`...\ :keyword:`except`...\ :keyword:`finally` |
| 391 | usage patterns to be encapsulated for convenient reuse. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 392 | |
| 393 | .. productionlist:: |
Andrés Delfino | caccca78 | 2018-07-07 17:24:46 -0300 | [diff] [blame] | 394 | with_stmt: "with" `with_item` ("," `with_item`)* ":" `suite` |
Georg Brandl | 0c31562 | 2009-05-25 21:10:36 +0000 | [diff] [blame] | 395 | with_item: `expression` ["as" `target`] |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 396 | |
Georg Brandl | 0c31562 | 2009-05-25 21:10:36 +0000 | [diff] [blame] | 397 | The execution of the :keyword:`with` statement with one "item" proceeds as follows: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 398 | |
Georg Brandl | 3387f48 | 2010-09-03 22:40:02 +0000 | [diff] [blame] | 399 | #. The context expression (the expression given in the :token:`with_item`) is |
| 400 | evaluated to obtain a context manager. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 401 | |
Benjamin Peterson | 876b2f2 | 2009-06-28 03:18:59 +0000 | [diff] [blame] | 402 | #. The context manager's :meth:`__exit__` is loaded for later use. |
| 403 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 404 | #. The context manager's :meth:`__enter__` method is invoked. |
| 405 | |
| 406 | #. If a target was included in the :keyword:`with` statement, the return value |
| 407 | from :meth:`__enter__` is assigned to it. |
| 408 | |
| 409 | .. note:: |
| 410 | |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 411 | The :keyword:`with` statement guarantees that if the :meth:`__enter__` |
| 412 | method returns without an error, then :meth:`__exit__` will always be |
Benjamin Peterson | 876b2f2 | 2009-06-28 03:18:59 +0000 | [diff] [blame] | 413 | called. Thus, if an error occurs during the assignment to the target list, |
| 414 | it will be treated the same as an error occurring within the suite would |
| 415 | be. See step 6 below. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 416 | |
| 417 | #. The suite is executed. |
| 418 | |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 419 | #. The context manager's :meth:`__exit__` method is invoked. If an exception |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 420 | caused the suite to be exited, its type, value, and traceback are passed as |
| 421 | arguments to :meth:`__exit__`. Otherwise, three :const:`None` arguments are |
| 422 | supplied. |
| 423 | |
| 424 | If the suite was exited due to an exception, and the return value from the |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 425 | :meth:`__exit__` method was false, the exception is reraised. If the return |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 426 | value was true, the exception is suppressed, and execution continues with the |
| 427 | statement following the :keyword:`with` statement. |
| 428 | |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 429 | If the suite was exited for any reason other than an exception, the return |
| 430 | value from :meth:`__exit__` is ignored, and execution proceeds at the normal |
| 431 | location for the kind of exit that was taken. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 432 | |
Georg Brandl | 0c31562 | 2009-05-25 21:10:36 +0000 | [diff] [blame] | 433 | With more than one item, the context managers are processed as if multiple |
| 434 | :keyword:`with` statements were nested:: |
| 435 | |
| 436 | with A() as a, B() as b: |
| 437 | suite |
| 438 | |
| 439 | is equivalent to :: |
| 440 | |
| 441 | with A() as a: |
| 442 | with B() as b: |
| 443 | suite |
| 444 | |
| 445 | .. versionchanged:: 3.1 |
| 446 | Support for multiple context expressions. |
| 447 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 448 | .. seealso:: |
| 449 | |
Serhiy Storchaka | e4ba872 | 2016-03-31 15:30:54 +0300 | [diff] [blame] | 450 | :pep:`343` - The "with" statement |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 451 | The specification, background, and examples for the Python :keyword:`with` |
| 452 | statement. |
| 453 | |
| 454 | |
Chris Jerdonek | b430994 | 2012-12-25 14:54:44 -0800 | [diff] [blame] | 455 | .. index:: |
| 456 | single: parameter; function definition |
| 457 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 458 | .. _function: |
Christian Heimes | 5b5e81c | 2007-12-31 16:14:33 +0000 | [diff] [blame] | 459 | .. _def: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 460 | |
| 461 | Function definitions |
| 462 | ==================== |
| 463 | |
| 464 | .. index:: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 465 | statement: def |
Christian Heimes | faf2f63 | 2008-01-06 16:59:19 +0000 | [diff] [blame] | 466 | pair: function; definition |
| 467 | pair: function; name |
| 468 | pair: name; binding |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 469 | object: user-defined function |
| 470 | object: function |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 471 | pair: function; name |
| 472 | pair: name; binding |
Serhiy Storchaka | 913876d | 2018-10-28 13:41:26 +0200 | [diff] [blame] | 473 | single: () (parentheses); function definition |
| 474 | single: , (comma); parameter list |
| 475 | single: : (colon); compound statement |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 476 | |
| 477 | A function definition defines a user-defined function object (see section |
| 478 | :ref:`types`): |
| 479 | |
| 480 | .. productionlist:: |
Andrés Delfino | caccca78 | 2018-07-07 17:24:46 -0300 | [diff] [blame] | 481 | funcdef: [`decorators`] "def" `funcname` "(" [`parameter_list`] ")" |
| 482 | : ["->" `expression`] ":" `suite` |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 483 | decorators: `decorator`+ |
Benjamin Peterson | bc7ee43 | 2016-05-16 23:18:33 -0700 | [diff] [blame] | 484 | decorator: "@" `dotted_name` ["(" [`argument_list` [","]] ")"] NEWLINE |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 485 | dotted_name: `identifier` ("." `identifier`)* |
Pablo Galindo | 29cb21d | 2019-05-29 22:59:00 +0100 | [diff] [blame^] | 486 | parameter_list: `defparameter` ("," `defparameter`)* "," "/" ["," [`parameter_list_no_posonly`]] |
Pablo Galindo | b76302d | 2019-05-29 00:45:32 +0100 | [diff] [blame] | 487 | : | `parameter_list_no_posonly` |
| 488 | parameter_list_no_posonly: `defparameter` ("," `defparameter`)* ["," [`parameter_list_starargs`]] |
| 489 | : | `parameter_list_starargs` |
Robert Collins | df39599 | 2015-08-12 08:00:06 +1200 | [diff] [blame] | 490 | parameter_list_starargs: "*" [`parameter`] ("," `defparameter`)* ["," ["**" `parameter` [","]]] |
Andrés Delfino | caccca78 | 2018-07-07 17:24:46 -0300 | [diff] [blame] | 491 | : | "**" `parameter` [","] |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 492 | parameter: `identifier` [":" `expression`] |
| 493 | defparameter: `parameter` ["=" `expression`] |
| 494 | funcname: `identifier` |
| 495 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 496 | |
| 497 | A function definition is an executable statement. Its execution binds the |
| 498 | function name in the current local namespace to a function object (a wrapper |
| 499 | around the executable code for the function). This function object contains a |
| 500 | reference to the current global namespace as the global namespace to be used |
| 501 | when the function is called. |
| 502 | |
| 503 | The function definition does not execute the function body; this gets executed |
Georg Brandl | 3dbca81 | 2008-07-23 16:10:53 +0000 | [diff] [blame] | 504 | only when the function is called. [#]_ |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 505 | |
Christian Heimes | dae2a89 | 2008-04-19 00:55:37 +0000 | [diff] [blame] | 506 | .. index:: |
Serhiy Storchaka | 913876d | 2018-10-28 13:41:26 +0200 | [diff] [blame] | 507 | single: @ (at); function definition |
Christian Heimes | dae2a89 | 2008-04-19 00:55:37 +0000 | [diff] [blame] | 508 | |
Christian Heimes | d8654cf | 2007-12-02 15:22:16 +0000 | [diff] [blame] | 509 | A function definition may be wrapped by one or more :term:`decorator` expressions. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 510 | Decorator expressions are evaluated when the function is defined, in the scope |
| 511 | that contains the function definition. The result must be a callable, which is |
| 512 | invoked with the function object as the only argument. The returned value is |
| 513 | bound to the function name instead of the function object. Multiple decorators |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 514 | are applied in nested fashion. For example, the following code :: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 515 | |
| 516 | @f1(arg) |
| 517 | @f2 |
| 518 | def func(): pass |
| 519 | |
Berker Peksag | 6cafece | 2016-08-03 10:17:21 +0300 | [diff] [blame] | 520 | is roughly equivalent to :: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 521 | |
| 522 | def func(): pass |
| 523 | func = f1(arg)(f2(func)) |
| 524 | |
Berker Peksag | 6cafece | 2016-08-03 10:17:21 +0300 | [diff] [blame] | 525 | except that the original function is not temporarily bound to the name ``func``. |
| 526 | |
Chris Jerdonek | b430994 | 2012-12-25 14:54:44 -0800 | [diff] [blame] | 527 | .. index:: |
| 528 | triple: default; parameter; value |
| 529 | single: argument; function definition |
Serhiy Storchaka | 913876d | 2018-10-28 13:41:26 +0200 | [diff] [blame] | 530 | single: = (equals); function definition |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 531 | |
Chris Jerdonek | b430994 | 2012-12-25 14:54:44 -0800 | [diff] [blame] | 532 | When one or more :term:`parameters <parameter>` have the form *parameter* ``=`` |
| 533 | *expression*, the function is said to have "default parameter values." For a |
| 534 | parameter with a default value, the corresponding :term:`argument` may be |
| 535 | omitted from a call, in which |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 536 | case the parameter's default value is substituted. If a parameter has a default |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 537 | value, all following parameters up until the "``*``" must also have a default |
| 538 | value --- this is a syntactic restriction that is not expressed by the grammar. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 539 | |
Benjamin Peterson | 1ef876c | 2013-02-10 09:29:59 -0500 | [diff] [blame] | 540 | **Default parameter values are evaluated from left to right when the function |
| 541 | definition is executed.** This means that the expression is evaluated once, when |
| 542 | the function is defined, and that the same "pre-computed" value is used for each |
| 543 | call. This is especially important to understand when a default parameter is a |
| 544 | mutable object, such as a list or a dictionary: if the function modifies the |
| 545 | object (e.g. by appending an item to a list), the default value is in effect |
| 546 | modified. This is generally not what was intended. A way around this is to use |
| 547 | ``None`` as the default, and explicitly test for it in the body of the function, |
| 548 | e.g.:: |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 549 | |
| 550 | def whats_on_the_telly(penguin=None): |
| 551 | if penguin is None: |
| 552 | penguin = [] |
| 553 | penguin.append("property of the zoo") |
| 554 | return penguin |
| 555 | |
Christian Heimes | dae2a89 | 2008-04-19 00:55:37 +0000 | [diff] [blame] | 556 | .. index:: |
Serhiy Storchaka | 913876d | 2018-10-28 13:41:26 +0200 | [diff] [blame] | 557 | single: * (asterisk); function definition |
Serhiy Storchaka | ddb961d | 2018-10-26 09:00:49 +0300 | [diff] [blame] | 558 | single: **; function definition |
Christian Heimes | dae2a89 | 2008-04-19 00:55:37 +0000 | [diff] [blame] | 559 | |
| 560 | Function call semantics are described in more detail in section :ref:`calls`. A |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 561 | function call always assigns values to all parameters mentioned in the parameter |
| 562 | list, either from position arguments, from keyword arguments, or from default |
| 563 | values. If the form "``*identifier``" is present, it is initialized to a tuple |
Eric Snow | b957b0c | 2016-09-08 13:59:58 -0700 | [diff] [blame] | 564 | receiving any excess positional parameters, defaulting to the empty tuple. |
| 565 | If the form "``**identifier``" is present, it is initialized to a new |
| 566 | ordered mapping receiving any excess keyword arguments, defaulting to a |
| 567 | new empty mapping of the same type. Parameters after "``*``" or |
| 568 | "``*identifier``" are keyword-only parameters and may only be passed |
| 569 | used keyword arguments. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 570 | |
Serhiy Storchaka | ddb961d | 2018-10-26 09:00:49 +0300 | [diff] [blame] | 571 | .. index:: |
| 572 | pair: function; annotations |
| 573 | single: ->; function annotations |
Serhiy Storchaka | 913876d | 2018-10-28 13:41:26 +0200 | [diff] [blame] | 574 | single: : (colon); function annotations |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 575 | |
Cheryl Sabella | b7105c9 | 2018-12-24 00:09:09 -0500 | [diff] [blame] | 576 | Parameters may have an :term:`annotation <function annotation>` of the form "``: expression``" |
| 577 | following the parameter name. Any parameter may have an annotation, even those of the form |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 578 | ``*identifier`` or ``**identifier``. Functions may have "return" annotation of |
| 579 | the form "``-> expression``" after the parameter list. These annotations can be |
Guido van Rossum | 95e4d58 | 2018-01-26 08:20:18 -0800 | [diff] [blame] | 580 | any valid Python expression. The presence of annotations does not change the |
| 581 | semantics of a function. The annotation values are available as values of |
| 582 | a dictionary keyed by the parameters' names in the :attr:`__annotations__` |
| 583 | attribute of the function object. If the ``annotations`` import from |
| 584 | :mod:`__future__` is used, annotations are preserved as strings at runtime which |
| 585 | enables postponed evaluation. Otherwise, they are evaluated when the function |
| 586 | definition is executed. In this case annotations may be evaluated in |
| 587 | a different order than they appear in the source code. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 588 | |
Georg Brandl | 242e6a0 | 2013-10-06 10:28:39 +0200 | [diff] [blame] | 589 | .. index:: pair: lambda; expression |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 590 | |
| 591 | It is also possible to create anonymous functions (functions not bound to a |
Georg Brandl | 242e6a0 | 2013-10-06 10:28:39 +0200 | [diff] [blame] | 592 | name), for immediate use in expressions. This uses lambda expressions, described in |
| 593 | section :ref:`lambda`. Note that the lambda expression is merely a shorthand for a |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 594 | simplified function definition; a function defined in a ":keyword:`def`" |
| 595 | statement can be passed around or assigned to another name just like a function |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 596 | defined by a lambda expression. The ":keyword:`!def`" form is actually more powerful |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 597 | since it allows the execution of multiple statements and annotations. |
| 598 | |
Georg Brandl | 242e6a0 | 2013-10-06 10:28:39 +0200 | [diff] [blame] | 599 | **Programmer's note:** Functions are first-class objects. A "``def``" statement |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 600 | executed inside a function definition defines a local function that can be |
| 601 | returned or passed around. Free variables used in the nested function can |
| 602 | access the local variables of the function containing the def. See section |
| 603 | :ref:`naming` for details. |
| 604 | |
Georg Brandl | 64a4094 | 2012-03-10 09:22:47 +0100 | [diff] [blame] | 605 | .. seealso:: |
| 606 | |
| 607 | :pep:`3107` - Function Annotations |
| 608 | The original specification for function annotations. |
| 609 | |
Guido van Rossum | 95e4d58 | 2018-01-26 08:20:18 -0800 | [diff] [blame] | 610 | :pep:`484` - Type Hints |
| 611 | Definition of a standard meaning for annotations: type hints. |
| 612 | |
| 613 | :pep:`526` - Syntax for Variable Annotations |
| 614 | Ability to type hint variable declarations, including class |
| 615 | variables and instance variables |
| 616 | |
| 617 | :pep:`563` - Postponed Evaluation of Annotations |
| 618 | Support for forward references within annotations by preserving |
| 619 | annotations in a string form at runtime instead of eager evaluation. |
| 620 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 621 | |
| 622 | .. _class: |
| 623 | |
| 624 | Class definitions |
| 625 | ================= |
| 626 | |
| 627 | .. index:: |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 628 | object: class |
Christian Heimes | faf2f63 | 2008-01-06 16:59:19 +0000 | [diff] [blame] | 629 | statement: class |
| 630 | pair: class; definition |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 631 | pair: class; name |
| 632 | pair: name; binding |
| 633 | pair: execution; frame |
Christian Heimes | faf2f63 | 2008-01-06 16:59:19 +0000 | [diff] [blame] | 634 | single: inheritance |
Georg Brandl | 3dbca81 | 2008-07-23 16:10:53 +0000 | [diff] [blame] | 635 | single: docstring |
Serhiy Storchaka | 913876d | 2018-10-28 13:41:26 +0200 | [diff] [blame] | 636 | single: () (parentheses); class definition |
| 637 | single: , (comma); expression list |
| 638 | single: : (colon); compound statement |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 639 | |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 640 | A class definition defines a class object (see section :ref:`types`): |
| 641 | |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 642 | .. productionlist:: |
| 643 | classdef: [`decorators`] "class" `classname` [`inheritance`] ":" `suite` |
Benjamin Peterson | 54044d6 | 2016-05-16 23:20:22 -0700 | [diff] [blame] | 644 | inheritance: "(" [`argument_list`] ")" |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 645 | classname: `identifier` |
| 646 | |
Georg Brandl | 65e5f80 | 2010-08-02 18:10:13 +0000 | [diff] [blame] | 647 | A class definition is an executable statement. The inheritance list usually |
| 648 | gives a list of base classes (see :ref:`metaclasses` for more advanced uses), so |
| 649 | each item in the list should evaluate to a class object which allows |
Éric Araujo | 28053fb | 2010-11-22 03:09:19 +0000 | [diff] [blame] | 650 | subclassing. Classes without an inheritance list inherit, by default, from the |
| 651 | base class :class:`object`; hence, :: |
| 652 | |
| 653 | class Foo: |
| 654 | pass |
| 655 | |
| 656 | is equivalent to :: |
| 657 | |
| 658 | class Foo(object): |
| 659 | pass |
Georg Brandl | 65e5f80 | 2010-08-02 18:10:13 +0000 | [diff] [blame] | 660 | |
| 661 | The class's suite is then executed in a new execution frame (see :ref:`naming`), |
| 662 | using a newly created local namespace and the original global namespace. |
| 663 | (Usually, the suite contains mostly function definitions.) When the class's |
| 664 | suite finishes execution, its execution frame is discarded but its local |
| 665 | namespace is saved. [#]_ A class object is then created using the inheritance |
| 666 | list for the base classes and the saved local namespace for the attribute |
| 667 | dictionary. The class name is bound to this class object in the original local |
| 668 | namespace. |
| 669 | |
Eric Snow | 92a6c17 | 2016-09-05 14:50:11 -0700 | [diff] [blame] | 670 | The order in which attributes are defined in the class body is preserved |
Eric Snow | 4f29e75 | 2016-09-08 15:11:11 -0700 | [diff] [blame] | 671 | in the new class's ``__dict__``. Note that this is reliable only right |
| 672 | after the class is created and only for classes that were defined using |
| 673 | the definition syntax. |
Eric Snow | 92a6c17 | 2016-09-05 14:50:11 -0700 | [diff] [blame] | 674 | |
Georg Brandl | 65e5f80 | 2010-08-02 18:10:13 +0000 | [diff] [blame] | 675 | Class creation can be customized heavily using :ref:`metaclasses <metaclasses>`. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 676 | |
Serhiy Storchaka | ddb961d | 2018-10-26 09:00:49 +0300 | [diff] [blame] | 677 | .. index:: |
Serhiy Storchaka | 913876d | 2018-10-28 13:41:26 +0200 | [diff] [blame] | 678 | single: @ (at); class definition |
Serhiy Storchaka | ddb961d | 2018-10-26 09:00:49 +0300 | [diff] [blame] | 679 | |
Georg Brandl | f414272 | 2010-10-17 10:38:20 +0000 | [diff] [blame] | 680 | Classes can also be decorated: just like when decorating functions, :: |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 681 | |
| 682 | @f1(arg) |
| 683 | @f2 |
| 684 | class Foo: pass |
| 685 | |
Berker Peksag | 6cafece | 2016-08-03 10:17:21 +0300 | [diff] [blame] | 686 | is roughly equivalent to :: |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 687 | |
| 688 | class Foo: pass |
| 689 | Foo = f1(arg)(f2(Foo)) |
| 690 | |
Georg Brandl | f414272 | 2010-10-17 10:38:20 +0000 | [diff] [blame] | 691 | The evaluation rules for the decorator expressions are the same as for function |
Berker Peksag | 6cafece | 2016-08-03 10:17:21 +0300 | [diff] [blame] | 692 | decorators. The result is then bound to the class name. |
Georg Brandl | f414272 | 2010-10-17 10:38:20 +0000 | [diff] [blame] | 693 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 694 | **Programmer's note:** Variables defined in the class definition are class |
Georg Brandl | 65e5f80 | 2010-08-02 18:10:13 +0000 | [diff] [blame] | 695 | attributes; they are shared by instances. Instance attributes can be set in a |
| 696 | method with ``self.name = value``. Both class and instance attributes are |
| 697 | accessible through the notation "``self.name``", and an instance attribute hides |
| 698 | a class attribute with the same name when accessed in this way. Class |
| 699 | attributes can be used as defaults for instance attributes, but using mutable |
| 700 | values there can lead to unexpected results. :ref:`Descriptors <descriptors>` |
| 701 | can be used to create instance variables with different implementation details. |
Georg Brandl | 85eb8c1 | 2007-08-31 16:33:38 +0000 | [diff] [blame] | 702 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 703 | |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 704 | .. seealso:: |
| 705 | |
Andrés Delfino | 0f14fc1 | 2018-10-19 20:31:15 -0300 | [diff] [blame] | 706 | :pep:`3115` - Metaclasses in Python 3000 |
| 707 | The proposal that changed the declaration of metaclasses to the current |
| 708 | syntax, and the semantics for how classes with metaclasses are |
| 709 | constructed. |
| 710 | |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 711 | :pep:`3129` - Class Decorators |
Andrés Delfino | 0f14fc1 | 2018-10-19 20:31:15 -0300 | [diff] [blame] | 712 | The proposal that added class decorators. Function and method decorators |
| 713 | were introduced in :pep:`318`. |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 714 | |
Georg Brandl | 02c3056 | 2007-09-07 17:52:53 +0000 | [diff] [blame] | 715 | |
Elvis Pranskevichus | 63536bd | 2018-05-19 23:15:06 -0400 | [diff] [blame] | 716 | .. _async: |
| 717 | |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 718 | Coroutines |
| 719 | ========== |
| 720 | |
Yury Selivanov | 5376ba9 | 2015-06-22 12:19:30 -0400 | [diff] [blame] | 721 | .. versionadded:: 3.5 |
| 722 | |
Yury Selivanov | 66f8828 | 2015-06-24 11:04:15 -0400 | [diff] [blame] | 723 | .. index:: statement: async def |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 724 | .. _`async def`: |
| 725 | |
| 726 | Coroutine function definition |
| 727 | ----------------------------- |
| 728 | |
| 729 | .. productionlist:: |
Andrés Delfino | caccca78 | 2018-07-07 17:24:46 -0300 | [diff] [blame] | 730 | async_funcdef: [`decorators`] "async" "def" `funcname` "(" [`parameter_list`] ")" |
| 731 | : ["->" `expression`] ":" `suite` |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 732 | |
Yury Selivanov | 66f8828 | 2015-06-24 11:04:15 -0400 | [diff] [blame] | 733 | .. index:: |
| 734 | keyword: async |
| 735 | keyword: await |
| 736 | |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 737 | Execution of Python coroutines can be suspended and resumed at many points |
Andrés Delfino | 95f68b1 | 2018-10-28 07:41:57 -0300 | [diff] [blame] | 738 | (see :term:`coroutine`). Inside the body of a coroutine function, ``await`` and |
Yury Selivanov | 66f8828 | 2015-06-24 11:04:15 -0400 | [diff] [blame] | 739 | ``async`` identifiers become reserved keywords; :keyword:`await` expressions, |
| 740 | :keyword:`async for` and :keyword:`async with` can only be used in |
Andrés Delfino | 95f68b1 | 2018-10-28 07:41:57 -0300 | [diff] [blame] | 741 | coroutine function bodies. |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 742 | |
| 743 | Functions defined with ``async def`` syntax are always coroutine functions, |
| 744 | even if they do not contain ``await`` or ``async`` keywords. |
| 745 | |
Andrés Delfino | 95f68b1 | 2018-10-28 07:41:57 -0300 | [diff] [blame] | 746 | It is a :exc:`SyntaxError` to use a ``yield from`` expression inside the body |
| 747 | of a coroutine function. |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 748 | |
Yury Selivanov | 5376ba9 | 2015-06-22 12:19:30 -0400 | [diff] [blame] | 749 | An example of a coroutine function:: |
| 750 | |
| 751 | async def func(param1, param2): |
| 752 | do_stuff() |
| 753 | await some_coroutine() |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 754 | |
| 755 | |
Yury Selivanov | 66f8828 | 2015-06-24 11:04:15 -0400 | [diff] [blame] | 756 | .. index:: statement: async for |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 757 | .. _`async for`: |
| 758 | |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 759 | The :keyword:`!async for` statement |
| 760 | ----------------------------------- |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 761 | |
| 762 | .. productionlist:: |
| 763 | async_for_stmt: "async" `for_stmt` |
| 764 | |
| 765 | An :term:`asynchronous iterable` is able to call asynchronous code in its |
| 766 | *iter* implementation, and :term:`asynchronous iterator` can call asynchronous |
| 767 | code in its *next* method. |
| 768 | |
| 769 | The ``async for`` statement allows convenient iteration over asynchronous |
| 770 | iterators. |
| 771 | |
| 772 | The following code:: |
| 773 | |
| 774 | async for TARGET in ITER: |
| 775 | BLOCK |
| 776 | else: |
| 777 | BLOCK2 |
| 778 | |
| 779 | Is semantically equivalent to:: |
| 780 | |
| 781 | iter = (ITER) |
Yury Selivanov | a6f6edb | 2016-06-09 15:08:31 -0400 | [diff] [blame] | 782 | iter = type(iter).__aiter__(iter) |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 783 | running = True |
| 784 | while running: |
| 785 | try: |
| 786 | TARGET = await type(iter).__anext__(iter) |
| 787 | except StopAsyncIteration: |
| 788 | running = False |
| 789 | else: |
| 790 | BLOCK |
| 791 | else: |
| 792 | BLOCK2 |
| 793 | |
| 794 | See also :meth:`__aiter__` and :meth:`__anext__` for details. |
| 795 | |
Andrés Delfino | 95f68b1 | 2018-10-28 07:41:57 -0300 | [diff] [blame] | 796 | It is a :exc:`SyntaxError` to use an ``async for`` statement outside the |
| 797 | body of a coroutine function. |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 798 | |
| 799 | |
Yury Selivanov | 66f8828 | 2015-06-24 11:04:15 -0400 | [diff] [blame] | 800 | .. index:: statement: async with |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 801 | .. _`async with`: |
| 802 | |
Serhiy Storchaka | 2b57c43 | 2018-12-19 08:09:46 +0200 | [diff] [blame] | 803 | The :keyword:`!async with` statement |
| 804 | ------------------------------------ |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 805 | |
| 806 | .. productionlist:: |
| 807 | async_with_stmt: "async" `with_stmt` |
| 808 | |
| 809 | An :term:`asynchronous context manager` is a :term:`context manager` that is |
| 810 | able to suspend execution in its *enter* and *exit* methods. |
| 811 | |
| 812 | The following code:: |
| 813 | |
| 814 | async with EXPR as VAR: |
| 815 | BLOCK |
| 816 | |
| 817 | Is semantically equivalent to:: |
| 818 | |
| 819 | mgr = (EXPR) |
| 820 | aexit = type(mgr).__aexit__ |
| 821 | aenter = type(mgr).__aenter__(mgr) |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 822 | |
| 823 | VAR = await aenter |
| 824 | try: |
| 825 | BLOCK |
| 826 | except: |
| 827 | if not await aexit(mgr, *sys.exc_info()): |
| 828 | raise |
| 829 | else: |
| 830 | await aexit(mgr, None, None, None) |
| 831 | |
| 832 | See also :meth:`__aenter__` and :meth:`__aexit__` for details. |
| 833 | |
Andrés Delfino | 95f68b1 | 2018-10-28 07:41:57 -0300 | [diff] [blame] | 834 | It is a :exc:`SyntaxError` to use an ``async with`` statement outside the |
| 835 | body of a coroutine function. |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 836 | |
| 837 | .. seealso:: |
| 838 | |
| 839 | :pep:`492` - Coroutines with async and await syntax |
Andrés Delfino | 0f14fc1 | 2018-10-19 20:31:15 -0300 | [diff] [blame] | 840 | The proposal that made coroutines a proper standalone concept in Python, |
| 841 | and added supporting syntax. |
Yury Selivanov | f3e40fa | 2015-05-21 11:50:30 -0400 | [diff] [blame] | 842 | |
| 843 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 844 | .. rubric:: Footnotes |
| 845 | |
Ezio Melotti | fc3db8a | 2011-06-26 11:25:28 +0300 | [diff] [blame] | 846 | .. [#] The exception is propagated to the invocation stack unless |
| 847 | there is a :keyword:`finally` clause which happens to raise another |
| 848 | exception. That new exception causes the old one to be lost. |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 849 | |
Georg Brandl | 3dbca81 | 2008-07-23 16:10:53 +0000 | [diff] [blame] | 850 | .. [#] A string literal appearing as the first statement in the function body is |
| 851 | transformed into the function's ``__doc__`` attribute and therefore the |
| 852 | function's :term:`docstring`. |
| 853 | |
| 854 | .. [#] A string literal appearing as the first statement in the class body is |
| 855 | transformed into the namespace's ``__doc__`` item and therefore the class's |
| 856 | :term:`docstring`. |