Fred Drake | 61c7728 | 1998-07-28 19:34:22 +0000 | [diff] [blame] | 1 | \chapter{Data model\label{datamodel}} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 2 | |
Fred Drake | 2829f1c | 2001-06-23 05:27:20 +0000 | [diff] [blame] | 3 | |
Fred Drake | 61c7728 | 1998-07-28 19:34:22 +0000 | [diff] [blame] | 4 | \section{Objects, values and types\label{objects}} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 5 | |
| 6 | \dfn{Objects} are Python's abstraction for data. All data in a Python |
| 7 | program is represented by objects or by relations between objects. |
| 8 | (In a sense, and in conformance to Von Neumann's model of a |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 9 | ``stored program computer,'' code is also represented by objects.) |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 10 | \index{object} |
| 11 | \index{data} |
| 12 | |
| 13 | Every object has an identity, a type and a value. An object's |
| 14 | \emph{identity} never changes once it has been created; you may think |
Fred Drake | 293dd4b | 2002-06-04 16:25:57 +0000 | [diff] [blame] | 15 | of it as the object's address in memory. The `\keyword{is}' operator |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 16 | compares the identity of two objects; the |
| 17 | \function{id()}\bifuncindex{id} function returns an integer |
| 18 | representing its identity (currently implemented as its address). |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 19 | An object's \dfn{type} is |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 20 | also unchangeable.\footnote{Since Python 2.2, a gradual merging of |
| 21 | types and classes has been started that makes this and a few other |
| 22 | assertions made in this manual not 100\% accurate and complete: |
| 23 | for example, it \emph{is} now possible in some cases to change an |
| 24 | object's type, under certain controlled conditions. Until this manual |
| 25 | undergoes extensive revision, it must now be taken as authoritative |
| 26 | only regarding ``classic classes'', that are still the default, for |
| 27 | compatibility purposes, in Python 2.2 and 2.3.} |
| 28 | An object's type determines the operations that the object |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 29 | supports (e.g., ``does it have a length?'') and also defines the |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 30 | possible values for objects of that type. The |
| 31 | \function{type()}\bifuncindex{type} function returns an object's type |
| 32 | (which is an object itself). The \emph{value} of some |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 33 | objects can change. Objects whose value can change are said to be |
| 34 | \emph{mutable}; objects whose value is unchangeable once they are |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 35 | created are called \emph{immutable}. |
Guido van Rossum | 264bd59 | 1999-02-23 16:40:55 +0000 | [diff] [blame] | 36 | (The value of an immutable container object that contains a reference |
| 37 | to a mutable object can change when the latter's value is changed; |
| 38 | however the container is still considered immutable, because the |
| 39 | collection of objects it contains cannot be changed. So, immutability |
| 40 | is not strictly the same as having an unchangeable value, it is more |
| 41 | subtle.) |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 42 | An object's mutability is determined by its type; for instance, |
| 43 | numbers, strings and tuples are immutable, while dictionaries and |
| 44 | lists are mutable. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 45 | \index{identity of an object} |
| 46 | \index{value of an object} |
| 47 | \index{type of an object} |
| 48 | \index{mutable object} |
| 49 | \index{immutable object} |
| 50 | |
| 51 | Objects are never explicitly destroyed; however, when they become |
| 52 | unreachable they may be garbage-collected. An implementation is |
Barry Warsaw | 92a6ed9 | 1998-08-07 16:33:51 +0000 | [diff] [blame] | 53 | allowed to postpone garbage collection or omit it altogether --- it is |
| 54 | a matter of implementation quality how garbage collection is |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 55 | implemented, as long as no objects are collected that are still |
| 56 | reachable. (Implementation note: the current implementation uses a |
Fred Drake | c8e8281 | 2001-01-22 17:46:18 +0000 | [diff] [blame] | 57 | reference-counting scheme with (optional) delayed detection of |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 58 | cyclically linked garbage, which collects most objects as soon as they |
Fred Drake | c8e8281 | 2001-01-22 17:46:18 +0000 | [diff] [blame] | 59 | become unreachable, but is not guaranteed to collect garbage |
| 60 | containing circular references. See the |
| 61 | \citetitle[../lib/module-gc.html]{Python Library Reference} for |
| 62 | information on controlling the collection of cyclic garbage.) |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 63 | \index{garbage collection} |
| 64 | \index{reference counting} |
| 65 | \index{unreachable object} |
| 66 | |
| 67 | Note that the use of the implementation's tracing or debugging |
| 68 | facilities may keep objects alive that would normally be collectable. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 69 | Also note that catching an exception with a |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 70 | `\keyword{try}...\keyword{except}' statement may keep objects alive. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 71 | |
| 72 | Some objects contain references to ``external'' resources such as open |
| 73 | files or windows. It is understood that these resources are freed |
| 74 | when the object is garbage-collected, but since garbage collection is |
| 75 | not guaranteed to happen, such objects also provide an explicit way to |
| 76 | release the external resource, usually a \method{close()} method. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 77 | Programs are strongly recommended to explicitly close such |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 78 | objects. The `\keyword{try}...\keyword{finally}' statement provides |
| 79 | a convenient way to do this. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 80 | |
| 81 | Some objects contain references to other objects; these are called |
| 82 | \emph{containers}. Examples of containers are tuples, lists and |
| 83 | dictionaries. The references are part of a container's value. In |
| 84 | most cases, when we talk about the value of a container, we imply the |
| 85 | values, not the identities of the contained objects; however, when we |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 86 | talk about the mutability of a container, only the identities of |
| 87 | the immediately contained objects are implied. So, if an immutable |
| 88 | container (like a tuple) |
| 89 | contains a reference to a mutable object, its value changes |
| 90 | if that mutable object is changed. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 91 | \index{container} |
| 92 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 93 | Types affect almost all aspects of object behavior. Even the importance |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 94 | of object identity is affected in some sense: for immutable types, |
| 95 | operations that compute new values may actually return a reference to |
| 96 | any existing object with the same type and value, while for mutable |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 97 | objects this is not allowed. E.g., after |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 98 | \samp{a = 1; b = 1}, |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 99 | \code{a} and \code{b} may or may not refer to the same object with the |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 100 | value one, depending on the implementation, but after |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 101 | \samp{c = []; d = []}, \code{c} and \code{d} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 102 | are guaranteed to refer to two different, unique, newly created empty |
| 103 | lists. |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 104 | (Note that \samp{c = d = []} assigns the same object to both |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 105 | \code{c} and \code{d}.) |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 106 | |
Fred Drake | 2829f1c | 2001-06-23 05:27:20 +0000 | [diff] [blame] | 107 | |
Fred Drake | 61c7728 | 1998-07-28 19:34:22 +0000 | [diff] [blame] | 108 | \section{The standard type hierarchy\label{types}} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 109 | |
| 110 | Below is a list of the types that are built into Python. Extension |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 111 | modules (written in C, Java, or other languages, depending on |
| 112 | the implementation) can define additional types. Future versions of |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 113 | Python may add types to the type hierarchy (e.g., rational |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 114 | numbers, efficiently stored arrays of integers, etc.). |
| 115 | \index{type} |
| 116 | \indexii{data}{type} |
| 117 | \indexii{type}{hierarchy} |
| 118 | \indexii{extension}{module} |
| 119 | \indexii{C}{language} |
| 120 | |
| 121 | Some of the type descriptions below contain a paragraph listing |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 122 | `special attributes.' These are attributes that provide access to the |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 123 | implementation and are not intended for general use. Their definition |
Fred Drake | 3570551 | 2001-12-03 17:32:27 +0000 | [diff] [blame] | 124 | may change in the future. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 125 | \index{attribute} |
| 126 | \indexii{special}{attribute} |
| 127 | \indexiii{generic}{special}{attribute} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 128 | |
| 129 | \begin{description} |
| 130 | |
| 131 | \item[None] |
| 132 | This type has a single value. There is a single object with this value. |
| 133 | This object is accessed through the built-in name \code{None}. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 134 | It is used to signify the absence of a value in many situations, e.g., |
| 135 | it is returned from functions that don't explicitly return anything. |
| 136 | Its truth value is false. |
Fred Drake | 7a700b8 | 2004-01-01 05:43:53 +0000 | [diff] [blame] | 137 | \obindex{None} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 138 | |
Neil Schemenauer | 48c2eb9 | 2001-01-04 01:25:50 +0000 | [diff] [blame] | 139 | \item[NotImplemented] |
| 140 | This type has a single value. There is a single object with this value. |
| 141 | This object is accessed through the built-in name \code{NotImplemented}. |
Guido van Rossum | ab782dd | 2001-01-18 15:17:06 +0000 | [diff] [blame] | 142 | Numeric methods and rich comparison methods may return this value if |
| 143 | they do not implement the operation for the operands provided. (The |
| 144 | interpreter will then try the reflected operation, or some other |
| 145 | fallback, depending on the operator.) Its truth value is true. |
Fred Drake | 7a700b8 | 2004-01-01 05:43:53 +0000 | [diff] [blame] | 146 | \obindex{NotImplemented} |
Neil Schemenauer | 48c2eb9 | 2001-01-04 01:25:50 +0000 | [diff] [blame] | 147 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 148 | \item[Ellipsis] |
| 149 | This type has a single value. There is a single object with this value. |
| 150 | This object is accessed through the built-in name \code{Ellipsis}. |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 151 | It is used to indicate the presence of the \samp{...} syntax in a |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 152 | slice. Its truth value is true. |
Fred Drake | c0a02c0 | 2002-04-16 02:03:05 +0000 | [diff] [blame] | 153 | \obindex{Ellipsis} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 154 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 155 | \item[Numbers] |
| 156 | These are created by numeric literals and returned as results by |
| 157 | arithmetic operators and arithmetic built-in functions. Numeric |
| 158 | objects are immutable; once created their value never changes. Python |
| 159 | numbers are of course strongly related to mathematical numbers, but |
| 160 | subject to the limitations of numerical representation in computers. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 161 | \obindex{numeric} |
| 162 | |
Fred Drake | b3384d3 | 2001-05-14 16:04:22 +0000 | [diff] [blame] | 163 | Python distinguishes between integers, floating point numbers, and |
| 164 | complex numbers: |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 165 | |
| 166 | \begin{description} |
| 167 | \item[Integers] |
Georg Brandl | d430726 | 2005-09-12 12:49:38 +0000 | [diff] [blame] | 168 | These represent elements from the mathematical set of integers |
| 169 | (positive and negative). |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 170 | \obindex{integer} |
| 171 | |
Guido van Rossum | 77f6a65 | 2002-04-03 22:41:51 +0000 | [diff] [blame] | 172 | There are three types of integers: |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 173 | |
| 174 | \begin{description} |
| 175 | |
| 176 | \item[Plain integers] |
| 177 | These represent numbers in the range -2147483648 through 2147483647. |
| 178 | (The range may be larger on machines with a larger natural word |
| 179 | size, but not smaller.) |
Fred Drake | e15956b | 2000-04-03 04:51:13 +0000 | [diff] [blame] | 180 | When the result of an operation would fall outside this range, the |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 181 | result is normally returned as a long integer (in some cases, the |
| 182 | exception \exception{OverflowError} is raised instead). |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 183 | For the purpose of shift and mask operations, integers are assumed to |
| 184 | have a binary, 2's complement notation using 32 or more bits, and |
| 185 | hiding no bits from the user (i.e., all 4294967296 different bit |
| 186 | patterns correspond to different values). |
| 187 | \obindex{plain integer} |
| 188 | \withsubitem{(built-in exception)}{\ttindex{OverflowError}} |
| 189 | |
| 190 | \item[Long integers] |
| 191 | These represent numbers in an unlimited range, subject to available |
| 192 | (virtual) memory only. For the purpose of shift and mask operations, |
| 193 | a binary representation is assumed, and negative numbers are |
| 194 | represented in a variant of 2's complement which gives the illusion of |
| 195 | an infinite string of sign bits extending to the left. |
| 196 | \obindex{long integer} |
| 197 | |
Guido van Rossum | 77f6a65 | 2002-04-03 22:41:51 +0000 | [diff] [blame] | 198 | \item[Booleans] |
| 199 | These represent the truth values False and True. The two objects |
| 200 | representing the values False and True are the only Boolean objects. |
| 201 | The Boolean type is a subtype of plain integers, and Boolean values |
| 202 | behave like the values 0 and 1, respectively, in almost all contexts, |
| 203 | the exception being that when converted to a string, the strings |
| 204 | \code{"False"} or \code{"True"} are returned, respectively. |
| 205 | \obindex{Boolean} |
| 206 | \ttindex{False} |
| 207 | \ttindex{True} |
| 208 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 209 | \end{description} % Integers |
| 210 | |
| 211 | The rules for integer representation are intended to give the most |
| 212 | meaningful interpretation of shift and mask operations involving |
| 213 | negative integers and the least surprises when switching between the |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 214 | plain and long integer domains. Any operation except left shift, |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 215 | if it yields a result in the plain integer domain without causing |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 216 | overflow, will yield the same result in the long integer domain or |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 217 | when using mixed operands. |
| 218 | \indexii{integer}{representation} |
| 219 | |
| 220 | \item[Floating point numbers] |
| 221 | These represent machine-level double precision floating point numbers. |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 222 | You are at the mercy of the underlying machine architecture (and |
| 223 | C or Java implementation) for the accepted range and handling of overflow. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 224 | Python does not support single-precision floating point numbers; the |
Fred Drake | 6e5e1d9 | 2001-07-14 02:12:27 +0000 | [diff] [blame] | 225 | savings in processor and memory usage that are usually the reason for using |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 226 | these is dwarfed by the overhead of using objects in Python, so there |
| 227 | is no reason to complicate the language with two kinds of floating |
| 228 | point numbers. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 229 | \obindex{floating point} |
| 230 | \indexii{floating point}{number} |
| 231 | \indexii{C}{language} |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 232 | \indexii{Java}{language} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 233 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 234 | \item[Complex numbers] |
| 235 | These represent complex numbers as a pair of machine-level double |
| 236 | precision floating point numbers. The same caveats apply as for |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 237 | floating point numbers. The real and imaginary parts of a complex |
| 238 | number \code{z} can be retrieved through the read-only attributes |
| 239 | \code{z.real} and \code{z.imag}. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 240 | \obindex{complex} |
| 241 | \indexii{complex}{number} |
| 242 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 243 | \end{description} % Numbers |
| 244 | |
Guido van Rossum | 77f6a65 | 2002-04-03 22:41:51 +0000 | [diff] [blame] | 245 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 246 | \item[Sequences] |
Fred Drake | 230d17d | 2001-02-22 21:28:04 +0000 | [diff] [blame] | 247 | These represent finite ordered sets indexed by non-negative numbers. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 248 | The built-in function \function{len()}\bifuncindex{len} returns the |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 249 | number of items of a sequence. |
Thomas Wouters | f9b526d | 2000-07-16 19:05:38 +0000 | [diff] [blame] | 250 | When the length of a sequence is \var{n}, the |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 251 | index set contains the numbers 0, 1, \ldots, \var{n}-1. Item |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 252 | \var{i} of sequence \var{a} is selected by \code{\var{a}[\var{i}]}. |
Fred Drake | e15956b | 2000-04-03 04:51:13 +0000 | [diff] [blame] | 253 | \obindex{sequence} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 254 | \index{index operation} |
| 255 | \index{item selection} |
| 256 | \index{subscription} |
| 257 | |
| 258 | Sequences also support slicing: \code{\var{a}[\var{i}:\var{j}]} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 259 | selects all items with index \var{k} such that \var{i} \code{<=} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 260 | \var{k} \code{<} \var{j}. When used as an expression, a slice is a |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 261 | sequence of the same type. This implies that the index set is |
| 262 | renumbered so that it starts at 0. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 263 | \index{slicing} |
| 264 | |
Michael W. Hudson | 5efaf7e | 2002-06-11 10:55:12 +0000 | [diff] [blame] | 265 | Some sequences also support ``extended slicing'' with a third ``step'' |
| 266 | parameter: \code{\var{a}[\var{i}:\var{j}:\var{k}]} selects all items |
| 267 | of \var{a} with index \var{x} where \code{\var{x} = \var{i} + |
| 268 | \var{n}*\var{k}}, \var{n} \code{>=} \code{0} and \var{i} \code{<=} |
| 269 | \var{x} \code{<} \var{j}. |
| 270 | \index{extended slicing} |
| 271 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 272 | Sequences are distinguished according to their mutability: |
| 273 | |
| 274 | \begin{description} |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 275 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 276 | \item[Immutable sequences] |
| 277 | An object of an immutable sequence type cannot change once it is |
| 278 | created. (If the object contains references to other objects, |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 279 | these other objects may be mutable and may be changed; however, |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 280 | the collection of objects directly referenced by an immutable object |
| 281 | cannot change.) |
| 282 | \obindex{immutable sequence} |
| 283 | \obindex{immutable} |
| 284 | |
| 285 | The following types are immutable sequences: |
| 286 | |
| 287 | \begin{description} |
| 288 | |
| 289 | \item[Strings] |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 290 | The items of a string are characters. There is no separate |
| 291 | character type; a character is represented by a string of one item. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 292 | Characters represent (at least) 8-bit bytes. The built-in |
| 293 | functions \function{chr()}\bifuncindex{chr} and |
| 294 | \function{ord()}\bifuncindex{ord} convert between characters and |
| 295 | nonnegative integers representing the byte values. Bytes with the |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 296 | values 0-127 usually represent the corresponding \ASCII{} values, but |
| 297 | the interpretation of values is up to the program. The string |
| 298 | data type is also used to represent arrays of bytes, e.g., to hold data |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 299 | read from a file. |
| 300 | \obindex{string} |
| 301 | \index{character} |
| 302 | \index{byte} |
Fred Drake | c37b65e | 2001-11-28 07:26:15 +0000 | [diff] [blame] | 303 | \index{ASCII@\ASCII} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 304 | |
Fred Drake | c37b65e | 2001-11-28 07:26:15 +0000 | [diff] [blame] | 305 | (On systems whose native character set is not \ASCII, strings may use |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 306 | EBCDIC in their internal representation, provided the functions |
| 307 | \function{chr()} and \function{ord()} implement a mapping between \ASCII{} and |
| 308 | EBCDIC, and string comparison preserves the \ASCII{} order. |
| 309 | Or perhaps someone can propose a better rule?) |
Fred Drake | c37b65e | 2001-11-28 07:26:15 +0000 | [diff] [blame] | 310 | \index{ASCII@\ASCII} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 311 | \index{EBCDIC} |
| 312 | \index{character set} |
| 313 | \indexii{string}{comparison} |
| 314 | \bifuncindex{chr} |
| 315 | \bifuncindex{ord} |
| 316 | |
Fred Drake | f0aff8e | 2000-04-06 13:57:21 +0000 | [diff] [blame] | 317 | \item[Unicode] |
Fred Drake | 5ec22f2 | 2002-09-24 21:09:13 +0000 | [diff] [blame] | 318 | The items of a Unicode object are Unicode code units. A Unicode code |
| 319 | unit is represented by a Unicode object of one item and can hold |
| 320 | either a 16-bit or 32-bit value representing a Unicode ordinal (the |
| 321 | maximum value for the ordinal is given in \code{sys.maxunicode}, and |
| 322 | depends on how Python is configured at compile time). Surrogate pairs |
| 323 | may be present in the Unicode object, and will be reported as two |
| 324 | separate items. The built-in functions |
Fred Drake | f0aff8e | 2000-04-06 13:57:21 +0000 | [diff] [blame] | 325 | \function{unichr()}\bifuncindex{unichr} and |
Fred Drake | 5ec22f2 | 2002-09-24 21:09:13 +0000 | [diff] [blame] | 326 | \function{ord()}\bifuncindex{ord} convert between code units and |
Fred Drake | f0aff8e | 2000-04-06 13:57:21 +0000 | [diff] [blame] | 327 | nonnegative integers representing the Unicode ordinals as defined in |
| 328 | the Unicode Standard 3.0. Conversion from and to other encodings are |
Fred Drake | b3dfc0a | 2005-09-07 04:57:56 +0000 | [diff] [blame] | 329 | possible through the Unicode method \method{encode()} and the built-in |
Fred Drake | 5ec22f2 | 2002-09-24 21:09:13 +0000 | [diff] [blame] | 330 | function \function{unicode()}.\bifuncindex{unicode} |
Fred Drake | f0aff8e | 2000-04-06 13:57:21 +0000 | [diff] [blame] | 331 | \obindex{unicode} |
| 332 | \index{character} |
| 333 | \index{integer} |
Fred Drake | 8b3ce9e | 2000-04-06 14:00:14 +0000 | [diff] [blame] | 334 | \index{Unicode} |
Fred Drake | f0aff8e | 2000-04-06 13:57:21 +0000 | [diff] [blame] | 335 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 336 | \item[Tuples] |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 337 | The items of a tuple are arbitrary Python objects. |
| 338 | Tuples of two or more items are formed by comma-separated lists |
| 339 | of expressions. A tuple of one item (a `singleton') can be formed |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 340 | by affixing a comma to an expression (an expression by itself does |
| 341 | not create a tuple, since parentheses must be usable for grouping of |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 342 | expressions). An empty tuple can be formed by an empty pair of |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 343 | parentheses. |
| 344 | \obindex{tuple} |
| 345 | \indexii{singleton}{tuple} |
| 346 | \indexii{empty}{tuple} |
| 347 | |
| 348 | \end{description} % Immutable sequences |
| 349 | |
| 350 | \item[Mutable sequences] |
| 351 | Mutable sequences can be changed after they are created. The |
| 352 | subscription and slicing notations can be used as the target of |
| 353 | assignment and \keyword{del} (delete) statements. |
Thomas Wouters | f9b526d | 2000-07-16 19:05:38 +0000 | [diff] [blame] | 354 | \obindex{mutable sequence} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 355 | \obindex{mutable} |
| 356 | \indexii{assignment}{statement} |
| 357 | \index{delete} |
| 358 | \stindex{del} |
| 359 | \index{subscription} |
| 360 | \index{slicing} |
| 361 | |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 362 | There is currently a single intrinsic mutable sequence type: |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 363 | |
| 364 | \begin{description} |
| 365 | |
| 366 | \item[Lists] |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 367 | The items of a list are arbitrary Python objects. Lists are formed |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 368 | by placing a comma-separated list of expressions in square brackets. |
| 369 | (Note that there are no special cases needed to form lists of length 0 |
| 370 | or 1.) |
| 371 | \obindex{list} |
| 372 | |
| 373 | \end{description} % Mutable sequences |
| 374 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 375 | The extension module \module{array}\refstmodindex{array} provides an |
| 376 | additional example of a mutable sequence type. |
| 377 | |
| 378 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 379 | \end{description} % Sequences |
| 380 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 381 | \item[Mappings] |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 382 | These represent finite sets of objects indexed by arbitrary index sets. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 383 | The subscript notation \code{a[k]} selects the item indexed |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 384 | by \code{k} from the mapping \code{a}; this can be used in |
| 385 | expressions and as the target of assignments or \keyword{del} statements. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 386 | The built-in function \function{len()} returns the number of items |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 387 | in a mapping. |
| 388 | \bifuncindex{len} |
| 389 | \index{subscription} |
| 390 | \obindex{mapping} |
| 391 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 392 | There is currently a single intrinsic mapping type: |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 393 | |
| 394 | \begin{description} |
| 395 | |
| 396 | \item[Dictionaries] |
Fred Drake | 8cdee96 | 1999-02-23 18:50:38 +0000 | [diff] [blame] | 397 | These\obindex{dictionary} represent finite sets of objects indexed by |
| 398 | nearly arbitrary values. The only types of values not acceptable as |
| 399 | keys are values containing lists or dictionaries or other mutable |
| 400 | types that are compared by value rather than by object identity, the |
| 401 | reason being that the efficient implementation of dictionaries |
| 402 | requires a key's hash value to remain constant. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 403 | Numeric types used for keys obey the normal rules for numeric |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 404 | comparison: if two numbers compare equal (e.g., \code{1} and |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 405 | \code{1.0}) then they can be used interchangeably to index the same |
| 406 | dictionary entry. |
| 407 | |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 408 | Dictionaries are mutable; they can be created by the |
Fred Drake | 62364ff | 2003-03-20 18:17:16 +0000 | [diff] [blame] | 409 | \code{\{...\}} notation (see section~\ref{dict}, ``Dictionary |
Fred Drake | 8cdee96 | 1999-02-23 18:50:38 +0000 | [diff] [blame] | 410 | Displays''). |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 411 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 412 | The extension modules \module{dbm}\refstmodindex{dbm}, |
Fred Drake | 59c6191 | 2005-10-30 04:29:49 +0000 | [diff] [blame] | 413 | \module{gdbm}\refstmodindex{gdbm}, and |
| 414 | \module{bsddb}\refstmodindex{bsddb} provide additional examples of |
| 415 | mapping types. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 416 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 417 | \end{description} % Mapping types |
| 418 | |
| 419 | \item[Callable types] |
Fred Drake | 8cdee96 | 1999-02-23 18:50:38 +0000 | [diff] [blame] | 420 | These\obindex{callable} are the types to which the function call |
Fred Drake | 62364ff | 2003-03-20 18:17:16 +0000 | [diff] [blame] | 421 | operation (see section~\ref{calls}, ``Calls'') can be applied: |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 422 | \indexii{function}{call} |
| 423 | \index{invocation} |
| 424 | \indexii{function}{argument} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 425 | |
| 426 | \begin{description} |
| 427 | |
| 428 | \item[User-defined functions] |
| 429 | A user-defined function object is created by a function definition |
Fred Drake | 62364ff | 2003-03-20 18:17:16 +0000 | [diff] [blame] | 430 | (see section~\ref{function}, ``Function definitions''). It should be |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 431 | called with an argument |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 432 | list containing the same number of items as the function's formal |
| 433 | parameter list. |
| 434 | \indexii{user-defined}{function} |
| 435 | \obindex{function} |
| 436 | \obindex{user-defined function} |
| 437 | |
Michael W. Hudson | 5e89795 | 2004-08-12 18:12:44 +0000 | [diff] [blame] | 438 | Special attributes: |
Barry Warsaw | 7a5e80e | 2001-02-27 03:36:30 +0000 | [diff] [blame] | 439 | |
Michael W. Hudson | 5e89795 | 2004-08-12 18:12:44 +0000 | [diff] [blame] | 440 | \begin{tableiii}{lll}{member}{Attribute}{Meaning}{} |
| 441 | \lineiii{func_doc}{The function's documentation string, or |
| 442 | \code{None} if unavailable}{Writable} |
| 443 | |
| 444 | \lineiii{__doc__}{Another way of spelling |
| 445 | \member{func_doc}}{Writable} |
| 446 | |
| 447 | \lineiii{func_name}{The function's name}{Writable} |
| 448 | |
| 449 | \lineiii{__name__}{Another way of spelling |
| 450 | \member{func_name}}{Writable} |
| 451 | |
| 452 | \lineiii{__module__}{The name of the module the function was defined |
| 453 | in, or \code{None} if unavailable.}{Writable} |
| 454 | |
Raymond Hettinger | f21569e | 2005-04-26 05:18:53 +0000 | [diff] [blame] | 455 | \lineiii{func_defaults}{A tuple containing default argument values |
Michael W. Hudson | 5e89795 | 2004-08-12 18:12:44 +0000 | [diff] [blame] | 456 | for those arguments that have defaults, or \code{None} if no |
| 457 | arguments have a default value}{Writable} |
| 458 | |
| 459 | \lineiii{func_code}{The code object representing the compiled |
| 460 | function body.}{Writable} |
| 461 | |
| 462 | \lineiii{func_globals}{A reference to the dictionary that holds the |
| 463 | function's global variables --- the global namespace of the module |
| 464 | in which the function was defined.}{Read-only} |
| 465 | |
| 466 | \lineiii{func_dict}{The namespace supporting arbitrary function |
| 467 | attributes.}{Writable} |
| 468 | |
| 469 | \lineiii{func_closure}{\code{None} or a tuple of cells that contain |
| 470 | bindings for the function's free variables.}{Read-only} |
| 471 | \end{tableiii} |
| 472 | |
| 473 | Most of the attributes labelled ``Writable'' check the type of the |
| 474 | assigned value. |
| 475 | |
| 476 | \versionchanged[\code{func_name} is now writable]{2.4} |
| 477 | |
| 478 | Function objects also support getting and setting arbitrary |
| 479 | attributes, which can be used, for example, to attach metadata to |
| 480 | functions. Regular attribute dot-notation is used to get and set such |
| 481 | attributes. \emph{Note that the current implementation only supports |
| 482 | function attributes on user-defined functions. Function attributes on |
| 483 | built-in functions may be supported in the future.} |
| 484 | |
| 485 | Additional information about a function's definition can be retrieved |
| 486 | from its code object; see the description of internal types below. |
Jeremy Hylton | aa90adc | 2001-03-23 17:23:50 +0000 | [diff] [blame] | 487 | |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 488 | \withsubitem{(function attribute)}{ |
| 489 | \ttindex{func_doc} |
| 490 | \ttindex{__doc__} |
| 491 | \ttindex{__name__} |
Jeremy Hylton | f9b0cc7 | 2003-01-31 18:52:45 +0000 | [diff] [blame] | 492 | \ttindex{__module__} |
Barry Warsaw | 7a5e80e | 2001-02-27 03:36:30 +0000 | [diff] [blame] | 493 | \ttindex{__dict__} |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 494 | \ttindex{func_defaults} |
Jeremy Hylton | 26c49b6 | 2002-04-01 17:58:39 +0000 | [diff] [blame] | 495 | \ttindex{func_closure} |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 496 | \ttindex{func_code} |
Barry Warsaw | 7a5e80e | 2001-02-27 03:36:30 +0000 | [diff] [blame] | 497 | \ttindex{func_globals} |
| 498 | \ttindex{func_dict}} |
Guido van Rossum | dfb658c | 1998-07-23 17:54:36 +0000 | [diff] [blame] | 499 | \indexii{global}{namespace} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 500 | |
| 501 | \item[User-defined methods] |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 502 | A user-defined method object combines a class, a class instance (or |
Fred Drake | 8dd6ffd | 2001-08-02 21:34:53 +0000 | [diff] [blame] | 503 | \code{None}) and any callable object (normally a user-defined |
| 504 | function). |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 505 | \obindex{method} |
| 506 | \obindex{user-defined method} |
| 507 | \indexii{user-defined}{method} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 508 | |
| 509 | Special read-only attributes: \member{im_self} is the class instance |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 510 | object, \member{im_func} is the function object; |
Raymond Hettinger | 03ec6d5 | 2003-06-25 18:29:36 +0000 | [diff] [blame] | 511 | \member{im_class} is the class of \member{im_self} for bound methods |
| 512 | or the class that asked for the method for unbound methods; |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 513 | \member{__doc__} is the method's documentation (same as |
| 514 | \code{im_func.__doc__}); \member{__name__} is the method name (same as |
Jeremy Hylton | f9b0cc7 | 2003-01-31 18:52:45 +0000 | [diff] [blame] | 515 | \code{im_func.__name__}); \member{__module__} is the name of the |
| 516 | module the method was defined in, or \code{None} if unavailable. |
Fred Drake | f9d5803 | 2001-12-07 23:13:53 +0000 | [diff] [blame] | 517 | \versionchanged[\member{im_self} used to refer to the class that |
| 518 | defined the method]{2.2} |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 519 | \withsubitem{(method attribute)}{ |
Jeremy Hylton | f9b0cc7 | 2003-01-31 18:52:45 +0000 | [diff] [blame] | 520 | \ttindex{__doc__} |
| 521 | \ttindex{__name__} |
| 522 | \ttindex{__module__} |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 523 | \ttindex{im_func} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 524 | \ttindex{im_self}} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 525 | |
Barry Warsaw | 7a5e80e | 2001-02-27 03:36:30 +0000 | [diff] [blame] | 526 | Methods also support accessing (but not setting) the arbitrary |
| 527 | function attributes on the underlying function object. |
| 528 | |
Fred Drake | ea690c4 | 2003-07-17 05:26:53 +0000 | [diff] [blame] | 529 | User-defined method objects may be created when getting an attribute |
| 530 | of a class (perhaps via an instance of that class), if that attribute |
| 531 | is a user-defined function object, an unbound user-defined method object, |
| 532 | or a class method object. |
| 533 | When the attribute is a user-defined method object, a new |
| 534 | method object is only created if the class from which it is being |
| 535 | retrieved is the same as, or a derived class of, the class stored |
| 536 | in the original method object; otherwise, the original method object |
| 537 | is used as it is. |
| 538 | |
| 539 | When a user-defined method object is created by retrieving |
| 540 | a user-defined function object from a class, its \member{im_self} |
| 541 | attribute is \code{None} and the method object is said to be unbound. |
| 542 | When one is created by retrieving a user-defined function object |
| 543 | from a class via one of its instances, its \member{im_self} attribute |
| 544 | is the instance, and the method object is said to be bound. |
| 545 | In either case, the new method's \member{im_class} attribute |
| 546 | is the class from which the retrieval takes place, and |
| 547 | its \member{im_func} attribute is the original function object. |
| 548 | \withsubitem{(method attribute)}{ |
| 549 | \ttindex{im_class}\ttindex{im_func}\ttindex{im_self}} |
| 550 | |
| 551 | When a user-defined method object is created by retrieving another |
| 552 | method object from a class or instance, the behaviour is the same |
| 553 | as for a function object, except that the \member{im_func} attribute |
| 554 | of the new instance is not the original method object but its |
| 555 | \member{im_func} attribute. |
| 556 | \withsubitem{(method attribute)}{ |
| 557 | \ttindex{im_func}} |
| 558 | |
| 559 | When a user-defined method object is created by retrieving a |
| 560 | class method object from a class or instance, its \member{im_self} |
| 561 | attribute is the class itself (the same as the \member{im_class} |
| 562 | attribute), and its \member{im_func} attribute is the function |
| 563 | object underlying the class method. |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 564 | \withsubitem{(method attribute)}{ |
Fred Drake | 35c09f2 | 2000-06-28 20:15:47 +0000 | [diff] [blame] | 565 | \ttindex{im_class}\ttindex{im_func}\ttindex{im_self}} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 566 | |
| 567 | When an unbound user-defined method object is called, the underlying |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 568 | function (\member{im_func}) is called, with the restriction that the |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 569 | first argument must be an instance of the proper class |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 570 | (\member{im_class}) or of a derived class thereof. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 571 | |
| 572 | When a bound user-defined method object is called, the underlying |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 573 | function (\member{im_func}) is called, inserting the class instance |
| 574 | (\member{im_self}) in front of the argument list. For instance, when |
| 575 | \class{C} is a class which contains a definition for a function |
| 576 | \method{f()}, and \code{x} is an instance of \class{C}, calling |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 577 | \code{x.f(1)} is equivalent to calling \code{C.f(x, 1)}. |
| 578 | |
Fred Drake | ea690c4 | 2003-07-17 05:26:53 +0000 | [diff] [blame] | 579 | When a user-defined method object is derived from a class method object, |
| 580 | the ``class instance'' stored in \member{im_self} will actually be the |
| 581 | class itself, so that calling either \code{x.f(1)} or \code{C.f(1)} is |
| 582 | equivalent to calling \code{f(C,1)} where \code{f} is the underlying |
| 583 | function. |
| 584 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 585 | Note that the transformation from function object to (unbound or |
| 586 | bound) method object happens each time the attribute is retrieved from |
| 587 | the class or instance. In some cases, a fruitful optimization is to |
| 588 | assign the attribute to a local variable and call that local variable. |
| 589 | Also notice that this transformation only happens for user-defined |
| 590 | functions; other callable objects (and all non-callable objects) are |
Fred Drake | 35c09f2 | 2000-06-28 20:15:47 +0000 | [diff] [blame] | 591 | retrieved without transformation. It is also important to note that |
| 592 | user-defined functions which are attributes of a class instance are |
| 593 | not converted to bound methods; this \emph{only} happens when the |
| 594 | function is an attribute of the class. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 595 | |
Fred Drake | e31e9ce | 2001-12-11 21:10:08 +0000 | [diff] [blame] | 596 | \item[Generator functions\index{generator!function}\index{generator!iterator}] |
| 597 | A function or method which uses the \keyword{yield} statement (see |
| 598 | section~\ref{yield}, ``The \keyword{yield} statement'') is called a |
| 599 | \dfn{generator function}. Such a function, when called, always |
| 600 | returns an iterator object which can be used to execute the body of |
| 601 | the function: calling the iterator's \method{next()} method will |
| 602 | cause the function to execute until it provides a value using the |
| 603 | \keyword{yield} statement. When the function executes a |
| 604 | \keyword{return} statement or falls off the end, a |
| 605 | \exception{StopIteration} exception is raised and the iterator will |
| 606 | have reached the end of the set of values to be returned. |
| 607 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 608 | \item[Built-in functions] |
Georg Brandl | 1c330eb | 2005-07-02 10:27:31 +0000 | [diff] [blame] | 609 | A built-in function object is a wrapper around a C function. Examples |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 610 | of built-in functions are \function{len()} and \function{math.sin()} |
| 611 | (\module{math} is a standard built-in module). |
| 612 | The number and type of the arguments are |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 613 | determined by the C function. |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 614 | Special read-only attributes: \member{__doc__} is the function's |
| 615 | documentation string, or \code{None} if unavailable; \member{__name__} |
| 616 | is the function's name; \member{__self__} is set to \code{None} (but see |
Jeremy Hylton | f9b0cc7 | 2003-01-31 18:52:45 +0000 | [diff] [blame] | 617 | the next item); \member{__module__} is the name of the module the |
| 618 | function was defined in or \code{None} if unavailable. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 619 | \obindex{built-in function} |
| 620 | \obindex{function} |
| 621 | \indexii{C}{language} |
| 622 | |
| 623 | \item[Built-in methods] |
| 624 | This is really a different disguise of a built-in function, this time |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 625 | containing an object passed to the C function as an implicit extra |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 626 | argument. An example of a built-in method is |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 627 | \code{\var{alist}.append()}, assuming |
| 628 | \var{alist} is a list object. |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 629 | In this case, the special read-only attribute \member{__self__} is set |
Fred Drake | e31e9ce | 2001-12-11 21:10:08 +0000 | [diff] [blame] | 630 | to the object denoted by \var{list}. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 631 | \obindex{built-in method} |
| 632 | \obindex{method} |
| 633 | \indexii{built-in}{method} |
| 634 | |
Fred Drake | e37b4ed | 2003-07-15 20:45:16 +0000 | [diff] [blame] | 635 | \item[Class Types] |
| 636 | Class types, or ``new-style classes,'' are callable. These objects |
| 637 | normally act as factories for new instances of themselves, but |
| 638 | variations are possible for class types that override |
| 639 | \method{__new__()}. The arguments of the call are passed to |
| 640 | \method{__new__()} and, in the typical case, to \method{__init__()} to |
| 641 | initialize the new instance. |
| 642 | |
| 643 | \item[Classic Classes] |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 644 | Class objects are described below. When a class object is called, |
| 645 | a new class instance (also described below) is created and |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 646 | returned. This implies a call to the class's \method{__init__()} method |
| 647 | if it has one. Any arguments are passed on to the \method{__init__()} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 648 | method. If there is no \method{__init__()} method, the class must be called |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 649 | without arguments. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 650 | \withsubitem{(object method)}{\ttindex{__init__()}} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 651 | \obindex{class} |
| 652 | \obindex{class instance} |
| 653 | \obindex{instance} |
| 654 | \indexii{class object}{call} |
| 655 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 656 | \item[Class instances] |
| 657 | Class instances are described below. Class instances are callable |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 658 | only when the class has a \method{__call__()} method; \code{x(arguments)} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 659 | is a shorthand for \code{x.__call__(arguments)}. |
| 660 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 661 | \end{description} |
| 662 | |
| 663 | \item[Modules] |
Fred Drake | 62364ff | 2003-03-20 18:17:16 +0000 | [diff] [blame] | 664 | Modules are imported by the \keyword{import} statement (see |
Fred Drake | d51ce7d | 2003-07-15 22:03:00 +0000 | [diff] [blame] | 665 | section~\ref{import}, ``The \keyword{import} statement'').% |
| 666 | \stindex{import}\obindex{module} |
Guido van Rossum | dfb658c | 1998-07-23 17:54:36 +0000 | [diff] [blame] | 667 | A module object has a namespace implemented by a dictionary object |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 668 | (this is the dictionary referenced by the func_globals attribute of |
| 669 | functions defined in the module). Attribute references are translated |
| 670 | to lookups in this dictionary, e.g., \code{m.x} is equivalent to |
| 671 | \code{m.__dict__["x"]}. |
| 672 | A module object does not contain the code object used to |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 673 | initialize the module (since it isn't needed once the initialization |
| 674 | is done). |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 675 | |
Guido van Rossum | dfb658c | 1998-07-23 17:54:36 +0000 | [diff] [blame] | 676 | Attribute assignment updates the module's namespace dictionary, |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 677 | e.g., \samp{m.x = 1} is equivalent to \samp{m.__dict__["x"] = 1}. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 678 | |
Guido van Rossum | dfb658c | 1998-07-23 17:54:36 +0000 | [diff] [blame] | 679 | Special read-only attribute: \member{__dict__} is the module's |
| 680 | namespace as a dictionary object. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 681 | \withsubitem{(module attribute)}{\ttindex{__dict__}} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 682 | |
| 683 | Predefined (writable) attributes: \member{__name__} |
| 684 | is the module's name; \member{__doc__} is the |
| 685 | module's documentation string, or |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 686 | \code{None} if unavailable; \member{__file__} is the pathname of the |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 687 | file from which the module was loaded, if it was loaded from a file. |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 688 | The \member{__file__} attribute is not present for C{} modules that are |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 689 | statically linked into the interpreter; for extension modules loaded |
| 690 | dynamically from a shared library, it is the pathname of the shared |
| 691 | library file. |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 692 | \withsubitem{(module attribute)}{ |
| 693 | \ttindex{__name__} |
| 694 | \ttindex{__doc__} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 695 | \ttindex{__file__}} |
Guido van Rossum | dfb658c | 1998-07-23 17:54:36 +0000 | [diff] [blame] | 696 | \indexii{module}{namespace} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 697 | |
| 698 | \item[Classes] |
Fred Drake | 62364ff | 2003-03-20 18:17:16 +0000 | [diff] [blame] | 699 | Class objects are created by class definitions (see |
| 700 | section~\ref{class}, ``Class definitions''). |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 701 | A class has a namespace implemented by a dictionary object. |
| 702 | Class attribute references are translated to |
| 703 | lookups in this dictionary, |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 704 | e.g., \samp{C.x} is translated to \samp{C.__dict__["x"]}. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 705 | When the attribute name is not found |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 706 | there, the attribute search continues in the base classes. The search |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 707 | is depth-first, left-to-right in the order of occurrence in the |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 708 | base class list. |
Fred Drake | ea690c4 | 2003-07-17 05:26:53 +0000 | [diff] [blame] | 709 | |
| 710 | When a class attribute reference (for class \class{C}, say) |
| 711 | would yield a user-defined function object or |
| 712 | an unbound user-defined method object whose associated class is either |
| 713 | \class{C} or one of its base classes, it is transformed into an unbound |
| 714 | user-defined method object whose \member{im_class} attribute is~\class{C}. |
| 715 | When it would yield a class method object, it is transformed into |
| 716 | a bound user-defined method object whose \member{im_class} and |
| 717 | \member{im_self} attributes are both~\class{C}. When it would yield |
| 718 | a static method object, it is transformed into the object wrapped |
| 719 | by the static method object. See section~\ref{descriptors} for another |
| 720 | way in which attributes retrieved from a class may differ from those |
| 721 | actually contained in its \member{__dict__}. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 722 | \obindex{class} |
| 723 | \obindex{class instance} |
| 724 | \obindex{instance} |
| 725 | \indexii{class object}{call} |
| 726 | \index{container} |
| 727 | \obindex{dictionary} |
| 728 | \indexii{class}{attribute} |
| 729 | |
| 730 | Class attribute assignments update the class's dictionary, never the |
| 731 | dictionary of a base class. |
| 732 | \indexiii{class}{attribute}{assignment} |
| 733 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 734 | A class object can be called (see above) to yield a class instance (see |
| 735 | below). |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 736 | \indexii{class object}{call} |
| 737 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 738 | Special attributes: \member{__name__} is the class name; |
| 739 | \member{__module__} is the module name in which the class was defined; |
Guido van Rossum | dfb658c | 1998-07-23 17:54:36 +0000 | [diff] [blame] | 740 | \member{__dict__} is the dictionary containing the class's namespace; |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 741 | \member{__bases__} is a tuple (possibly empty or a singleton) |
| 742 | containing the base classes, in the order of their occurrence in the |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 743 | base class list; \member{__doc__} is the class's documentation string, |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 744 | or None if undefined. |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 745 | \withsubitem{(class attribute)}{ |
| 746 | \ttindex{__name__} |
| 747 | \ttindex{__module__} |
| 748 | \ttindex{__dict__} |
| 749 | \ttindex{__bases__} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 750 | \ttindex{__doc__}} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 751 | |
| 752 | \item[Class instances] |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 753 | A class instance is created by calling a class object (see above). |
| 754 | A class instance has a namespace implemented as a dictionary which |
| 755 | is the first place in which |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 756 | attribute references are searched. When an attribute is not found |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 757 | there, and the instance's class has an attribute by that name, |
| 758 | the search continues with the class attributes. If a class attribute |
Fred Drake | ea690c4 | 2003-07-17 05:26:53 +0000 | [diff] [blame] | 759 | is found that is a user-defined function object or an unbound |
| 760 | user-defined method object whose associated class is the class |
| 761 | (call it~\class{C}) of the instance for which the attribute reference |
| 762 | was initiated or one of its bases, |
| 763 | it is transformed into a bound user-defined method object whose |
| 764 | \member{im_class} attribute is~\class{C} whose \member{im_self} attribute |
| 765 | is the instance. Static method and class method objects are also |
| 766 | transformed, as if they had been retrieved from class~\class{C}; |
| 767 | see above under ``Classes''. See section~\ref{descriptors} for |
| 768 | another way in which attributes of a class retrieved via its |
| 769 | instances may differ from the objects actually stored in the |
| 770 | class's \member{__dict__}. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 771 | If no class attribute is found, and the object's class has a |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 772 | \method{__getattr__()} method, that is called to satisfy the lookup. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 773 | \obindex{class instance} |
| 774 | \obindex{instance} |
| 775 | \indexii{class}{instance} |
| 776 | \indexii{class instance}{attribute} |
| 777 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 778 | Attribute assignments and deletions update the instance's dictionary, |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 779 | never a class's dictionary. If the class has a \method{__setattr__()} or |
| 780 | \method{__delattr__()} method, this is called instead of updating the |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 781 | instance dictionary directly. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 782 | \indexiii{class instance}{attribute}{assignment} |
| 783 | |
| 784 | Class instances can pretend to be numbers, sequences, or mappings if |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 785 | they have methods with certain special names. See |
Fred Drake | 62364ff | 2003-03-20 18:17:16 +0000 | [diff] [blame] | 786 | section~\ref{specialnames}, ``Special method names.'' |
Fred Drake | e15956b | 2000-04-03 04:51:13 +0000 | [diff] [blame] | 787 | \obindex{numeric} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 788 | \obindex{sequence} |
| 789 | \obindex{mapping} |
| 790 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 791 | Special attributes: \member{__dict__} is the attribute |
| 792 | dictionary; \member{__class__} is the instance's class. |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 793 | \withsubitem{(instance attribute)}{ |
| 794 | \ttindex{__dict__} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 795 | \ttindex{__class__}} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 796 | |
| 797 | \item[Files] |
Fred Drake | e15eb35 | 1999-11-10 16:13:25 +0000 | [diff] [blame] | 798 | A file\obindex{file} object represents an open file. File objects are |
| 799 | created by the \function{open()}\bifuncindex{open} built-in function, |
| 800 | and also by |
| 801 | \withsubitem{(in module os)}{\ttindex{popen()}}\function{os.popen()}, |
| 802 | \function{os.fdopen()}, and the |
| 803 | \method{makefile()}\withsubitem{(socket method)}{\ttindex{makefile()}} |
| 804 | method of socket objects (and perhaps by other functions or methods |
| 805 | provided by extension modules). The objects |
| 806 | \ttindex{sys.stdin}\code{sys.stdin}, |
| 807 | \ttindex{sys.stdout}\code{sys.stdout} and |
| 808 | \ttindex{sys.stderr}\code{sys.stderr} are initialized to file objects |
| 809 | corresponding to the interpreter's standard\index{stdio} input, output |
| 810 | and error streams. See the \citetitle[../lib/lib.html]{Python Library |
| 811 | Reference} for complete documentation of file objects. |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 812 | \withsubitem{(in module sys)}{ |
| 813 | \ttindex{stdin} |
| 814 | \ttindex{stdout} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 815 | \ttindex{stderr}} |
Fred Drake | e15eb35 | 1999-11-10 16:13:25 +0000 | [diff] [blame] | 816 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 817 | |
| 818 | \item[Internal types] |
| 819 | A few types used internally by the interpreter are exposed to the user. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 820 | Their definitions may change with future versions of the interpreter, |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 821 | but they are mentioned here for completeness. |
| 822 | \index{internal type} |
| 823 | \index{types, internal} |
| 824 | |
| 825 | \begin{description} |
| 826 | |
| 827 | \item[Code objects] |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 828 | Code objects represent \emph{byte-compiled} executable Python code, or |
| 829 | \emph{bytecode}. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 830 | The difference between a code |
| 831 | object and a function object is that the function object contains an |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 832 | explicit reference to the function's globals (the module in which it |
| 833 | was defined), while a code object contains no context; |
| 834 | also the default argument values are stored in the function object, |
| 835 | not in the code object (because they represent values calculated at |
| 836 | run-time). Unlike function objects, code objects are immutable and |
| 837 | contain no references (directly or indirectly) to mutable objects. |
| 838 | \index{bytecode} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 839 | \obindex{code} |
| 840 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 841 | Special read-only attributes: \member{co_name} gives the function |
| 842 | name; \member{co_argcount} is the number of positional arguments |
| 843 | (including arguments with default values); \member{co_nlocals} is the |
| 844 | number of local variables used by the function (including arguments); |
| 845 | \member{co_varnames} is a tuple containing the names of the local |
Jeremy Hylton | aa90adc | 2001-03-23 17:23:50 +0000 | [diff] [blame] | 846 | variables (starting with the argument names); \member{co_cellvars} is |
| 847 | a tuple containing the names of local variables that are referenced by |
| 848 | nested functions; \member{co_freevars} is a tuple containing the names |
Jeremy Hylton | 8392f36 | 2002-04-01 18:53:36 +0000 | [diff] [blame] | 849 | of free variables; \member{co_code} is a string representing the |
| 850 | sequence of bytecode instructions; |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 851 | \member{co_consts} is a tuple containing the literals used by the |
| 852 | bytecode; \member{co_names} is a tuple containing the names used by |
| 853 | the bytecode; \member{co_filename} is the filename from which the code |
| 854 | was compiled; \member{co_firstlineno} is the first line number of the |
| 855 | function; \member{co_lnotab} is a string encoding the mapping from |
Thomas Wouters | f9b526d | 2000-07-16 19:05:38 +0000 | [diff] [blame] | 856 | byte code offsets to line numbers (for details see the source code of |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 857 | the interpreter); \member{co_stacksize} is the required stack size |
| 858 | (including local variables); \member{co_flags} is an integer encoding |
| 859 | a number of flags for the interpreter. |
Jeremy Hylton | aa90adc | 2001-03-23 17:23:50 +0000 | [diff] [blame] | 860 | |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 861 | \withsubitem{(code object attribute)}{ |
| 862 | \ttindex{co_argcount} |
| 863 | \ttindex{co_code} |
| 864 | \ttindex{co_consts} |
| 865 | \ttindex{co_filename} |
| 866 | \ttindex{co_firstlineno} |
| 867 | \ttindex{co_flags} |
| 868 | \ttindex{co_lnotab} |
| 869 | \ttindex{co_name} |
| 870 | \ttindex{co_names} |
| 871 | \ttindex{co_nlocals} |
| 872 | \ttindex{co_stacksize} |
Jeremy Hylton | aa90adc | 2001-03-23 17:23:50 +0000 | [diff] [blame] | 873 | \ttindex{co_varnames} |
| 874 | \ttindex{co_cellvars} |
| 875 | \ttindex{co_freevars}} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 876 | |
Fred Drake | e15956b | 2000-04-03 04:51:13 +0000 | [diff] [blame] | 877 | The following flag bits are defined for \member{co_flags}: bit |
| 878 | \code{0x04} is set if the function uses the \samp{*arguments} syntax |
| 879 | to accept an arbitrary number of positional arguments; bit |
| 880 | \code{0x08} is set if the function uses the \samp{**keywords} syntax |
Jeremy Hylton | 8392f36 | 2002-04-01 18:53:36 +0000 | [diff] [blame] | 881 | to accept arbitrary keyword arguments; bit \code{0x20} is set if the |
Brett Cannon | 9e6fedd | 2003-06-15 22:57:44 +0000 | [diff] [blame] | 882 | function is a generator. |
| 883 | \obindex{generator} |
Jeremy Hylton | 8392f36 | 2002-04-01 18:53:36 +0000 | [diff] [blame] | 884 | |
| 885 | Future feature declarations (\samp{from __future__ import division}) |
| 886 | also use bits in \member{co_flags} to indicate whether a code object |
| 887 | was compiled with a particular feature enabled: bit \code{0x2000} is |
| 888 | set if the function was compiled with future division enabled; bits |
| 889 | \code{0x10} and \code{0x1000} were used in earlier versions of Python. |
| 890 | |
| 891 | Other bits in \member{co_flags} are reserved for internal use. |
| 892 | |
| 893 | If\index{documentation string} a code object represents a function, |
| 894 | the first item in |
Jeremy Hylton | aa90adc | 2001-03-23 17:23:50 +0000 | [diff] [blame] | 895 | \member{co_consts} is the documentation string of the function, or |
| 896 | \code{None} if undefined. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 897 | |
| 898 | \item[Frame objects] |
| 899 | Frame objects represent execution frames. They may occur in traceback |
| 900 | objects (see below). |
| 901 | \obindex{frame} |
| 902 | |
| 903 | Special read-only attributes: \member{f_back} is to the previous |
| 904 | stack frame (towards the caller), or \code{None} if this is the bottom |
| 905 | stack frame; \member{f_code} is the code object being executed in this |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 906 | frame; \member{f_locals} is the dictionary used to look up local |
| 907 | variables; \member{f_globals} is used for global variables; |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 908 | \member{f_builtins} is used for built-in (intrinsic) names; |
| 909 | \member{f_restricted} is a flag indicating whether the function is |
Michael W. Hudson | cfd3884 | 2002-12-17 16:15:34 +0000 | [diff] [blame] | 910 | executing in restricted execution mode; \member{f_lasti} gives the |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 911 | precise instruction (this is an index into the bytecode string of |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 912 | the code object). |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 913 | \withsubitem{(frame attribute)}{ |
| 914 | \ttindex{f_back} |
| 915 | \ttindex{f_code} |
| 916 | \ttindex{f_globals} |
| 917 | \ttindex{f_locals} |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 918 | \ttindex{f_lasti} |
| 919 | \ttindex{f_builtins} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 920 | \ttindex{f_restricted}} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 921 | |
Georg Brandl | 1c330eb | 2005-07-02 10:27:31 +0000 | [diff] [blame] | 922 | Special writable attributes: \member{f_trace}, if not \code{None}, is |
| 923 | a function called at the start of each source code line (this is used |
| 924 | by the debugger); \member{f_exc_type}, \member{f_exc_value}, |
| 925 | \member{f_exc_traceback} represent the last exception raised in the |
| 926 | parent frame provided another exception was ever raised in the current |
| 927 | frame (in all other cases they are None); \member{f_lineno} is the |
| 928 | current line number of the frame --- writing to this from within a |
| 929 | trace function jumps to the given line (only for the bottom-most |
| 930 | frame). A debugger can implement a Jump command (aka Set Next |
| 931 | Statement) by writing to f_lineno. |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 932 | \withsubitem{(frame attribute)}{ |
| 933 | \ttindex{f_trace} |
| 934 | \ttindex{f_exc_type} |
| 935 | \ttindex{f_exc_value} |
Michael W. Hudson | cfd3884 | 2002-12-17 16:15:34 +0000 | [diff] [blame] | 936 | \ttindex{f_exc_traceback} |
| 937 | \ttindex{f_lineno}} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 938 | |
| 939 | \item[Traceback objects] \label{traceback} |
| 940 | Traceback objects represent a stack trace of an exception. A |
| 941 | traceback object is created when an exception occurs. When the search |
| 942 | for an exception handler unwinds the execution stack, at each unwound |
| 943 | level a traceback object is inserted in front of the current |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 944 | traceback. When an exception handler is entered, the stack trace is |
| 945 | made available to the program. |
Fred Drake | 62364ff | 2003-03-20 18:17:16 +0000 | [diff] [blame] | 946 | (See section~\ref{try}, ``The \code{try} statement.'') |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 947 | It is accessible as \code{sys.exc_traceback}, and also as the third |
| 948 | item of the tuple returned by \code{sys.exc_info()}. The latter is |
| 949 | the preferred interface, since it works correctly when the program is |
| 950 | using multiple threads. |
| 951 | When the program contains no suitable handler, the stack trace is written |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 952 | (nicely formatted) to the standard error stream; if the interpreter is |
| 953 | interactive, it is also made available to the user as |
| 954 | \code{sys.last_traceback}. |
| 955 | \obindex{traceback} |
| 956 | \indexii{stack}{trace} |
| 957 | \indexii{exception}{handler} |
| 958 | \indexii{execution}{stack} |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 959 | \withsubitem{(in module sys)}{ |
| 960 | \ttindex{exc_info} |
| 961 | \ttindex{exc_traceback} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 962 | \ttindex{last_traceback}} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 963 | \ttindex{sys.exc_info} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 964 | \ttindex{sys.exc_traceback} |
| 965 | \ttindex{sys.last_traceback} |
| 966 | |
| 967 | Special read-only attributes: \member{tb_next} is the next level in the |
| 968 | stack trace (towards the frame where the exception occurred), or |
| 969 | \code{None} if there is no next level; \member{tb_frame} points to the |
| 970 | execution frame of the current level; \member{tb_lineno} gives the line |
| 971 | number where the exception occurred; \member{tb_lasti} indicates the |
| 972 | precise instruction. The line number and last instruction in the |
| 973 | traceback may differ from the line number of its frame object if the |
| 974 | exception occurred in a \keyword{try} statement with no matching |
| 975 | except clause or with a finally clause. |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 976 | \withsubitem{(traceback attribute)}{ |
| 977 | \ttindex{tb_next} |
| 978 | \ttindex{tb_frame} |
| 979 | \ttindex{tb_lineno} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 980 | \ttindex{tb_lasti}} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 981 | \stindex{try} |
| 982 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 983 | \item[Slice objects] |
| 984 | Slice objects are used to represent slices when \emph{extended slice |
| 985 | syntax} is used. This is a slice using two colons, or multiple slices |
| 986 | or ellipses separated by commas, e.g., \code{a[i:j:step]}, \code{a[i:j, |
Raymond Hettinger | 03ec6d5 | 2003-06-25 18:29:36 +0000 | [diff] [blame] | 987 | k:l]}, or \code{a[..., i:j]}. They are also created by the built-in |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 988 | \function{slice()}\bifuncindex{slice} function. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 989 | |
Thomas Wouters | f9b526d | 2000-07-16 19:05:38 +0000 | [diff] [blame] | 990 | Special read-only attributes: \member{start} is the lower bound; |
| 991 | \member{stop} is the upper bound; \member{step} is the step value; each is |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 992 | \code{None} if omitted. These attributes can have any type. |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 993 | \withsubitem{(slice object attribute)}{ |
| 994 | \ttindex{start} |
| 995 | \ttindex{stop} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 996 | \ttindex{step}} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 997 | |
Fred Drake | 5ec22f2 | 2002-09-24 21:09:13 +0000 | [diff] [blame] | 998 | Slice objects support one method: |
| 999 | |
| 1000 | \begin{methoddesc}[slice]{indices}{self, length} |
| 1001 | This method takes a single integer argument \var{length} and computes |
| 1002 | information about the extended slice that the slice object would |
| 1003 | describe if applied to a sequence of \var{length} items. It returns a |
| 1004 | tuple of three integers; respectively these are the \var{start} and |
| 1005 | \var{stop} indices and the \var{step} or stride length of the slice. |
| 1006 | Missing or out-of-bounds indices are handled in a manner consistent |
| 1007 | with regular slices. |
Michael W. Hudson | f0d777c | 2002-07-19 15:47:06 +0000 | [diff] [blame] | 1008 | \versionadded{2.3} |
Fred Drake | 5ec22f2 | 2002-09-24 21:09:13 +0000 | [diff] [blame] | 1009 | \end{methoddesc} |
Michael W. Hudson | f0d777c | 2002-07-19 15:47:06 +0000 | [diff] [blame] | 1010 | |
Fred Drake | ea690c4 | 2003-07-17 05:26:53 +0000 | [diff] [blame] | 1011 | \item[Static method objects] |
| 1012 | Static method objects provide a way of defeating the transformation |
| 1013 | of function objects to method objects described above. A static method |
| 1014 | object is a wrapper around any other object, usually a user-defined |
| 1015 | method object. When a static method object is retrieved from a class |
| 1016 | or a class instance, the object actually returned is the wrapped object, |
| 1017 | which is not subject to any further transformation. Static method |
| 1018 | objects are not themselves callable, although the objects they |
| 1019 | wrap usually are. Static method objects are created by the built-in |
| 1020 | \function{staticmethod()} constructor. |
| 1021 | |
| 1022 | \item[Class method objects] |
| 1023 | A class method object, like a static method object, is a wrapper |
| 1024 | around another object that alters the way in which that object |
| 1025 | is retrieved from classes and class instances. The behaviour of |
| 1026 | class method objects upon such retrieval is described above, |
| 1027 | under ``User-defined methods''. Class method objects are created |
| 1028 | by the built-in \function{classmethod()} constructor. |
| 1029 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1030 | \end{description} % Internal types |
| 1031 | |
| 1032 | \end{description} % Types |
| 1033 | |
Andrew M. Kuchling | 6af5239 | 2005-12-04 16:07:15 +0000 | [diff] [blame^] | 1034 | %========================================================================= |
| 1035 | \section{New-style and classic classes} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1036 | |
Andrew M. Kuchling | 6af5239 | 2005-12-04 16:07:15 +0000 | [diff] [blame^] | 1037 | Classes and instances come in two flavours: old-style or classic, and new-style. |
| 1038 | |
| 1039 | Old-style classes were the only flavour of class available before Python 2.1. While they supported multiple inheritance, the rules for resolving names were chosen for ease of implementation. These rules turn out to make multiple inheritance hard to use in certain situations. |
| 1040 | |
| 1041 | New-style classes were introduced in Python 2.1, and change the method resolution order to make multiple inheritance more usable. |
| 1042 | |
| 1043 | The plan is to eventually drop old-style classes, leaving only the semantics of new-style classes. This change will probably only be feasible in Python 3.0. |
| 1044 | |
| 1045 | |
| 1046 | |
| 1047 | %========================================================================= |
Fred Drake | 61c7728 | 1998-07-28 19:34:22 +0000 | [diff] [blame] | 1048 | \section{Special method names\label{specialnames}} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1049 | |
| 1050 | A class can implement certain operations that are invoked by special |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1051 | syntax (such as arithmetic operations or subscripting and slicing) by |
Fred Drake | 7af9f4d | 2003-05-12 13:50:11 +0000 | [diff] [blame] | 1052 | defining methods with special names.\indexii{operator}{overloading} |
| 1053 | This is Python's approach to \dfn{operator overloading}, allowing |
| 1054 | classes to define their own behavior with respect to language |
| 1055 | operators. For instance, if a class defines |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1056 | a method named \method{__getitem__()}, and \code{x} is an instance of |
| 1057 | this class, then \code{x[i]} is equivalent to |
Raymond Hettinger | 9415309 | 2002-05-12 03:09:25 +0000 | [diff] [blame] | 1058 | \code{x.__getitem__(i)}. Except where mentioned, attempts to execute |
| 1059 | an operation raise an exception when no appropriate method is defined. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1060 | \withsubitem{(mapping object method)}{\ttindex{__getitem__()}} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1061 | |
Fred Drake | 0c47559 | 2000-12-07 04:49:34 +0000 | [diff] [blame] | 1062 | When implementing a class that emulates any built-in type, it is |
| 1063 | important that the emulation only be implemented to the degree that it |
| 1064 | makes sense for the object being modelled. For example, some |
| 1065 | sequences may work well with retrieval of individual elements, but |
| 1066 | extracting a slice may not make sense. (One example of this is the |
| 1067 | \class{NodeList} interface in the W3C's Document Object Model.) |
| 1068 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1069 | |
Fred Drake | 61c7728 | 1998-07-28 19:34:22 +0000 | [diff] [blame] | 1070 | \subsection{Basic customization\label{customization}} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1071 | |
Greg Ward | ff564d3 | 2005-03-08 01:10:20 +0000 | [diff] [blame] | 1072 | \begin{methoddesc}[object]{__new__}{cls\optional{, \moreargs}} |
| 1073 | Called to create a new instance of class \var{cls}. \method{__new__()} |
Georg Brandl | 15ad935 | 2005-08-26 12:56:22 +0000 | [diff] [blame] | 1074 | is a static method (special-cased so you need not declare it as such) |
Greg Ward | ff564d3 | 2005-03-08 01:10:20 +0000 | [diff] [blame] | 1075 | that takes the class of which an instance was requested as its first |
| 1076 | argument. The remaining arguments are those passed to the object |
| 1077 | constructor expression (the call to the class). The return value of |
| 1078 | \method{__new__()} should be the new object instance (usually an |
| 1079 | instance of \var{cls}). |
| 1080 | |
| 1081 | Typical implementations create a new instance of the class by invoking |
| 1082 | the superclass's \method{__new__()} method using |
| 1083 | \samp{super(\var{currentclass}, \var{cls}).__new__(\var{cls}[, ...])} |
| 1084 | with appropriate arguments and then modifying the newly-created instance |
| 1085 | as necessary before returning it. |
| 1086 | |
| 1087 | If \method{__new__()} returns an instance of \var{cls}, then the new |
| 1088 | instance's \method{__init__()} method will be invoked like |
| 1089 | \samp{__init__(\var{self}[, ...])}, where \var{self} is the new instance |
| 1090 | and the remaining arguments are the same as were passed to |
| 1091 | \method{__new__()}. |
| 1092 | |
| 1093 | If \method{__new__()} does not return an instance of \var{cls}, then the |
| 1094 | new instance's \method{__init__()} method will not be invoked. |
| 1095 | |
| 1096 | \method{__new__()} is intended mainly to allow subclasses of |
| 1097 | immutable types (like int, str, or tuple) to customize instance |
| 1098 | creation. |
| 1099 | \end{methoddesc} |
| 1100 | |
Fred Drake | 044bb4d | 2001-08-02 15:53:05 +0000 | [diff] [blame] | 1101 | \begin{methoddesc}[object]{__init__}{self\optional{, \moreargs}} |
| 1102 | Called\indexii{class}{constructor} when the instance is created. The |
| 1103 | arguments are those passed to the class constructor expression. If a |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1104 | base class has an \method{__init__()} method, the derived class's |
| 1105 | \method{__init__()} method, if any, must explicitly call it to ensure proper |
Fred Drake | 044bb4d | 2001-08-02 15:53:05 +0000 | [diff] [blame] | 1106 | initialization of the base class part of the instance; for example: |
| 1107 | \samp{BaseClass.__init__(\var{self}, [\var{args}...])}. As a special |
Martin v. Löwis | 95cf84a | 2003-10-19 07:32:24 +0000 | [diff] [blame] | 1108 | constraint on constructors, no value may be returned; doing so will |
Fred Drake | 044bb4d | 2001-08-02 15:53:05 +0000 | [diff] [blame] | 1109 | cause a \exception{TypeError} to be raised at runtime. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1110 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1111 | |
| 1112 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1113 | \begin{methoddesc}[object]{__del__}{self} |
Guido van Rossum | 7c0240f | 1998-07-24 15:36:43 +0000 | [diff] [blame] | 1114 | Called when the instance is about to be destroyed. This is also |
| 1115 | called a destructor\index{destructor}. If a base class |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1116 | has a \method{__del__()} method, the derived class's \method{__del__()} |
| 1117 | method, if any, |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1118 | must explicitly call it to ensure proper deletion of the base class |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1119 | part of the instance. Note that it is possible (though not recommended!) |
| 1120 | for the \method{__del__()} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1121 | method to postpone destruction of the instance by creating a new |
| 1122 | reference to it. It may then be called at a later time when this new |
| 1123 | reference is deleted. It is not guaranteed that |
| 1124 | \method{__del__()} methods are called for objects that still exist when |
| 1125 | the interpreter exits. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1126 | \stindex{del} |
| 1127 | |
Fred Drake | 591dd8f | 2001-12-14 22:52:41 +0000 | [diff] [blame] | 1128 | \begin{notice} |
| 1129 | \samp{del x} doesn't directly call |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1130 | \code{x.__del__()} --- the former decrements the reference count for |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1131 | \code{x} by one, and the latter is only called when \code{x}'s reference |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1132 | count reaches zero. Some common situations that may prevent the |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1133 | reference count of an object from going to zero include: circular |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1134 | references between objects (e.g., a doubly-linked list or a tree data |
| 1135 | structure with parent and child pointers); a reference to the object |
| 1136 | on the stack frame of a function that caught an exception (the |
| 1137 | traceback stored in \code{sys.exc_traceback} keeps the stack frame |
| 1138 | alive); or a reference to the object on the stack frame that raised an |
| 1139 | unhandled exception in interactive mode (the traceback stored in |
| 1140 | \code{sys.last_traceback} keeps the stack frame alive). The first |
| 1141 | situation can only be remedied by explicitly breaking the cycles; the |
Fred Drake | 591dd8f | 2001-12-14 22:52:41 +0000 | [diff] [blame] | 1142 | latter two situations can be resolved by storing \code{None} in |
| 1143 | \code{sys.exc_traceback} or \code{sys.last_traceback}. Circular |
| 1144 | references which are garbage are detected when the option cycle |
| 1145 | detector is enabled (it's on by default), but can only be cleaned up |
| 1146 | if there are no Python-level \method{__del__()} methods involved. |
| 1147 | Refer to the documentation for the \ulink{\module{gc} |
| 1148 | module}{../lib/module-gc.html} for more information about how |
| 1149 | \method{__del__()} methods are handled by the cycle detector, |
| 1150 | particularly the description of the \code{garbage} value. |
| 1151 | \end{notice} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1152 | |
Fred Drake | 591dd8f | 2001-12-14 22:52:41 +0000 | [diff] [blame] | 1153 | \begin{notice}[warning] |
| 1154 | Due to the precarious circumstances under which |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1155 | \method{__del__()} methods are invoked, exceptions that occur during their |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1156 | execution are ignored, and a warning is printed to \code{sys.stderr} |
Fred Drake | 591dd8f | 2001-12-14 22:52:41 +0000 | [diff] [blame] | 1157 | instead. Also, when \method{__del__()} is invoked in response to a module |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1158 | being deleted (e.g., when execution of the program is done), other |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1159 | globals referenced by the \method{__del__()} method may already have been |
| 1160 | deleted. For this reason, \method{__del__()} methods should do the |
Raymond Hettinger | a0e4d6c | 2002-09-08 21:10:54 +0000 | [diff] [blame] | 1161 | absolute minimum needed to maintain external invariants. Starting with |
| 1162 | version 1.5, Python guarantees that globals whose name begins with a single |
| 1163 | underscore are deleted from their module before other globals are deleted; |
| 1164 | if no other references to such globals exist, this may help in assuring that |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1165 | imported modules are still available at the time when the |
Fred Drake | 591dd8f | 2001-12-14 22:52:41 +0000 | [diff] [blame] | 1166 | \method{__del__()} method is called. |
| 1167 | \end{notice} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1168 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1169 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1170 | \begin{methoddesc}[object]{__repr__}{self} |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 1171 | Called by the \function{repr()}\bifuncindex{repr} built-in function |
| 1172 | and by string conversions (reverse quotes) to compute the ``official'' |
Andrew M. Kuchling | 68abe83 | 2000-12-19 14:09:21 +0000 | [diff] [blame] | 1173 | string representation of an object. If at all possible, this should |
Guido van Rossum | 035f7e8 | 2000-12-19 04:18:13 +0000 | [diff] [blame] | 1174 | look like a valid Python expression that could be used to recreate an |
| 1175 | object with the same value (given an appropriate environment). If |
| 1176 | this is not possible, a string of the form \samp{<\var{...some useful |
| 1177 | description...}>} should be returned. The return value must be a |
| 1178 | string object. |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1179 | If a class defines \method{__repr__()} but not \method{__str__()}, |
| 1180 | then \method{__repr__()} is also used when an ``informal'' string |
| 1181 | representation of instances of that class is required. |
Guido van Rossum | 035f7e8 | 2000-12-19 04:18:13 +0000 | [diff] [blame] | 1182 | |
| 1183 | This is typically used for debugging, so it is important that the |
| 1184 | representation is information-rich and unambiguous. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1185 | \indexii{string}{conversion} |
| 1186 | \indexii{reverse}{quotes} |
| 1187 | \indexii{backward}{quotes} |
| 1188 | \index{back-quotes} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1189 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1190 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1191 | \begin{methoddesc}[object]{__str__}{self} |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1192 | Called by the \function{str()}\bifuncindex{str} built-in function and |
| 1193 | by the \keyword{print}\stindex{print} statement to compute the |
Fred Drake | 8238587 | 1998-10-01 20:40:43 +0000 | [diff] [blame] | 1194 | ``informal'' string representation of an object. This differs from |
| 1195 | \method{__repr__()} in that it does not have to be a valid Python |
| 1196 | expression: a more convenient or concise representation may be used |
Guido van Rossum | 035f7e8 | 2000-12-19 04:18:13 +0000 | [diff] [blame] | 1197 | instead. The return value must be a string object. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1198 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1199 | |
Guido van Rossum | ab782dd | 2001-01-18 15:17:06 +0000 | [diff] [blame] | 1200 | \begin{methoddesc}[object]{__lt__}{self, other} |
| 1201 | \methodline[object]{__le__}{self, other} |
| 1202 | \methodline[object]{__eq__}{self, other} |
| 1203 | \methodline[object]{__ne__}{self, other} |
| 1204 | \methodline[object]{__gt__}{self, other} |
| 1205 | \methodline[object]{__ge__}{self, other} |
| 1206 | \versionadded{2.1} |
| 1207 | These are the so-called ``rich comparison'' methods, and are called |
| 1208 | for comparison operators in preference to \method{__cmp__()} below. |
| 1209 | The correspondence between operator symbols and method names is as |
| 1210 | follows: |
| 1211 | \code{\var{x}<\var{y}} calls \code{\var{x}.__lt__(\var{y})}, |
| 1212 | \code{\var{x}<=\var{y}} calls \code{\var{x}.__le__(\var{y})}, |
| 1213 | \code{\var{x}==\var{y}} calls \code{\var{x}.__eq__(\var{y})}, |
| 1214 | \code{\var{x}!=\var{y}} and \code{\var{x}<>\var{y}} call |
| 1215 | \code{\var{x}.__ne__(\var{y})}, |
| 1216 | \code{\var{x}>\var{y}} calls \code{\var{x}.__gt__(\var{y})}, and |
| 1217 | \code{\var{x}>=\var{y}} calls \code{\var{x}.__ge__(\var{y})}. |
| 1218 | These methods can return any value, but if the comparison operator is |
| 1219 | used in a Boolean context, the return value should be interpretable as |
| 1220 | a Boolean value, else a \exception{TypeError} will be raised. |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1221 | By convention, \code{False} is used for false and \code{True} for true. |
Guido van Rossum | ab782dd | 2001-01-18 15:17:06 +0000 | [diff] [blame] | 1222 | |
Raymond Hettinger | 4d6e8fe | 2003-07-16 19:40:23 +0000 | [diff] [blame] | 1223 | There are no implied relationships among the comparison operators. |
Raymond Hettinger | 943277e | 2003-07-17 14:47:12 +0000 | [diff] [blame] | 1224 | The truth of \code{\var{x}==\var{y}} does not imply that \code{\var{x}!=\var{y}} |
Fred Drake | b3dfc0a | 2005-09-07 04:57:56 +0000 | [diff] [blame] | 1225 | is false. Accordingly, when defining \method{__eq__()}, one should also |
| 1226 | define \method{__ne__()} so that the operators will behave as expected. |
Raymond Hettinger | 4d6e8fe | 2003-07-16 19:40:23 +0000 | [diff] [blame] | 1227 | |
Guido van Rossum | ab782dd | 2001-01-18 15:17:06 +0000 | [diff] [blame] | 1228 | There are no reflected (swapped-argument) versions of these methods |
| 1229 | (to be used when the left argument does not support the operation but |
| 1230 | the right argument does); rather, \method{__lt__()} and |
| 1231 | \method{__gt__()} are each other's reflection, \method{__le__()} and |
| 1232 | \method{__ge__()} are each other's reflection, and \method{__eq__()} |
| 1233 | and \method{__ne__()} are their own reflection. |
| 1234 | |
| 1235 | Arguments to rich comparison methods are never coerced. A rich |
| 1236 | comparison method may return \code{NotImplemented} if it does not |
| 1237 | implement the operation for a given pair of arguments. |
| 1238 | \end{methoddesc} |
| 1239 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1240 | \begin{methoddesc}[object]{__cmp__}{self, other} |
Guido van Rossum | ab782dd | 2001-01-18 15:17:06 +0000 | [diff] [blame] | 1241 | Called by comparison operations if rich comparison (see above) is not |
Fred Drake | 597bc1d | 2001-05-29 16:02:35 +0000 | [diff] [blame] | 1242 | defined. Should return a negative integer if \code{self < other}, |
| 1243 | zero if \code{self == other}, a positive integer if \code{self > |
| 1244 | other}. If no \method{__cmp__()}, \method{__eq__()} or |
| 1245 | \method{__ne__()} operation is defined, class instances are compared |
| 1246 | by object identity (``address''). See also the description of |
| 1247 | \method{__hash__()} for some important notes on creating objects which |
| 1248 | support custom comparison operations and are usable as dictionary |
| 1249 | keys. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1250 | (Note: the restriction that exceptions are not propagated by |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1251 | \method{__cmp__()} has been removed since Python 1.5.) |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1252 | \bifuncindex{cmp} |
| 1253 | \index{comparisons} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1254 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1255 | |
Fred Drake | e57a114 | 2000-06-15 20:07:25 +0000 | [diff] [blame] | 1256 | \begin{methoddesc}[object]{__rcmp__}{self, other} |
Fred Drake | 445f832 | 2001-01-04 15:11:48 +0000 | [diff] [blame] | 1257 | \versionchanged[No longer supported]{2.1} |
Fred Drake | e57a114 | 2000-06-15 20:07:25 +0000 | [diff] [blame] | 1258 | \end{methoddesc} |
| 1259 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1260 | \begin{methoddesc}[object]{__hash__}{self} |
Brett Cannon | a031a08 | 2004-06-29 04:14:02 +0000 | [diff] [blame] | 1261 | Called for the key object for dictionary \obindex{dictionary} |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1262 | operations, and by the built-in function |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1263 | \function{hash()}\bifuncindex{hash}. Should return a 32-bit integer |
| 1264 | usable as a hash value |
| 1265 | for dictionary operations. The only required property is that objects |
| 1266 | which compare equal have the same hash value; it is advised to somehow |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1267 | mix together (e.g., using exclusive or) the hash values for the |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1268 | components of the object that also play a part in comparison of |
| 1269 | objects. If a class does not define a \method{__cmp__()} method it should |
| 1270 | not define a \method{__hash__()} operation either; if it defines |
Fred Drake | 597bc1d | 2001-05-29 16:02:35 +0000 | [diff] [blame] | 1271 | \method{__cmp__()} or \method{__eq__()} but not \method{__hash__()}, |
| 1272 | its instances will not be usable as dictionary keys. If a class |
| 1273 | defines mutable objects and implements a \method{__cmp__()} or |
| 1274 | \method{__eq__()} method, it should not implement \method{__hash__()}, |
| 1275 | since the dictionary implementation requires that a key's hash value |
| 1276 | is immutable (if the object's hash value changes, it will be in the |
| 1277 | wrong hash bucket). |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1278 | \withsubitem{(object method)}{\ttindex{__cmp__()}} |
| 1279 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1280 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1281 | \begin{methoddesc}[object]{__nonzero__}{self} |
Guido van Rossum | 77f6a65 | 2002-04-03 22:41:51 +0000 | [diff] [blame] | 1282 | Called to implement truth value testing, and the built-in operation |
| 1283 | \code{bool()}; should return \code{False} or \code{True}, or their |
| 1284 | integer equivalents \code{0} or \code{1}. |
| 1285 | When this method is not defined, \method{__len__()} is |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1286 | called, if it is defined (see below). If a class defines neither |
| 1287 | \method{__len__()} nor \method{__nonzero__()}, all its instances are |
| 1288 | considered true. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1289 | \withsubitem{(mapping object method)}{\ttindex{__len__()}} |
| 1290 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1291 | |
Martin v. Löwis | 2a519f8 | 2002-04-11 12:39:35 +0000 | [diff] [blame] | 1292 | \begin{methoddesc}[object]{__unicode__}{self} |
| 1293 | Called to implement \function{unicode()}\bifuncindex{unicode} builtin; |
| 1294 | should return a Unicode object. When this method is not defined, string |
| 1295 | conversion is attempted, and the result of string conversion is converted |
| 1296 | to Unicode using the system default encoding. |
| 1297 | \end{methoddesc} |
| 1298 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1299 | |
Fred Drake | 61c7728 | 1998-07-28 19:34:22 +0000 | [diff] [blame] | 1300 | \subsection{Customizing attribute access\label{attribute-access}} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1301 | |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1302 | The following methods can be defined to customize the meaning of |
| 1303 | attribute access (use of, assignment to, or deletion of \code{x.name}) |
| 1304 | for class instances. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1305 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1306 | \begin{methoddesc}[object]{__getattr__}{self, name} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1307 | Called when an attribute lookup has not found the attribute in the |
| 1308 | usual places (i.e. it is not an instance attribute nor is it found in |
| 1309 | the class tree for \code{self}). \code{name} is the attribute name. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1310 | This method should return the (computed) attribute value or raise an |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1311 | \exception{AttributeError} exception. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1312 | |
| 1313 | Note that if the attribute is found through the normal mechanism, |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1314 | \method{__getattr__()} is not called. (This is an intentional |
| 1315 | asymmetry between \method{__getattr__()} and \method{__setattr__()}.) |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1316 | This is done both for efficiency reasons and because otherwise |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1317 | \method{__setattr__()} would have no way to access other attributes of |
Guido van Rossum | d41eea0 | 2003-02-28 14:11:45 +0000 | [diff] [blame] | 1318 | the instance. Note that at least for instance variables, you can fake |
| 1319 | total control by not inserting any values in the instance attribute |
| 1320 | dictionary (but instead inserting them in another object). See the |
| 1321 | \method{__getattribute__()} method below for a way to actually get |
| 1322 | total control in new-style classes. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1323 | \withsubitem{(object method)}{\ttindex{__setattr__()}} |
| 1324 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1325 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1326 | \begin{methoddesc}[object]{__setattr__}{self, name, value} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1327 | Called when an attribute assignment is attempted. This is called |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1328 | instead of the normal mechanism (i.e.\ store the value in the instance |
| 1329 | dictionary). \var{name} is the attribute name, \var{value} is the |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1330 | value to be assigned to it. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1331 | |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1332 | If \method{__setattr__()} wants to assign to an instance attribute, it |
| 1333 | should not simply execute \samp{self.\var{name} = value} --- this |
| 1334 | would cause a recursive call to itself. Instead, it should insert the |
| 1335 | value in the dictionary of instance attributes, e.g., |
Guido van Rossum | d41eea0 | 2003-02-28 14:11:45 +0000 | [diff] [blame] | 1336 | \samp{self.__dict__[\var{name}] = value}. For new-style classes, |
| 1337 | rather than accessing the instance dictionary, it should call the base |
| 1338 | class method with the same name, for example, |
| 1339 | \samp{object.__setattr__(self, name, value)}. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1340 | \withsubitem{(instance attribute)}{\ttindex{__dict__}} |
| 1341 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1342 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1343 | \begin{methoddesc}[object]{__delattr__}{self, name} |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1344 | Like \method{__setattr__()} but for attribute deletion instead of |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1345 | assignment. This should only be implemented if \samp{del |
| 1346 | obj.\var{name}} is meaningful for the object. |
| 1347 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1348 | |
Michael W. Hudson | 2ab1d08 | 2003-03-05 14:20:58 +0000 | [diff] [blame] | 1349 | \subsubsection{More attribute access for new-style classes \label{new-style-attribute-access}} |
Guido van Rossum | d41eea0 | 2003-02-28 14:11:45 +0000 | [diff] [blame] | 1350 | |
| 1351 | The following methods only apply to new-style classes. |
| 1352 | |
| 1353 | \begin{methoddesc}[object]{__getattribute__}{self, name} |
| 1354 | Called unconditionally to implement attribute accesses for instances |
Fred Drake | b3dfc0a | 2005-09-07 04:57:56 +0000 | [diff] [blame] | 1355 | of the class. If the class also defines \method{__getattr__()}, the latter |
Georg Brandl | 1c330eb | 2005-07-02 10:27:31 +0000 | [diff] [blame] | 1356 | will not be called unless \method{__getattribute__()} either calls it |
| 1357 | explicitly or raises an \exception{AttributeError}. |
Guido van Rossum | d41eea0 | 2003-02-28 14:11:45 +0000 | [diff] [blame] | 1358 | This method should return the (computed) attribute |
| 1359 | value or raise an \exception{AttributeError} exception. |
| 1360 | In order to avoid infinite recursion in this method, its |
| 1361 | implementation should always call the base class method with the same |
Fred Drake | 62364ff | 2003-03-20 18:17:16 +0000 | [diff] [blame] | 1362 | name to access any attributes it needs, for example, |
Guido van Rossum | d41eea0 | 2003-02-28 14:11:45 +0000 | [diff] [blame] | 1363 | \samp{object.__getattribute__(self, name)}. |
| 1364 | \end{methoddesc} |
| 1365 | |
Michael W. Hudson | 2ab1d08 | 2003-03-05 14:20:58 +0000 | [diff] [blame] | 1366 | \subsubsection{Implementing Descriptors \label{descriptors}} |
Guido van Rossum | d41eea0 | 2003-02-28 14:11:45 +0000 | [diff] [blame] | 1367 | |
| 1368 | The following methods only apply when an instance of the class |
Fred Drake | 62364ff | 2003-03-20 18:17:16 +0000 | [diff] [blame] | 1369 | containing the method (a so-called \emph{descriptor} class) appears in |
Guido van Rossum | d41eea0 | 2003-02-28 14:11:45 +0000 | [diff] [blame] | 1370 | the class dictionary of another new-style class, known as the |
| 1371 | \emph{owner} class. In the examples below, ``the attribute'' refers to |
Fred Drake | 62364ff | 2003-03-20 18:17:16 +0000 | [diff] [blame] | 1372 | the attribute whose name is the key of the property in the owner |
Fred Drake | 67a521e | 2004-05-06 12:44:29 +0000 | [diff] [blame] | 1373 | class' \code{__dict__}. Descriptors can only be implemented as |
| 1374 | new-style classes themselves. |
Guido van Rossum | d41eea0 | 2003-02-28 14:11:45 +0000 | [diff] [blame] | 1375 | |
| 1376 | \begin{methoddesc}[object]{__get__}{self, instance, owner} |
Fred Drake | 62364ff | 2003-03-20 18:17:16 +0000 | [diff] [blame] | 1377 | Called to get the attribute of the owner class (class attribute access) |
Raymond Hettinger | 6880431 | 2005-01-01 00:28:46 +0000 | [diff] [blame] | 1378 | or of an instance of that class (instance attribute access). |
Guido van Rossum | d41eea0 | 2003-02-28 14:11:45 +0000 | [diff] [blame] | 1379 | \var{owner} is always the owner class, while \var{instance} is the |
| 1380 | instance that the attribute was accessed through, or \code{None} when |
| 1381 | the attribute is accessed through the \var{owner}. This method should |
| 1382 | return the (computed) attribute value or raise an |
| 1383 | \exception{AttributeError} exception. |
| 1384 | \end{methoddesc} |
| 1385 | |
| 1386 | \begin{methoddesc}[object]{__set__}{self, instance, value} |
Michael W. Hudson | 2ab1d08 | 2003-03-05 14:20:58 +0000 | [diff] [blame] | 1387 | Called to set the attribute on an instance \var{instance} of the owner |
Guido van Rossum | d41eea0 | 2003-02-28 14:11:45 +0000 | [diff] [blame] | 1388 | class to a new value, \var{value}. |
| 1389 | \end{methoddesc} |
| 1390 | |
| 1391 | \begin{methoddesc}[object]{__delete__}{self, instance} |
Michael W. Hudson | 2ab1d08 | 2003-03-05 14:20:58 +0000 | [diff] [blame] | 1392 | Called to delete the attribute on an instance \var{instance} of the |
| 1393 | owner class. |
Guido van Rossum | d41eea0 | 2003-02-28 14:11:45 +0000 | [diff] [blame] | 1394 | \end{methoddesc} |
| 1395 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1396 | |
Fred Drake | 4db3661 | 2003-06-26 03:11:20 +0000 | [diff] [blame] | 1397 | \subsubsection{Invoking Descriptors \label{descriptor-invocation}} |
Raymond Hettinger | 03ec6d5 | 2003-06-25 18:29:36 +0000 | [diff] [blame] | 1398 | |
| 1399 | In general, a descriptor is an object attribute with ``binding behavior'', |
| 1400 | one whose attribute access has been overridden by methods in the descriptor |
Raymond Hettinger | df9eff0 | 2003-06-27 06:57:56 +0000 | [diff] [blame] | 1401 | protocol: \method{__get__()}, \method{__set__()}, and \method{__delete__()}. |
Raymond Hettinger | 03ec6d5 | 2003-06-25 18:29:36 +0000 | [diff] [blame] | 1402 | If any of those methods are defined for an object, it is said to be a |
| 1403 | descriptor. |
| 1404 | |
| 1405 | The default behavior for attribute access is to get, set, or delete the |
| 1406 | attribute from an object's dictionary. For instance, \code{a.x} has a |
| 1407 | lookup chain starting with \code{a.__dict__['x']}, then |
| 1408 | \code{type(a).__dict__['x']}, and continuing |
| 1409 | through the base classes of \code{type(a)} excluding metaclasses. |
| 1410 | |
| 1411 | However, if the looked-up value is an object defining one of the descriptor |
| 1412 | methods, then Python may override the default behavior and invoke the |
| 1413 | descriptor method instead. Where this occurs in the precedence chain depends |
| 1414 | on which descriptor methods were defined and how they were called. Note that |
| 1415 | descriptors are only invoked for new style objects or classes |
Raymond Hettinger | df9eff0 | 2003-06-27 06:57:56 +0000 | [diff] [blame] | 1416 | (ones that subclass \class{object()} or \class{type()}). |
Raymond Hettinger | 03ec6d5 | 2003-06-25 18:29:36 +0000 | [diff] [blame] | 1417 | |
| 1418 | The starting point for descriptor invocation is a binding, \code{a.x}. |
| 1419 | How the arguments are assembled depends on \code{a}: |
| 1420 | |
| 1421 | \begin{itemize} |
| 1422 | |
| 1423 | \item[Direct Call] The simplest and least common call is when user code |
| 1424 | directly invokes a descriptor method: \code{x.__get__(a)}. |
| 1425 | |
| 1426 | \item[Instance Binding] If binding to a new-style object instance, |
| 1427 | \code{a.x} is transformed into the call: |
| 1428 | \code{type(a).__dict__['x'].__get__(a, type(a))}. |
| 1429 | |
| 1430 | \item[Class Binding] If binding to a new-style class, \code{A.x} |
| 1431 | is transformed into the call: \code{A.__dict__['x'].__get__(None, A)}. |
| 1432 | |
| 1433 | \item[Super Binding] If \code{a} is an instance of \class{super}, |
| 1434 | then the binding \code{super(B, obj).m()} searches |
| 1435 | \code{obj.__class__.__mro__} for the base class \code{A} immediately |
| 1436 | preceding \code{B} and then invokes the descriptor with the call: |
| 1437 | \code{A.__dict__['m'].__get__(obj, A)}. |
| 1438 | |
| 1439 | \end{itemize} |
| 1440 | |
| 1441 | For instance bindings, the precedence of descriptor invocation depends |
| 1442 | on the which descriptor methods are defined. Data descriptors define |
Raymond Hettinger | df9eff0 | 2003-06-27 06:57:56 +0000 | [diff] [blame] | 1443 | both \method{__get__()} and \method{__set__()}. Non-data descriptors have |
| 1444 | just the \method{__get__()} method. Data descriptors always override |
Raymond Hettinger | 03ec6d5 | 2003-06-25 18:29:36 +0000 | [diff] [blame] | 1445 | a redefinition in an instance dictionary. In contrast, non-data |
| 1446 | descriptors can be overridden by instances. |
| 1447 | |
Raymond Hettinger | df9eff0 | 2003-06-27 06:57:56 +0000 | [diff] [blame] | 1448 | Python methods (including \function{staticmethod()} and \function{classmethod()}) |
Raymond Hettinger | 03ec6d5 | 2003-06-25 18:29:36 +0000 | [diff] [blame] | 1449 | are implemented as non-data descriptors. Accordingly, instances can |
| 1450 | redefine and override methods. This allows individual instances to acquire |
| 1451 | behaviors that differ from other instances of the same class. |
| 1452 | |
Raymond Hettinger | df9eff0 | 2003-06-27 06:57:56 +0000 | [diff] [blame] | 1453 | The \function{property()} function is implemented as a data descriptor. |
| 1454 | Accordingly, instances cannot override the behavior of a property. |
| 1455 | |
| 1456 | |
| 1457 | \subsubsection{__slots__\label{slots}} |
| 1458 | |
| 1459 | By default, instances of both old and new-style classes have a dictionary |
| 1460 | for attribute storage. This wastes space for objects having very few instance |
| 1461 | variables. The space consumption can become acute when creating large numbers |
| 1462 | of instances. |
| 1463 | |
| 1464 | The default can be overridden by defining \var{__slots__} in a new-style class |
| 1465 | definition. The \var{__slots__} declaration takes a sequence of instance |
| 1466 | variables and reserves just enough space in each instance to hold a value |
| 1467 | for each variable. Space is saved because \var{__dict__} is not created for |
| 1468 | each instance. |
| 1469 | |
| 1470 | \begin{datadesc}{__slots__} |
| 1471 | This class variable can be assigned a string, iterable, or sequence of strings |
Raymond Hettinger | 5918f8d | 2003-06-29 04:53:23 +0000 | [diff] [blame] | 1472 | with variable names used by instances. If defined in a new-style class, |
| 1473 | \var{__slots__} reserves space for the declared variables |
Raymond Hettinger | df9eff0 | 2003-06-27 06:57:56 +0000 | [diff] [blame] | 1474 | and prevents the automatic creation of \var{__dict__} and \var{__weakref__} |
| 1475 | for each instance. |
| 1476 | \versionadded{2.2} |
| 1477 | \end{datadesc} |
| 1478 | |
| 1479 | \noindent |
Raymond Hettinger | 5918f8d | 2003-06-29 04:53:23 +0000 | [diff] [blame] | 1480 | Notes on using \var{__slots__} |
Raymond Hettinger | df9eff0 | 2003-06-27 06:57:56 +0000 | [diff] [blame] | 1481 | |
| 1482 | \begin{itemize} |
| 1483 | |
| 1484 | \item Without a \var{__dict__} variable, instances cannot be assigned new |
| 1485 | variables not listed in the \var{__slots__} definition. Attempts to assign |
| 1486 | to an unlisted variable name raises \exception{AttributeError}. If dynamic |
| 1487 | assignment of new variables is desired, then add \code{'__dict__'} to the |
| 1488 | sequence of strings in the \var{__slots__} declaration. |
| 1489 | \versionchanged[Previously, adding \code{'__dict__'} to the \var{__slots__} |
| 1490 | declaration would not enable the assignment of new attributes not |
| 1491 | specifically listed in the sequence of instance variable names]{2.3} |
| 1492 | |
| 1493 | \item Without a \var{__weakref__} variable for each instance, classes |
| 1494 | defining \var{__slots__} do not support weak references to its instances. |
| 1495 | If weak reference support is needed, then add \code{'__weakref__'} to the |
| 1496 | sequence of strings in the \var{__slots__} declaration. |
Raymond Hettinger | 5918f8d | 2003-06-29 04:53:23 +0000 | [diff] [blame] | 1497 | \versionchanged[Previously, adding \code{'__weakref__'} to the \var{__slots__} |
Raymond Hettinger | df9eff0 | 2003-06-27 06:57:56 +0000 | [diff] [blame] | 1498 | declaration would not enable support for weak references]{2.3} |
| 1499 | |
| 1500 | \item \var{__slots__} are implemented at the class level by creating |
| 1501 | descriptors (\ref{descriptors}) for each variable name. As a result, |
| 1502 | class attributes cannot be used to set default values for instance |
| 1503 | variables defined by \var{__slots__}; otherwise, the class attribute would |
| 1504 | overwrite the descriptor assignment. |
| 1505 | |
| 1506 | \item If a class defines a slot also defined in a base class, the instance |
| 1507 | variable defined by the base class slot is inaccessible (except by retrieving |
| 1508 | its descriptor directly from the base class). This renders the meaning of the |
| 1509 | program undefined. In the future, a check may be added to prevent this. |
| 1510 | |
| 1511 | \item The action of a \var{__slots__} declaration is limited to the class |
| 1512 | where it is defined. As a result, subclasses will have a \var{__dict__} |
| 1513 | unless they also define \var{__slots__}. |
| 1514 | |
| 1515 | \item \var{__slots__} do not work for classes derived from ``variable-length'' |
| 1516 | built-in types such as \class{long}, \class{str} and \class{tuple}. |
| 1517 | |
Raymond Hettinger | 5918f8d | 2003-06-29 04:53:23 +0000 | [diff] [blame] | 1518 | \item Any non-string iterable may be assigned to \var{__slots__}. |
Raymond Hettinger | df9eff0 | 2003-06-27 06:57:56 +0000 | [diff] [blame] | 1519 | Mappings may also be used; however, in the future, special meaning may |
| 1520 | be assigned to the values corresponding to each key. |
| 1521 | |
| 1522 | \end{itemize} |
| 1523 | |
| 1524 | |
| 1525 | \subsection{Customizing class creation\label{metaclasses}} |
| 1526 | |
| 1527 | By default, new-style classes are constructed using \function{type()}. |
| 1528 | A class definition is read into a separate namespace and the value |
| 1529 | of class name is bound to the result of \code{type(name, bases, dict)}. |
| 1530 | |
| 1531 | When the class definition is read, if \var{__metaclass__} is defined |
| 1532 | then the callable assigned to it will be called instead of \function{type()}. |
| 1533 | The allows classes or functions to be written which monitor or alter the class |
| 1534 | creation process: |
| 1535 | |
| 1536 | \begin{itemize} |
| 1537 | \item Modifying the class dictionary prior to the class being created. |
| 1538 | \item Returning an instance of another class -- essentially performing |
| 1539 | the role of a factory function. |
| 1540 | \end{itemize} |
| 1541 | |
| 1542 | \begin{datadesc}{__metaclass__} |
| 1543 | This variable can be any callable accepting arguments for \code{name}, |
| 1544 | \code{bases}, and \code{dict}. Upon class creation, the callable is |
| 1545 | used instead of the built-in \function{type()}. |
| 1546 | \versionadded{2.2} |
| 1547 | \end{datadesc} |
| 1548 | |
| 1549 | The appropriate metaclass is determined by the following precedence rules: |
| 1550 | |
| 1551 | \begin{itemize} |
| 1552 | |
| 1553 | \item If \code{dict['__metaclass__']} exists, it is used. |
| 1554 | |
| 1555 | \item Otherwise, if there is at least one base class, its metaclass is used |
| 1556 | (this looks for a \var{__class__} attribute first and if not found, uses its |
| 1557 | type). |
| 1558 | |
| 1559 | \item Otherwise, if a global variable named __metaclass__ exists, it is used. |
| 1560 | |
| 1561 | \item Otherwise, the old-style, classic metaclass (types.ClassType) is used. |
| 1562 | |
| 1563 | \end{itemize} |
| 1564 | |
| 1565 | The potential uses for metaclasses are boundless. Some ideas that have |
| 1566 | been explored including logging, interface checking, automatic delegation, |
| 1567 | automatic property creation, proxies, frameworks, and automatic resource |
| 1568 | locking/synchronization. |
Raymond Hettinger | 03ec6d5 | 2003-06-25 18:29:36 +0000 | [diff] [blame] | 1569 | |
| 1570 | |
Fred Drake | 61c7728 | 1998-07-28 19:34:22 +0000 | [diff] [blame] | 1571 | \subsection{Emulating callable objects\label{callable-types}} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1572 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1573 | \begin{methoddesc}[object]{__call__}{self\optional{, args...}} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1574 | Called when the instance is ``called'' as a function; if this method |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1575 | is defined, \code{\var{x}(arg1, arg2, ...)} is a shorthand for |
| 1576 | \code{\var{x}.__call__(arg1, arg2, ...)}. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1577 | \indexii{call}{instance} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1578 | \end{methoddesc} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1579 | |
| 1580 | |
Fred Drake | 73921b0 | 2001-10-01 16:32:13 +0000 | [diff] [blame] | 1581 | \subsection{Emulating container types\label{sequence-types}} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1582 | |
Fred Drake | 73921b0 | 2001-10-01 16:32:13 +0000 | [diff] [blame] | 1583 | The following methods can be defined to implement container |
| 1584 | objects. Containers usually are sequences (such as lists or tuples) |
| 1585 | or mappings (like dictionaries), but can represent other containers as |
| 1586 | well. The first set of methods is used either to emulate a |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1587 | sequence or to emulate a mapping; the difference is that for a |
| 1588 | sequence, the allowable keys should be the integers \var{k} for which |
| 1589 | \code{0 <= \var{k} < \var{N}} where \var{N} is the length of the |
Thomas Wouters | 1d75a79 | 2000-08-17 22:37:32 +0000 | [diff] [blame] | 1590 | sequence, or slice objects, which define a range of items. (For backwards |
| 1591 | compatibility, the method \method{__getslice__()} (see below) can also be |
| 1592 | defined to handle simple, but not extended slices.) It is also recommended |
Fred Drake | a007382 | 2000-08-18 02:42:14 +0000 | [diff] [blame] | 1593 | that mappings provide the methods \method{keys()}, \method{values()}, |
Thomas Wouters | 1d75a79 | 2000-08-17 22:37:32 +0000 | [diff] [blame] | 1594 | \method{items()}, \method{has_key()}, \method{get()}, \method{clear()}, |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1595 | \method{setdefault()}, \method{iterkeys()}, \method{itervalues()}, |
Raymond Hettinger | f4ca5a2 | 2003-01-19 14:57:12 +0000 | [diff] [blame] | 1596 | \method{iteritems()}, \method{pop()}, \method{popitem()}, |
Thomas Wouters | 1d75a79 | 2000-08-17 22:37:32 +0000 | [diff] [blame] | 1597 | \method{copy()}, and \method{update()} behaving similar to those for |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1598 | Python's standard dictionary objects. The \module{UserDict} module |
| 1599 | provides a \class{DictMixin} class to help create those methods |
| 1600 | from a base set of \method{__getitem__()}, \method{__setitem__()}, |
| 1601 | \method{__delitem__()}, and \method{keys()}. |
| 1602 | Mutable sequences should provide |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1603 | methods \method{append()}, \method{count()}, \method{index()}, |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1604 | \method{extend()}, |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1605 | \method{insert()}, \method{pop()}, \method{remove()}, \method{reverse()} |
| 1606 | and \method{sort()}, like Python standard list objects. Finally, |
| 1607 | sequence types should implement addition (meaning concatenation) and |
| 1608 | multiplication (meaning repetition) by defining the methods |
Thomas Wouters | 12bba85 | 2000-08-24 20:06:04 +0000 | [diff] [blame] | 1609 | \method{__add__()}, \method{__radd__()}, \method{__iadd__()}, |
| 1610 | \method{__mul__()}, \method{__rmul__()} and \method{__imul__()} described |
| 1611 | below; they should not define \method{__coerce__()} or other numerical |
Guido van Rossum | 0dbb4fb | 2001-04-20 16:50:40 +0000 | [diff] [blame] | 1612 | operators. It is recommended that both mappings and sequences |
Fred Drake | 18d8d5a | 2001-09-18 17:58:20 +0000 | [diff] [blame] | 1613 | implement the \method{__contains__()} method to allow efficient use of |
| 1614 | the \code{in} operator; for mappings, \code{in} should be equivalent |
| 1615 | of \method{has_key()}; for sequences, it should search through the |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1616 | values. It is further recommended that both mappings and sequences |
| 1617 | implement the \method{__iter__()} method to allow efficient iteration |
| 1618 | through the container; for mappings, \method{__iter__()} should be |
| 1619 | the same as \method{iterkeys()}; for sequences, it should iterate |
| 1620 | through the values. |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 1621 | \withsubitem{(mapping object method)}{ |
| 1622 | \ttindex{keys()} |
| 1623 | \ttindex{values()} |
| 1624 | \ttindex{items()} |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1625 | \ttindex{iterkeys()} |
| 1626 | \ttindex{itervalues()} |
| 1627 | \ttindex{iteritems()} |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 1628 | \ttindex{has_key()} |
| 1629 | \ttindex{get()} |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1630 | \ttindex{setdefault()} |
| 1631 | \ttindex{pop()} |
| 1632 | \ttindex{popitem()} |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 1633 | \ttindex{clear()} |
| 1634 | \ttindex{copy()} |
Guido van Rossum | 0dbb4fb | 2001-04-20 16:50:40 +0000 | [diff] [blame] | 1635 | \ttindex{update()} |
| 1636 | \ttindex{__contains__()}} |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 1637 | \withsubitem{(sequence object method)}{ |
| 1638 | \ttindex{append()} |
| 1639 | \ttindex{count()} |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1640 | \ttindex{extend()} |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 1641 | \ttindex{index()} |
| 1642 | \ttindex{insert()} |
| 1643 | \ttindex{pop()} |
| 1644 | \ttindex{remove()} |
| 1645 | \ttindex{reverse()} |
| 1646 | \ttindex{sort()} |
| 1647 | \ttindex{__add__()} |
| 1648 | \ttindex{__radd__()} |
Thomas Wouters | 12bba85 | 2000-08-24 20:06:04 +0000 | [diff] [blame] | 1649 | \ttindex{__iadd__()} |
Fred Drake | 4856d01 | 1999-01-12 04:15:20 +0000 | [diff] [blame] | 1650 | \ttindex{__mul__()} |
Thomas Wouters | 12bba85 | 2000-08-24 20:06:04 +0000 | [diff] [blame] | 1651 | \ttindex{__rmul__()} |
Guido van Rossum | 0dbb4fb | 2001-04-20 16:50:40 +0000 | [diff] [blame] | 1652 | \ttindex{__imul__()} |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1653 | \ttindex{__contains__()} |
| 1654 | \ttindex{__iter__()}} |
Fred Drake | ae3e574 | 1999-01-28 23:21:49 +0000 | [diff] [blame] | 1655 | \withsubitem{(numeric object method)}{\ttindex{__coerce__()}} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1656 | |
Fred Drake | 73921b0 | 2001-10-01 16:32:13 +0000 | [diff] [blame] | 1657 | \begin{methoddesc}[container object]{__len__}{self} |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1658 | Called to implement the built-in function |
| 1659 | \function{len()}\bifuncindex{len}. Should return the length of the |
| 1660 | object, an integer \code{>=} 0. Also, an object that doesn't define a |
| 1661 | \method{__nonzero__()} method and whose \method{__len__()} method |
| 1662 | returns zero is considered to be false in a Boolean context. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1663 | \withsubitem{(object method)}{\ttindex{__nonzero__()}} |
| 1664 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1665 | |
Fred Drake | 73921b0 | 2001-10-01 16:32:13 +0000 | [diff] [blame] | 1666 | \begin{methoddesc}[container object]{__getitem__}{self, key} |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1667 | Called to implement evaluation of \code{\var{self}[\var{key}]}. |
Fred Drake | 31575ce | 2000-09-21 05:28:26 +0000 | [diff] [blame] | 1668 | For sequence types, the accepted keys should be integers and slice |
| 1669 | objects.\obindex{slice} Note that |
| 1670 | the special interpretation of negative indexes (if the class wishes to |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1671 | emulate a sequence type) is up to the \method{__getitem__()} method. |
Fred Drake | 91826ed | 2000-07-13 04:57:58 +0000 | [diff] [blame] | 1672 | If \var{key} is of an inappropriate type, \exception{TypeError} may be |
| 1673 | raised; if of a value outside the set of indexes for the sequence |
| 1674 | (after any special interpretation of negative values), |
| 1675 | \exception{IndexError} should be raised. |
Raymond Hettinger | a30616a | 2005-08-21 11:26:14 +0000 | [diff] [blame] | 1676 | For mapping types, if \var{key} is missing (not in the container), |
| 1677 | \exception{KeyError} should be raised. |
Fred Drake | 0aa811c | 2001-10-20 04:24:09 +0000 | [diff] [blame] | 1678 | \note{\keyword{for} loops expect that an |
Fred Drake | 91826ed | 2000-07-13 04:57:58 +0000 | [diff] [blame] | 1679 | \exception{IndexError} will be raised for illegal indexes to allow |
Fred Drake | 0aa811c | 2001-10-20 04:24:09 +0000 | [diff] [blame] | 1680 | proper detection of the end of the sequence.} |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1681 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1682 | |
Fred Drake | 73921b0 | 2001-10-01 16:32:13 +0000 | [diff] [blame] | 1683 | \begin{methoddesc}[container object]{__setitem__}{self, key, value} |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1684 | Called to implement assignment to \code{\var{self}[\var{key}]}. Same |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1685 | note as for \method{__getitem__()}. This should only be implemented |
| 1686 | for mappings if the objects support changes to the values for keys, or |
| 1687 | if new keys can be added, or for sequences if elements can be |
Fred Drake | 91826ed | 2000-07-13 04:57:58 +0000 | [diff] [blame] | 1688 | replaced. The same exceptions should be raised for improper |
| 1689 | \var{key} values as for the \method{__getitem__()} method. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1690 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1691 | |
Fred Drake | 73921b0 | 2001-10-01 16:32:13 +0000 | [diff] [blame] | 1692 | \begin{methoddesc}[container object]{__delitem__}{self, key} |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1693 | Called to implement deletion of \code{\var{self}[\var{key}]}. Same |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1694 | note as for \method{__getitem__()}. This should only be implemented |
| 1695 | for mappings if the objects support removal of keys, or for sequences |
Fred Drake | 91826ed | 2000-07-13 04:57:58 +0000 | [diff] [blame] | 1696 | if elements can be removed from the sequence. The same exceptions |
| 1697 | should be raised for improper \var{key} values as for the |
| 1698 | \method{__getitem__()} method. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1699 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1700 | |
Fred Drake | 73921b0 | 2001-10-01 16:32:13 +0000 | [diff] [blame] | 1701 | \begin{methoddesc}[container object]{__iter__}{self} |
| 1702 | This method is called when an iterator is required for a container. |
| 1703 | This method should return a new iterator object that can iterate over |
| 1704 | all the objects in the container. For mappings, it should iterate |
| 1705 | over the keys of the container, and should also be made available as |
| 1706 | the method \method{iterkeys()}. |
| 1707 | |
| 1708 | Iterator objects also need to implement this method; they are required |
| 1709 | to return themselves. For more information on iterator objects, see |
| 1710 | ``\ulink{Iterator Types}{../lib/typeiter.html}'' in the |
| 1711 | \citetitle[../lib/lib.html]{Python Library Reference}. |
| 1712 | \end{methoddesc} |
| 1713 | |
| 1714 | The membership test operators (\keyword{in} and \keyword{not in}) are |
| 1715 | normally implemented as an iteration through a sequence. However, |
| 1716 | container objects can supply the following special method with a more |
| 1717 | efficient implementation, which also does not require the object be a |
| 1718 | sequence. |
| 1719 | |
| 1720 | \begin{methoddesc}[container object]{__contains__}{self, item} |
| 1721 | Called to implement membership test operators. Should return true if |
| 1722 | \var{item} is in \var{self}, false otherwise. For mapping objects, |
| 1723 | this should consider the keys of the mapping rather than the values or |
| 1724 | the key-item pairs. |
| 1725 | \end{methoddesc} |
| 1726 | |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1727 | |
Fred Drake | 3041b07 | 1998-10-21 00:25:32 +0000 | [diff] [blame] | 1728 | \subsection{Additional methods for emulation of sequence types |
Fred Drake | 61c7728 | 1998-07-28 19:34:22 +0000 | [diff] [blame] | 1729 | \label{sequence-methods}} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1730 | |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1731 | The following optional methods can be defined to further emulate sequence |
| 1732 | objects. Immutable sequences methods should at most only define |
| 1733 | \method{__getslice__()}; mutable sequences might define all three |
Raymond Hettinger | 92016dc | 2003-09-22 15:27:11 +0000 | [diff] [blame] | 1734 | methods. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1735 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1736 | \begin{methoddesc}[sequence object]{__getslice__}{self, i, j} |
Fred Drake | a007382 | 2000-08-18 02:42:14 +0000 | [diff] [blame] | 1737 | \deprecated{2.0}{Support slice objects as parameters to the |
| 1738 | \method{__getitem__()} method.} |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1739 | Called to implement evaluation of \code{\var{self}[\var{i}:\var{j}]}. |
| 1740 | The returned object should be of the same type as \var{self}. Note |
| 1741 | that missing \var{i} or \var{j} in the slice expression are replaced |
Fred Drake | e15956b | 2000-04-03 04:51:13 +0000 | [diff] [blame] | 1742 | by zero or \code{sys.maxint}, respectively. If negative indexes are |
| 1743 | used in the slice, the length of the sequence is added to that index. |
| 1744 | If the instance does not implement the \method{__len__()} method, an |
| 1745 | \exception{AttributeError} is raised. |
| 1746 | No guarantee is made that indexes adjusted this way are not still |
| 1747 | negative. Indexes which are greater than the length of the sequence |
| 1748 | are not modified. |
Fred Drake | a007382 | 2000-08-18 02:42:14 +0000 | [diff] [blame] | 1749 | If no \method{__getslice__()} is found, a slice |
Thomas Wouters | 1d75a79 | 2000-08-17 22:37:32 +0000 | [diff] [blame] | 1750 | object is created instead, and passed to \method{__getitem__()} instead. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1751 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1752 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1753 | \begin{methoddesc}[sequence object]{__setslice__}{self, i, j, sequence} |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1754 | Called to implement assignment to \code{\var{self}[\var{i}:\var{j}]}. |
| 1755 | Same notes for \var{i} and \var{j} as for \method{__getslice__()}. |
Thomas Wouters | 1d75a79 | 2000-08-17 22:37:32 +0000 | [diff] [blame] | 1756 | |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1757 | This method is deprecated. If no \method{__setslice__()} is found, |
| 1758 | or for extended slicing of the form |
| 1759 | \code{\var{self}[\var{i}:\var{j}:\var{k}]}, a |
| 1760 | slice object is created, and passed to \method{__setitem__()}, |
| 1761 | instead of \method{__setslice__()} being called. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1762 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1763 | |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1764 | \begin{methoddesc}[sequence object]{__delslice__}{self, i, j} |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1765 | Called to implement deletion of \code{\var{self}[\var{i}:\var{j}]}. |
| 1766 | Same notes for \var{i} and \var{j} as for \method{__getslice__()}. |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1767 | This method is deprecated. If no \method{__delslice__()} is found, |
| 1768 | or for extended slicing of the form |
| 1769 | \code{\var{self}[\var{i}:\var{j}:\var{k}]}, a |
| 1770 | slice object is created, and passed to \method{__delitem__()}, |
| 1771 | instead of \method{__delslice__()} being called. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1772 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1773 | |
Fred Drake | fb8ffe6 | 2001-04-13 15:54:41 +0000 | [diff] [blame] | 1774 | Notice that these methods are only invoked when a single slice with a |
| 1775 | single colon is used, and the slice method is available. For slice |
| 1776 | operations involving extended slice notation, or in absence of the |
| 1777 | slice methods, \method{__getitem__()}, \method{__setitem__()} or |
| 1778 | \method{__delitem__()} is called with a slice object as argument. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1779 | |
Fred Drake | f8925978 | 2000-09-21 22:27:16 +0000 | [diff] [blame] | 1780 | The following example demonstrate how to make your program or module |
| 1781 | compatible with earlier versions of Python (assuming that methods |
| 1782 | \method{__getitem__()}, \method{__setitem__()} and \method{__delitem__()} |
| 1783 | support slice objects as arguments): |
| 1784 | |
| 1785 | \begin{verbatim} |
| 1786 | class MyClass: |
| 1787 | ... |
| 1788 | def __getitem__(self, index): |
| 1789 | ... |
| 1790 | def __setitem__(self, index, value): |
| 1791 | ... |
| 1792 | def __delitem__(self, index): |
| 1793 | ... |
| 1794 | |
| 1795 | if sys.version_info < (2, 0): |
| 1796 | # They won't be defined if version is at least 2.0 final |
| 1797 | |
| 1798 | def __getslice__(self, i, j): |
| 1799 | return self[max(0, i):max(0, j):] |
| 1800 | def __setslice__(self, i, j, seq): |
| 1801 | self[max(0, i):max(0, j):] = seq |
| 1802 | def __delslice__(self, i, j): |
| 1803 | del self[max(0, i):max(0, j):] |
| 1804 | ... |
| 1805 | \end{verbatim} |
| 1806 | |
Raymond Hettinger | e701dcb | 2003-01-19 13:08:18 +0000 | [diff] [blame] | 1807 | Note the calls to \function{max()}; these are necessary because of |
| 1808 | the handling of negative indices before the |
Fred Drake | f8925978 | 2000-09-21 22:27:16 +0000 | [diff] [blame] | 1809 | \method{__*slice__()} methods are called. When negative indexes are |
| 1810 | used, the \method{__*item__()} methods receive them as provided, but |
| 1811 | the \method{__*slice__()} methods get a ``cooked'' form of the index |
| 1812 | values. For each negative index value, the length of the sequence is |
| 1813 | added to the index before calling the method (which may still result |
| 1814 | in a negative index); this is the customary handling of negative |
| 1815 | indexes by the built-in sequence types, and the \method{__*item__()} |
| 1816 | methods are expected to do this as well. However, since they should |
| 1817 | already be doing that, negative indexes cannot be passed in; they must |
Raymond Hettinger | e41d4c8 | 2003-08-25 04:39:55 +0000 | [diff] [blame] | 1818 | be constrained to the bounds of the sequence before being passed to |
Fred Drake | f8925978 | 2000-09-21 22:27:16 +0000 | [diff] [blame] | 1819 | the \method{__*item__()} methods. |
| 1820 | Calling \code{max(0, i)} conveniently returns the proper value. |
| 1821 | |
Fred Drake | 15988fd | 1999-02-12 18:14:57 +0000 | [diff] [blame] | 1822 | |
Fred Drake | 61c7728 | 1998-07-28 19:34:22 +0000 | [diff] [blame] | 1823 | \subsection{Emulating numeric types\label{numeric-types}} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1824 | |
| 1825 | The following methods can be defined to emulate numeric objects. |
| 1826 | Methods corresponding to operations that are not supported by the |
| 1827 | particular kind of number implemented (e.g., bitwise operations for |
| 1828 | non-integral numbers) should be left undefined. |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1829 | |
Fred Drake | b894370 | 1999-05-10 13:43:22 +0000 | [diff] [blame] | 1830 | \begin{methoddesc}[numeric object]{__add__}{self, other} |
| 1831 | \methodline[numeric object]{__sub__}{self, other} |
| 1832 | \methodline[numeric object]{__mul__}{self, other} |
Fred Drake | 3e2aca4 | 2001-08-14 20:28:08 +0000 | [diff] [blame] | 1833 | \methodline[numeric object]{__floordiv__}{self, other} |
Fred Drake | b894370 | 1999-05-10 13:43:22 +0000 | [diff] [blame] | 1834 | \methodline[numeric object]{__mod__}{self, other} |
| 1835 | \methodline[numeric object]{__divmod__}{self, other} |
| 1836 | \methodline[numeric object]{__pow__}{self, other\optional{, modulo}} |
| 1837 | \methodline[numeric object]{__lshift__}{self, other} |
| 1838 | \methodline[numeric object]{__rshift__}{self, other} |
| 1839 | \methodline[numeric object]{__and__}{self, other} |
| 1840 | \methodline[numeric object]{__xor__}{self, other} |
| 1841 | \methodline[numeric object]{__or__}{self, other} |
Fred Drake | 3e2aca4 | 2001-08-14 20:28:08 +0000 | [diff] [blame] | 1842 | These methods are |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1843 | called to implement the binary arithmetic operations (\code{+}, |
Fred Drake | 3e2aca4 | 2001-08-14 20:28:08 +0000 | [diff] [blame] | 1844 | \code{-}, \code{*}, \code{//}, \code{\%}, |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1845 | \function{divmod()}\bifuncindex{divmod}, |
Fred Drake | fb8ffe6 | 2001-04-13 15:54:41 +0000 | [diff] [blame] | 1846 | \function{pow()}\bifuncindex{pow}, \code{**}, \code{<}\code{<}, |
| 1847 | \code{>}\code{>}, \code{\&}, \code{\^}, \code{|}). For instance, to |
| 1848 | evaluate the expression \var{x}\code{+}\var{y}, where \var{x} is an |
| 1849 | instance of a class that has an \method{__add__()} method, |
Fred Drake | 3e2aca4 | 2001-08-14 20:28:08 +0000 | [diff] [blame] | 1850 | \code{\var{x}.__add__(\var{y})} is called. The \method{__divmod__()} |
| 1851 | method should be the equivalent to using \method{__floordiv__()} and |
| 1852 | \method{__mod__()}; it should not be related to \method{__truediv__()} |
| 1853 | (described below). Note that |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1854 | \method{__pow__()} should be defined to accept an optional third |
| 1855 | argument if the ternary version of the built-in |
| 1856 | \function{pow()}\bifuncindex{pow} function is to be supported. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1857 | \end{methoddesc} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1858 | |
Fred Drake | 3e2aca4 | 2001-08-14 20:28:08 +0000 | [diff] [blame] | 1859 | \begin{methoddesc}[numeric object]{__div__}{self, other} |
| 1860 | \methodline[numeric object]{__truediv__}{self, other} |
| 1861 | The division operator (\code{/}) is implemented by these methods. The |
| 1862 | \method{__truediv__()} method is used when \code{__future__.division} |
| 1863 | is in effect, otherwise \method{__div__()} is used. If only one of |
| 1864 | these two methods is defined, the object will not support division in |
| 1865 | the alternate context; \exception{TypeError} will be raised instead. |
| 1866 | \end{methoddesc} |
| 1867 | |
Fred Drake | b894370 | 1999-05-10 13:43:22 +0000 | [diff] [blame] | 1868 | \begin{methoddesc}[numeric object]{__radd__}{self, other} |
| 1869 | \methodline[numeric object]{__rsub__}{self, other} |
| 1870 | \methodline[numeric object]{__rmul__}{self, other} |
| 1871 | \methodline[numeric object]{__rdiv__}{self, other} |
Raymond Hettinger | 10cbe8d | 2002-06-20 06:12:37 +0000 | [diff] [blame] | 1872 | \methodline[numeric object]{__rtruediv__}{self, other} |
| 1873 | \methodline[numeric object]{__rfloordiv__}{self, other} |
Fred Drake | b894370 | 1999-05-10 13:43:22 +0000 | [diff] [blame] | 1874 | \methodline[numeric object]{__rmod__}{self, other} |
| 1875 | \methodline[numeric object]{__rdivmod__}{self, other} |
| 1876 | \methodline[numeric object]{__rpow__}{self, other} |
| 1877 | \methodline[numeric object]{__rlshift__}{self, other} |
| 1878 | \methodline[numeric object]{__rrshift__}{self, other} |
| 1879 | \methodline[numeric object]{__rand__}{self, other} |
| 1880 | \methodline[numeric object]{__rxor__}{self, other} |
| 1881 | \methodline[numeric object]{__ror__}{self, other} |
Fred Drake | 3e2aca4 | 2001-08-14 20:28:08 +0000 | [diff] [blame] | 1882 | These methods are |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1883 | called to implement the binary arithmetic operations (\code{+}, |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1884 | \code{-}, \code{*}, \code{/}, \code{\%}, |
| 1885 | \function{divmod()}\bifuncindex{divmod}, |
Fred Drake | fb8ffe6 | 2001-04-13 15:54:41 +0000 | [diff] [blame] | 1886 | \function{pow()}\bifuncindex{pow}, \code{**}, \code{<}\code{<}, |
| 1887 | \code{>}\code{>}, \code{\&}, \code{\^}, \code{|}) with reflected |
| 1888 | (swapped) operands. These functions are only called if the left |
| 1889 | operand does not support the corresponding operation. For instance, |
| 1890 | to evaluate the expression \var{x}\code{-}\var{y}, where \var{y} is an |
| 1891 | instance of a class that has an \method{__rsub__()} method, |
| 1892 | \code{\var{y}.__rsub__(\var{x})} is called. Note that ternary |
| 1893 | \function{pow()}\bifuncindex{pow} will not try calling |
| 1894 | \method{__rpow__()} (the coercion rules would become too |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1895 | complicated). |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1896 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1897 | |
Thomas Wouters | dc90cc2 | 2000-12-11 23:11:51 +0000 | [diff] [blame] | 1898 | \begin{methoddesc}[numeric object]{__iadd__}{self, other} |
| 1899 | \methodline[numeric object]{__isub__}{self, other} |
| 1900 | \methodline[numeric object]{__imul__}{self, other} |
| 1901 | \methodline[numeric object]{__idiv__}{self, other} |
Raymond Hettinger | 10cbe8d | 2002-06-20 06:12:37 +0000 | [diff] [blame] | 1902 | \methodline[numeric object]{__itruediv__}{self, other} |
| 1903 | \methodline[numeric object]{__ifloordiv__}{self, other} |
| 1904 | \methodline[numeric object]{__imod__}{self, other} |
Thomas Wouters | dc90cc2 | 2000-12-11 23:11:51 +0000 | [diff] [blame] | 1905 | \methodline[numeric object]{__ipow__}{self, other\optional{, modulo}} |
| 1906 | \methodline[numeric object]{__ilshift__}{self, other} |
| 1907 | \methodline[numeric object]{__irshift__}{self, other} |
| 1908 | \methodline[numeric object]{__iand__}{self, other} |
| 1909 | \methodline[numeric object]{__ixor__}{self, other} |
| 1910 | \methodline[numeric object]{__ior__}{self, other} |
Fred Drake | fb8ffe6 | 2001-04-13 15:54:41 +0000 | [diff] [blame] | 1911 | These methods are called to implement the augmented arithmetic |
| 1912 | operations (\code{+=}, \code{-=}, \code{*=}, \code{/=}, \code{\%=}, |
| 1913 | \code{**=}, \code{<}\code{<=}, \code{>}\code{>=}, \code{\&=}, |
Fred Drake | a378864 | 2003-07-23 15:18:03 +0000 | [diff] [blame] | 1914 | \code{\textasciicircum=}, \code{|=}). These methods should attempt to do the |
Fred Drake | fb8ffe6 | 2001-04-13 15:54:41 +0000 | [diff] [blame] | 1915 | operation in-place (modifying \var{self}) and return the result (which |
| 1916 | could be, but does not have to be, \var{self}). If a specific method |
| 1917 | is not defined, the augmented operation falls back to the normal |
| 1918 | methods. For instance, to evaluate the expression |
| 1919 | \var{x}\code{+=}\var{y}, where \var{x} is an instance of a class that |
| 1920 | has an \method{__iadd__()} method, \code{\var{x}.__iadd__(\var{y})} is |
| 1921 | called. If \var{x} is an instance of a class that does not define a |
Fred Drake | b3dfc0a | 2005-09-07 04:57:56 +0000 | [diff] [blame] | 1922 | \method{__iadd__()} method, \code{\var{x}.__add__(\var{y})} and |
Fred Drake | fb8ffe6 | 2001-04-13 15:54:41 +0000 | [diff] [blame] | 1923 | \code{\var{y}.__radd__(\var{x})} are considered, as with the |
| 1924 | evaluation of \var{x}\code{+}\var{y}. |
Thomas Wouters | dc90cc2 | 2000-12-11 23:11:51 +0000 | [diff] [blame] | 1925 | \end{methoddesc} |
| 1926 | |
Fred Drake | b894370 | 1999-05-10 13:43:22 +0000 | [diff] [blame] | 1927 | \begin{methoddesc}[numeric object]{__neg__}{self} |
| 1928 | \methodline[numeric object]{__pos__}{self} |
| 1929 | \methodline[numeric object]{__abs__}{self} |
| 1930 | \methodline[numeric object]{__invert__}{self} |
Fred Drake | fb8ffe6 | 2001-04-13 15:54:41 +0000 | [diff] [blame] | 1931 | Called to implement the unary arithmetic operations (\code{-}, |
| 1932 | \code{+}, \function{abs()}\bifuncindex{abs} and \code{\~{}}). |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1933 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1934 | |
Fred Drake | b894370 | 1999-05-10 13:43:22 +0000 | [diff] [blame] | 1935 | \begin{methoddesc}[numeric object]{__complex__}{self} |
| 1936 | \methodline[numeric object]{__int__}{self} |
| 1937 | \methodline[numeric object]{__long__}{self} |
| 1938 | \methodline[numeric object]{__float__}{self} |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1939 | Called to implement the built-in functions |
Fred Drake | 15988fd | 1999-02-12 18:14:57 +0000 | [diff] [blame] | 1940 | \function{complex()}\bifuncindex{complex}, |
| 1941 | \function{int()}\bifuncindex{int}, \function{long()}\bifuncindex{long}, |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1942 | and \function{float()}\bifuncindex{float}. Should return a value of |
| 1943 | the appropriate type. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1944 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1945 | |
Fred Drake | b894370 | 1999-05-10 13:43:22 +0000 | [diff] [blame] | 1946 | \begin{methoddesc}[numeric object]{__oct__}{self} |
| 1947 | \methodline[numeric object]{__hex__}{self} |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1948 | Called to implement the built-in functions |
| 1949 | \function{oct()}\bifuncindex{oct} and |
| 1950 | \function{hex()}\bifuncindex{hex}. Should return a string value. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1951 | \end{methoddesc} |
Fred Drake | f666917 | 1998-05-06 19:52:49 +0000 | [diff] [blame] | 1952 | |
Fred Drake | b894370 | 1999-05-10 13:43:22 +0000 | [diff] [blame] | 1953 | \begin{methoddesc}[numeric object]{__coerce__}{self, other} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1954 | Called to implement ``mixed-mode'' numeric arithmetic. Should either |
Fred Drake | d82575d | 1998-08-28 20:03:12 +0000 | [diff] [blame] | 1955 | return a 2-tuple containing \var{self} and \var{other} converted to |
Fred Drake | b894370 | 1999-05-10 13:43:22 +0000 | [diff] [blame] | 1956 | a common numeric type, or \code{None} if conversion is impossible. When |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1957 | the common type would be the type of \code{other}, it is sufficient to |
| 1958 | return \code{None}, since the interpreter will also ask the other |
| 1959 | object to attempt a coercion (but sometimes, if the implementation of |
| 1960 | the other type cannot be changed, it is useful to do the conversion to |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 1961 | the other type here). A return value of \code{NotImplemented} is |
| 1962 | equivalent to returning \code{None}. |
Fred Drake | 1e42d8a | 1998-11-25 17:58:50 +0000 | [diff] [blame] | 1963 | \end{methoddesc} |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1964 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 1965 | \subsection{Coercion rules\label{coercion-rules}} |
| 1966 | |
| 1967 | This section used to document the rules for coercion. As the language |
| 1968 | has evolved, the coercion rules have become hard to document |
| 1969 | precisely; documenting what one version of one particular |
| 1970 | implementation does is undesirable. Instead, here are some informal |
| 1971 | guidelines regarding coercion. In Python 3.0, coercion will not be |
| 1972 | supported. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1973 | |
| 1974 | \begin{itemize} |
| 1975 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 1976 | \item |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1977 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 1978 | If the left operand of a \% operator is a string or Unicode object, no |
| 1979 | coercion takes place and the string formatting operation is invoked |
| 1980 | instead. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1981 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 1982 | \item |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1983 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 1984 | It is no longer recommended to define a coercion operation. |
| 1985 | Mixed-mode operations on types that don't define coercion pass the |
| 1986 | original arguments to the operation. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1987 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 1988 | \item |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1989 | |
Fred Drake | 293dd4b | 2002-06-04 16:25:57 +0000 | [diff] [blame] | 1990 | New-style classes (those derived from \class{object}) never invoke the |
| 1991 | \method{__coerce__()} method in response to a binary operator; the only |
| 1992 | time \method{__coerce__()} is invoked is when the built-in function |
| 1993 | \function{coerce()} is called. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1994 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 1995 | \item |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 1996 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 1997 | For most intents and purposes, an operator that returns |
| 1998 | \code{NotImplemented} is treated the same as one that is not |
| 1999 | implemented at all. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 2000 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2001 | \item |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 2002 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2003 | Below, \method{__op__()} and \method{__rop__()} are used to signify |
| 2004 | the generic method names corresponding to an operator; |
Fred Drake | b3dfc0a | 2005-09-07 04:57:56 +0000 | [diff] [blame] | 2005 | \method{__iop__()} is used for the corresponding in-place operator. For |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2006 | example, for the operator `\code{+}', \method{__add__()} and |
| 2007 | \method{__radd__()} are used for the left and right variant of the |
Fred Drake | b3dfc0a | 2005-09-07 04:57:56 +0000 | [diff] [blame] | 2008 | binary operator, and \method{__iadd__()} for the in-place variant. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 2009 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2010 | \item |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 2011 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2012 | For objects \var{x} and \var{y}, first \code{\var{x}.__op__(\var{y})} |
| 2013 | is tried. If this is not implemented or returns \code{NotImplemented}, |
| 2014 | \code{\var{y}.__rop__(\var{x})} is tried. If this is also not |
Fred Drake | 293dd4b | 2002-06-04 16:25:57 +0000 | [diff] [blame] | 2015 | implemented or returns \code{NotImplemented}, a \exception{TypeError} |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2016 | exception is raised. But see the following exception: |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 2017 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2018 | \item |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 2019 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2020 | Exception to the previous item: if the left operand is an instance of |
| 2021 | a built-in type or a new-style class, and the right operand is an |
| 2022 | instance of a proper subclass of that type or class, the right |
Fred Drake | 293dd4b | 2002-06-04 16:25:57 +0000 | [diff] [blame] | 2023 | operand's \method{__rop__()} method is tried \emph{before} the left |
| 2024 | operand's \method{__op__()} method. This is done so that a subclass can |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2025 | completely override binary operators. Otherwise, the left operand's |
| 2026 | __op__ method would always accept the right operand: when an instance |
| 2027 | of a given class is expected, an instance of a subclass of that class |
| 2028 | is always acceptable. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 2029 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2030 | \item |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 2031 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2032 | When either operand type defines a coercion, this coercion is called |
Fred Drake | 293dd4b | 2002-06-04 16:25:57 +0000 | [diff] [blame] | 2033 | before that type's \method{__op__()} or \method{__rop__()} method is |
| 2034 | called, but no sooner. If the coercion returns an object of a |
| 2035 | different type for the operand whose coercion is invoked, part of the |
| 2036 | process is redone using the new object. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 2037 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2038 | \item |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 2039 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2040 | When an in-place operator (like `\code{+=}') is used, if the left |
Fred Drake | 293dd4b | 2002-06-04 16:25:57 +0000 | [diff] [blame] | 2041 | operand implements \method{__iop__()}, it is invoked without any |
| 2042 | coercion. When the operation falls back to \method{__op__()} and/or |
| 2043 | \method{__rop__()}, the normal coercion rules apply. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 2044 | |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2045 | \item |
| 2046 | |
| 2047 | In \var{x}\code{+}\var{y}, if \var{x} is a sequence that implements |
| 2048 | sequence concatenation, sequence concatenation is invoked. |
| 2049 | |
| 2050 | \item |
| 2051 | |
| 2052 | In \var{x}\code{*}\var{y}, if one operator is a sequence that |
| 2053 | implements sequence repetition, and the other is an integer |
Fred Drake | 293dd4b | 2002-06-04 16:25:57 +0000 | [diff] [blame] | 2054 | (\class{int} or \class{long}), sequence repetition is invoked. |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2055 | |
| 2056 | \item |
| 2057 | |
Fred Drake | 293dd4b | 2002-06-04 16:25:57 +0000 | [diff] [blame] | 2058 | Rich comparisons (implemented by methods \method{__eq__()} and so on) |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2059 | never use coercion. Three-way comparison (implemented by |
Fred Drake | 293dd4b | 2002-06-04 16:25:57 +0000 | [diff] [blame] | 2060 | \method{__cmp__()}) does use coercion under the same conditions as |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2061 | other binary operations use it. |
| 2062 | |
| 2063 | \item |
| 2064 | |
Fred Drake | 293dd4b | 2002-06-04 16:25:57 +0000 | [diff] [blame] | 2065 | In the current implementation, the built-in numeric types \class{int}, |
| 2066 | \class{long} and \class{float} do not use coercion; the type |
| 2067 | \class{complex} however does use it. The difference can become |
Guido van Rossum | 92cf95f | 2002-06-03 19:06:41 +0000 | [diff] [blame] | 2068 | apparent when subclassing these types. Over time, the type |
Fred Drake | 293dd4b | 2002-06-04 16:25:57 +0000 | [diff] [blame] | 2069 | \class{complex} may be fixed to avoid coercion. All these types |
| 2070 | implement a \method{__coerce__()} method, for use by the built-in |
| 2071 | \function{coerce()} function. |
Guido van Rossum | 83b2f8a | 1998-07-23 17:12:46 +0000 | [diff] [blame] | 2072 | |
| 2073 | \end{itemize} |