blob: 737b8618ec52cf5a815f3a60f5bd8ceeeae3bea7 [file] [log] [blame]
Fred Drake61c77281998-07-28 19:34:22 +00001\chapter{Data model\label{datamodel}}
Fred Drakef6669171998-05-06 19:52:49 +00002
Fred Drake2829f1c2001-06-23 05:27:20 +00003
Fred Drake61c77281998-07-28 19:34:22 +00004\section{Objects, values and types\label{objects}}
Fred Drakef6669171998-05-06 19:52:49 +00005
6\dfn{Objects} are Python's abstraction for data. All data in a Python
7program is represented by objects or by relations between objects.
8(In a sense, and in conformance to Von Neumann's model of a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00009``stored program computer,'' code is also represented by objects.)
Fred Drakef6669171998-05-06 19:52:49 +000010\index{object}
11\index{data}
12
13Every object has an identity, a type and a value. An object's
14\emph{identity} never changes once it has been created; you may think
Fred Drake293dd4b2002-06-04 16:25:57 +000015of it as the object's address in memory. The `\keyword{is}' operator
Fred Drake82385871998-10-01 20:40:43 +000016compares the identity of two objects; the
17\function{id()}\bifuncindex{id} function returns an integer
18representing its identity (currently implemented as its address).
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000019An object's \dfn{type} is
Raymond Hettingere701dcb2003-01-19 13:08:18 +000020also unchangeable.\footnote{Since Python 2.2, a gradual merging of
21types and classes has been started that makes this and a few other
22assertions made in this manual not 100\% accurate and complete:
23for example, it \emph{is} now possible in some cases to change an
24object's type, under certain controlled conditions. Until this manual
25undergoes extensive revision, it must now be taken as authoritative
26only regarding ``classic classes'', that are still the default, for
Armin Rigoddddd2f2005-12-26 18:06:17 +000027compatibility purposes, in Python 2.2 and 2.3. For more information,
28see \url{http://www.python.org/doc/newstyle.html}.}
Raymond Hettingere701dcb2003-01-19 13:08:18 +000029An object's type determines the operations that the object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000030supports (e.g., ``does it have a length?'') and also defines the
Fred Drake82385871998-10-01 20:40:43 +000031possible values for objects of that type. The
32\function{type()}\bifuncindex{type} function returns an object's type
33(which is an object itself). The \emph{value} of some
Fred Drakef6669171998-05-06 19:52:49 +000034objects can change. Objects whose value can change are said to be
35\emph{mutable}; objects whose value is unchangeable once they are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000036created are called \emph{immutable}.
Guido van Rossum264bd591999-02-23 16:40:55 +000037(The value of an immutable container object that contains a reference
38to a mutable object can change when the latter's value is changed;
39however the container is still considered immutable, because the
40collection of objects it contains cannot be changed. So, immutability
41is not strictly the same as having an unchangeable value, it is more
42subtle.)
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000043An object's mutability is determined by its type; for instance,
44numbers, strings and tuples are immutable, while dictionaries and
45lists are mutable.
Fred Drakef6669171998-05-06 19:52:49 +000046\index{identity of an object}
47\index{value of an object}
48\index{type of an object}
49\index{mutable object}
50\index{immutable object}
51
52Objects are never explicitly destroyed; however, when they become
53unreachable they may be garbage-collected. An implementation is
Barry Warsaw92a6ed91998-08-07 16:33:51 +000054allowed to postpone garbage collection or omit it altogether --- it is
55a matter of implementation quality how garbage collection is
Fred Drakef6669171998-05-06 19:52:49 +000056implemented, as long as no objects are collected that are still
57reachable. (Implementation note: the current implementation uses a
Fred Drakec8e82812001-01-22 17:46:18 +000058reference-counting scheme with (optional) delayed detection of
Raymond Hettingere701dcb2003-01-19 13:08:18 +000059cyclically linked garbage, which collects most objects as soon as they
Fred Drakec8e82812001-01-22 17:46:18 +000060become unreachable, but is not guaranteed to collect garbage
61containing circular references. See the
62\citetitle[../lib/module-gc.html]{Python Library Reference} for
63information on controlling the collection of cyclic garbage.)
Fred Drakef6669171998-05-06 19:52:49 +000064\index{garbage collection}
65\index{reference counting}
66\index{unreachable object}
67
68Note that the use of the implementation's tracing or debugging
69facilities may keep objects alive that would normally be collectable.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000070Also note that catching an exception with a
Fred Drake4856d011999-01-12 04:15:20 +000071`\keyword{try}...\keyword{except}' statement may keep objects alive.
Fred Drakef6669171998-05-06 19:52:49 +000072
73Some objects contain references to ``external'' resources such as open
74files or windows. It is understood that these resources are freed
75when the object is garbage-collected, but since garbage collection is
76not guaranteed to happen, such objects also provide an explicit way to
77release the external resource, usually a \method{close()} method.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000078Programs are strongly recommended to explicitly close such
Fred Drake4856d011999-01-12 04:15:20 +000079objects. The `\keyword{try}...\keyword{finally}' statement provides
80a convenient way to do this.
Fred Drakef6669171998-05-06 19:52:49 +000081
82Some objects contain references to other objects; these are called
83\emph{containers}. Examples of containers are tuples, lists and
84dictionaries. The references are part of a container's value. In
85most cases, when we talk about the value of a container, we imply the
86values, not the identities of the contained objects; however, when we
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000087talk about the mutability of a container, only the identities of
88the immediately contained objects are implied. So, if an immutable
89container (like a tuple)
90contains a reference to a mutable object, its value changes
91if that mutable object is changed.
Fred Drakef6669171998-05-06 19:52:49 +000092\index{container}
93
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000094Types affect almost all aspects of object behavior. Even the importance
Fred Drakef6669171998-05-06 19:52:49 +000095of object identity is affected in some sense: for immutable types,
96operations that compute new values may actually return a reference to
97any existing object with the same type and value, while for mutable
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000098objects this is not allowed. E.g., after
Fred Drake82385871998-10-01 20:40:43 +000099\samp{a = 1; b = 1},
Fred Drakef6669171998-05-06 19:52:49 +0000100\code{a} and \code{b} may or may not refer to the same object with the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000101value one, depending on the implementation, but after
Fred Drake82385871998-10-01 20:40:43 +0000102\samp{c = []; d = []}, \code{c} and \code{d}
Fred Drakef6669171998-05-06 19:52:49 +0000103are guaranteed to refer to two different, unique, newly created empty
104lists.
Fred Drake82385871998-10-01 20:40:43 +0000105(Note that \samp{c = d = []} assigns the same object to both
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000106\code{c} and \code{d}.)
Fred Drakef6669171998-05-06 19:52:49 +0000107
Fred Drake2829f1c2001-06-23 05:27:20 +0000108
Fred Drake61c77281998-07-28 19:34:22 +0000109\section{The standard type hierarchy\label{types}}
Fred Drakef6669171998-05-06 19:52:49 +0000110
111Below is a list of the types that are built into Python. Extension
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000112modules (written in C, Java, or other languages, depending on
113the implementation) can define additional types. Future versions of
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000114Python may add types to the type hierarchy (e.g., rational
Fred Drakef6669171998-05-06 19:52:49 +0000115numbers, efficiently stored arrays of integers, etc.).
116\index{type}
117\indexii{data}{type}
118\indexii{type}{hierarchy}
119\indexii{extension}{module}
120\indexii{C}{language}
121
122Some of the type descriptions below contain a paragraph listing
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000123`special attributes.' These are attributes that provide access to the
Fred Drakef6669171998-05-06 19:52:49 +0000124implementation and are not intended for general use. Their definition
Fred Drake35705512001-12-03 17:32:27 +0000125may change in the future.
Fred Drakef6669171998-05-06 19:52:49 +0000126\index{attribute}
127\indexii{special}{attribute}
128\indexiii{generic}{special}{attribute}
Fred Drakef6669171998-05-06 19:52:49 +0000129
130\begin{description}
131
132\item[None]
133This type has a single value. There is a single object with this value.
134This object is accessed through the built-in name \code{None}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000135It is used to signify the absence of a value in many situations, e.g.,
136it is returned from functions that don't explicitly return anything.
137Its truth value is false.
Fred Drake7a700b82004-01-01 05:43:53 +0000138\obindex{None}
Fred Drakef6669171998-05-06 19:52:49 +0000139
Neil Schemenauer48c2eb92001-01-04 01:25:50 +0000140\item[NotImplemented]
141This type has a single value. There is a single object with this value.
142This object is accessed through the built-in name \code{NotImplemented}.
Guido van Rossumab782dd2001-01-18 15:17:06 +0000143Numeric methods and rich comparison methods may return this value if
144they do not implement the operation for the operands provided. (The
145interpreter will then try the reflected operation, or some other
146fallback, depending on the operator.) Its truth value is true.
Fred Drake7a700b82004-01-01 05:43:53 +0000147\obindex{NotImplemented}
Neil Schemenauer48c2eb92001-01-04 01:25:50 +0000148
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000149\item[Ellipsis]
150This type has a single value. There is a single object with this value.
151This object is accessed through the built-in name \code{Ellipsis}.
Fred Drake82385871998-10-01 20:40:43 +0000152It is used to indicate the presence of the \samp{...} syntax in a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000153slice. Its truth value is true.
Fred Drakec0a02c02002-04-16 02:03:05 +0000154\obindex{Ellipsis}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000155
Fred Drakef6669171998-05-06 19:52:49 +0000156\item[Numbers]
157These are created by numeric literals and returned as results by
158arithmetic operators and arithmetic built-in functions. Numeric
159objects are immutable; once created their value never changes. Python
160numbers are of course strongly related to mathematical numbers, but
161subject to the limitations of numerical representation in computers.
Fred Drakef6669171998-05-06 19:52:49 +0000162\obindex{numeric}
163
Fred Drakeb3384d32001-05-14 16:04:22 +0000164Python distinguishes between integers, floating point numbers, and
165complex numbers:
Fred Drakef6669171998-05-06 19:52:49 +0000166
167\begin{description}
168\item[Integers]
Georg Brandld4307262005-09-12 12:49:38 +0000169These represent elements from the mathematical set of integers
170(positive and negative).
Fred Drakef6669171998-05-06 19:52:49 +0000171\obindex{integer}
172
Guido van Rossum77f6a652002-04-03 22:41:51 +0000173There are three types of integers:
Fred Drakef6669171998-05-06 19:52:49 +0000174
175\begin{description}
176
177\item[Plain integers]
178These represent numbers in the range -2147483648 through 2147483647.
179(The range may be larger on machines with a larger natural word
180size, but not smaller.)
Fred Drakee15956b2000-04-03 04:51:13 +0000181When the result of an operation would fall outside this range, the
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000182result is normally returned as a long integer (in some cases, the
183exception \exception{OverflowError} is raised instead).
Fred Drakef6669171998-05-06 19:52:49 +0000184For the purpose of shift and mask operations, integers are assumed to
185have a binary, 2's complement notation using 32 or more bits, and
186hiding no bits from the user (i.e., all 4294967296 different bit
187patterns correspond to different values).
188\obindex{plain integer}
189\withsubitem{(built-in exception)}{\ttindex{OverflowError}}
190
191\item[Long integers]
192These represent numbers in an unlimited range, subject to available
193(virtual) memory only. For the purpose of shift and mask operations,
194a binary representation is assumed, and negative numbers are
195represented in a variant of 2's complement which gives the illusion of
196an infinite string of sign bits extending to the left.
197\obindex{long integer}
198
Guido van Rossum77f6a652002-04-03 22:41:51 +0000199\item[Booleans]
200These represent the truth values False and True. The two objects
201representing the values False and True are the only Boolean objects.
202The Boolean type is a subtype of plain integers, and Boolean values
203behave like the values 0 and 1, respectively, in almost all contexts,
204the exception being that when converted to a string, the strings
205\code{"False"} or \code{"True"} are returned, respectively.
206\obindex{Boolean}
207\ttindex{False}
208\ttindex{True}
209
Fred Drakef6669171998-05-06 19:52:49 +0000210\end{description} % Integers
211
212The rules for integer representation are intended to give the most
213meaningful interpretation of shift and mask operations involving
214negative integers and the least surprises when switching between the
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000215plain and long integer domains. Any operation except left shift,
Fred Drakef6669171998-05-06 19:52:49 +0000216if it yields a result in the plain integer domain without causing
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000217overflow, will yield the same result in the long integer domain or
Fred Drakef6669171998-05-06 19:52:49 +0000218when using mixed operands.
219\indexii{integer}{representation}
220
221\item[Floating point numbers]
222These represent machine-level double precision floating point numbers.
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000223You are at the mercy of the underlying machine architecture (and
224C or Java implementation) for the accepted range and handling of overflow.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000225Python does not support single-precision floating point numbers; the
Fred Drake6e5e1d92001-07-14 02:12:27 +0000226savings in processor and memory usage that are usually the reason for using
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000227these is dwarfed by the overhead of using objects in Python, so there
228is no reason to complicate the language with two kinds of floating
229point numbers.
Fred Drakef6669171998-05-06 19:52:49 +0000230\obindex{floating point}
231\indexii{floating point}{number}
232\indexii{C}{language}
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000233\indexii{Java}{language}
Fred Drakef6669171998-05-06 19:52:49 +0000234
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000235\item[Complex numbers]
236These represent complex numbers as a pair of machine-level double
237precision floating point numbers. The same caveats apply as for
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000238floating point numbers. The real and imaginary parts of a complex
239number \code{z} can be retrieved through the read-only attributes
240\code{z.real} and \code{z.imag}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000241\obindex{complex}
242\indexii{complex}{number}
243
Fred Drakef6669171998-05-06 19:52:49 +0000244\end{description} % Numbers
245
Guido van Rossum77f6a652002-04-03 22:41:51 +0000246
Fred Drakef6669171998-05-06 19:52:49 +0000247\item[Sequences]
Fred Drake230d17d2001-02-22 21:28:04 +0000248These represent finite ordered sets indexed by non-negative numbers.
Fred Drakef6669171998-05-06 19:52:49 +0000249The built-in function \function{len()}\bifuncindex{len} returns the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000250number of items of a sequence.
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000251When the length of a sequence is \var{n}, the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000252index set contains the numbers 0, 1, \ldots, \var{n}-1. Item
Fred Drakef6669171998-05-06 19:52:49 +0000253\var{i} of sequence \var{a} is selected by \code{\var{a}[\var{i}]}.
Fred Drakee15956b2000-04-03 04:51:13 +0000254\obindex{sequence}
Fred Drakef6669171998-05-06 19:52:49 +0000255\index{index operation}
256\index{item selection}
257\index{subscription}
258
259Sequences also support slicing: \code{\var{a}[\var{i}:\var{j}]}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000260selects all items with index \var{k} such that \var{i} \code{<=}
Fred Drakef6669171998-05-06 19:52:49 +0000261\var{k} \code{<} \var{j}. When used as an expression, a slice is a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000262sequence of the same type. This implies that the index set is
263renumbered so that it starts at 0.
Fred Drakef6669171998-05-06 19:52:49 +0000264\index{slicing}
265
Michael W. Hudson5efaf7e2002-06-11 10:55:12 +0000266Some sequences also support ``extended slicing'' with a third ``step''
267parameter: \code{\var{a}[\var{i}:\var{j}:\var{k}]} selects all items
268of \var{a} with index \var{x} where \code{\var{x} = \var{i} +
269\var{n}*\var{k}}, \var{n} \code{>=} \code{0} and \var{i} \code{<=}
270\var{x} \code{<} \var{j}.
271\index{extended slicing}
272
Fred Drakef6669171998-05-06 19:52:49 +0000273Sequences are distinguished according to their mutability:
274
275\begin{description}
Fred Drake4856d011999-01-12 04:15:20 +0000276
Fred Drakef6669171998-05-06 19:52:49 +0000277\item[Immutable sequences]
278An object of an immutable sequence type cannot change once it is
279created. (If the object contains references to other objects,
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000280these other objects may be mutable and may be changed; however,
Fred Drakef6669171998-05-06 19:52:49 +0000281the collection of objects directly referenced by an immutable object
282cannot change.)
283\obindex{immutable sequence}
284\obindex{immutable}
285
286The following types are immutable sequences:
287
288\begin{description}
289
290\item[Strings]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000291The items of a string are characters. There is no separate
292character type; a character is represented by a string of one item.
Fred Drakef6669171998-05-06 19:52:49 +0000293Characters represent (at least) 8-bit bytes. The built-in
294functions \function{chr()}\bifuncindex{chr} and
295\function{ord()}\bifuncindex{ord} convert between characters and
296nonnegative integers representing the byte values. Bytes with the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000297values 0-127 usually represent the corresponding \ASCII{} values, but
298the interpretation of values is up to the program. The string
299data type is also used to represent arrays of bytes, e.g., to hold data
Fred Drakef6669171998-05-06 19:52:49 +0000300read from a file.
301\obindex{string}
302\index{character}
303\index{byte}
Fred Drakec37b65e2001-11-28 07:26:15 +0000304\index{ASCII@\ASCII}
Fred Drakef6669171998-05-06 19:52:49 +0000305
Fred Drakec37b65e2001-11-28 07:26:15 +0000306(On systems whose native character set is not \ASCII, strings may use
Fred Drakef6669171998-05-06 19:52:49 +0000307EBCDIC in their internal representation, provided the functions
308\function{chr()} and \function{ord()} implement a mapping between \ASCII{} and
309EBCDIC, and string comparison preserves the \ASCII{} order.
310Or perhaps someone can propose a better rule?)
Fred Drakec37b65e2001-11-28 07:26:15 +0000311\index{ASCII@\ASCII}
Fred Drakef6669171998-05-06 19:52:49 +0000312\index{EBCDIC}
313\index{character set}
314\indexii{string}{comparison}
315\bifuncindex{chr}
316\bifuncindex{ord}
317
Fred Drakef0aff8e2000-04-06 13:57:21 +0000318\item[Unicode]
Fred Drake5ec22f22002-09-24 21:09:13 +0000319The items of a Unicode object are Unicode code units. A Unicode code
320unit is represented by a Unicode object of one item and can hold
321either a 16-bit or 32-bit value representing a Unicode ordinal (the
322maximum value for the ordinal is given in \code{sys.maxunicode}, and
323depends on how Python is configured at compile time). Surrogate pairs
324may be present in the Unicode object, and will be reported as two
325separate items. The built-in functions
Fred Drakef0aff8e2000-04-06 13:57:21 +0000326\function{unichr()}\bifuncindex{unichr} and
Fred Drake5ec22f22002-09-24 21:09:13 +0000327\function{ord()}\bifuncindex{ord} convert between code units and
Fred Drakef0aff8e2000-04-06 13:57:21 +0000328nonnegative integers representing the Unicode ordinals as defined in
329the Unicode Standard 3.0. Conversion from and to other encodings are
Fred Drakeb3dfc0a2005-09-07 04:57:56 +0000330possible through the Unicode method \method{encode()} and the built-in
Fred Drake5ec22f22002-09-24 21:09:13 +0000331function \function{unicode()}.\bifuncindex{unicode}
Fred Drakef0aff8e2000-04-06 13:57:21 +0000332\obindex{unicode}
333\index{character}
334\index{integer}
Fred Drake8b3ce9e2000-04-06 14:00:14 +0000335\index{Unicode}
Fred Drakef0aff8e2000-04-06 13:57:21 +0000336
Fred Drakef6669171998-05-06 19:52:49 +0000337\item[Tuples]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000338The items of a tuple are arbitrary Python objects.
339Tuples of two or more items are formed by comma-separated lists
340of expressions. A tuple of one item (a `singleton') can be formed
Fred Drakef6669171998-05-06 19:52:49 +0000341by affixing a comma to an expression (an expression by itself does
342not create a tuple, since parentheses must be usable for grouping of
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000343expressions). An empty tuple can be formed by an empty pair of
Fred Drakef6669171998-05-06 19:52:49 +0000344parentheses.
345\obindex{tuple}
346\indexii{singleton}{tuple}
347\indexii{empty}{tuple}
348
349\end{description} % Immutable sequences
350
351\item[Mutable sequences]
352Mutable sequences can be changed after they are created. The
353subscription and slicing notations can be used as the target of
354assignment and \keyword{del} (delete) statements.
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000355\obindex{mutable sequence}
Fred Drakef6669171998-05-06 19:52:49 +0000356\obindex{mutable}
357\indexii{assignment}{statement}
358\index{delete}
359\stindex{del}
360\index{subscription}
361\index{slicing}
362
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000363There is currently a single intrinsic mutable sequence type:
Fred Drakef6669171998-05-06 19:52:49 +0000364
365\begin{description}
366
367\item[Lists]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000368The items of a list are arbitrary Python objects. Lists are formed
Fred Drakef6669171998-05-06 19:52:49 +0000369by placing a comma-separated list of expressions in square brackets.
370(Note that there are no special cases needed to form lists of length 0
371or 1.)
372\obindex{list}
373
374\end{description} % Mutable sequences
375
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000376The extension module \module{array}\refstmodindex{array} provides an
377additional example of a mutable sequence type.
378
379
Fred Drakef6669171998-05-06 19:52:49 +0000380\end{description} % Sequences
381
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000382\item[Mappings]
Fred Drakef6669171998-05-06 19:52:49 +0000383These represent finite sets of objects indexed by arbitrary index sets.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000384The subscript notation \code{a[k]} selects the item indexed
Fred Drakef6669171998-05-06 19:52:49 +0000385by \code{k} from the mapping \code{a}; this can be used in
386expressions and as the target of assignments or \keyword{del} statements.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000387The built-in function \function{len()} returns the number of items
Fred Drakef6669171998-05-06 19:52:49 +0000388in a mapping.
389\bifuncindex{len}
390\index{subscription}
391\obindex{mapping}
392
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000393There is currently a single intrinsic mapping type:
Fred Drakef6669171998-05-06 19:52:49 +0000394
395\begin{description}
396
397\item[Dictionaries]
Fred Drake8cdee961999-02-23 18:50:38 +0000398These\obindex{dictionary} represent finite sets of objects indexed by
399nearly arbitrary values. The only types of values not acceptable as
400keys are values containing lists or dictionaries or other mutable
401types that are compared by value rather than by object identity, the
402reason being that the efficient implementation of dictionaries
403requires a key's hash value to remain constant.
Fred Drakef6669171998-05-06 19:52:49 +0000404Numeric types used for keys obey the normal rules for numeric
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000405comparison: if two numbers compare equal (e.g., \code{1} and
Fred Drakef6669171998-05-06 19:52:49 +0000406\code{1.0}) then they can be used interchangeably to index the same
407dictionary entry.
408
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000409Dictionaries are mutable; they can be created by the
Fred Drake62364ff2003-03-20 18:17:16 +0000410\code{\{...\}} notation (see section~\ref{dict}, ``Dictionary
Fred Drake8cdee961999-02-23 18:50:38 +0000411Displays'').
Fred Drakef6669171998-05-06 19:52:49 +0000412
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000413The extension modules \module{dbm}\refstmodindex{dbm},
Fred Drake59c61912005-10-30 04:29:49 +0000414\module{gdbm}\refstmodindex{gdbm}, and
415\module{bsddb}\refstmodindex{bsddb} provide additional examples of
416mapping types.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000417
Fred Drakef6669171998-05-06 19:52:49 +0000418\end{description} % Mapping types
419
420\item[Callable types]
Fred Drake8cdee961999-02-23 18:50:38 +0000421These\obindex{callable} are the types to which the function call
Fred Drake62364ff2003-03-20 18:17:16 +0000422operation (see section~\ref{calls}, ``Calls'') can be applied:
Fred Drakef6669171998-05-06 19:52:49 +0000423\indexii{function}{call}
424\index{invocation}
425\indexii{function}{argument}
Fred Drakef6669171998-05-06 19:52:49 +0000426
427\begin{description}
428
429\item[User-defined functions]
430A user-defined function object is created by a function definition
Fred Drake62364ff2003-03-20 18:17:16 +0000431(see section~\ref{function}, ``Function definitions''). It should be
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000432called with an argument
Fred Drakef6669171998-05-06 19:52:49 +0000433list containing the same number of items as the function's formal
434parameter list.
435\indexii{user-defined}{function}
436\obindex{function}
437\obindex{user-defined function}
438
Michael W. Hudson5e897952004-08-12 18:12:44 +0000439Special attributes:
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000440
Michael W. Hudson5e897952004-08-12 18:12:44 +0000441\begin{tableiii}{lll}{member}{Attribute}{Meaning}{}
442 \lineiii{func_doc}{The function's documentation string, or
443 \code{None} if unavailable}{Writable}
444
445 \lineiii{__doc__}{Another way of spelling
446 \member{func_doc}}{Writable}
447
448 \lineiii{func_name}{The function's name}{Writable}
449
450 \lineiii{__name__}{Another way of spelling
451 \member{func_name}}{Writable}
452
453 \lineiii{__module__}{The name of the module the function was defined
454 in, or \code{None} if unavailable.}{Writable}
455
Raymond Hettingerf21569e2005-04-26 05:18:53 +0000456 \lineiii{func_defaults}{A tuple containing default argument values
Michael W. Hudson5e897952004-08-12 18:12:44 +0000457 for those arguments that have defaults, or \code{None} if no
458 arguments have a default value}{Writable}
459
460 \lineiii{func_code}{The code object representing the compiled
461 function body.}{Writable}
462
463 \lineiii{func_globals}{A reference to the dictionary that holds the
464 function's global variables --- the global namespace of the module
465 in which the function was defined.}{Read-only}
466
467 \lineiii{func_dict}{The namespace supporting arbitrary function
468 attributes.}{Writable}
469
470 \lineiii{func_closure}{\code{None} or a tuple of cells that contain
471 bindings for the function's free variables.}{Read-only}
472\end{tableiii}
473
474Most of the attributes labelled ``Writable'' check the type of the
475assigned value.
476
477\versionchanged[\code{func_name} is now writable]{2.4}
478
479Function objects also support getting and setting arbitrary
480attributes, which can be used, for example, to attach metadata to
481functions. Regular attribute dot-notation is used to get and set such
482attributes. \emph{Note that the current implementation only supports
483function attributes on user-defined functions. Function attributes on
484built-in functions may be supported in the future.}
485
486Additional information about a function's definition can be retrieved
487from its code object; see the description of internal types below.
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000488
Fred Drake4856d011999-01-12 04:15:20 +0000489\withsubitem{(function attribute)}{
490 \ttindex{func_doc}
491 \ttindex{__doc__}
492 \ttindex{__name__}
Jeremy Hyltonf9b0cc72003-01-31 18:52:45 +0000493 \ttindex{__module__}
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000494 \ttindex{__dict__}
Fred Drake4856d011999-01-12 04:15:20 +0000495 \ttindex{func_defaults}
Jeremy Hylton26c49b62002-04-01 17:58:39 +0000496 \ttindex{func_closure}
Fred Drake4856d011999-01-12 04:15:20 +0000497 \ttindex{func_code}
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000498 \ttindex{func_globals}
499 \ttindex{func_dict}}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000500\indexii{global}{namespace}
Fred Drakef6669171998-05-06 19:52:49 +0000501
502\item[User-defined methods]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000503A user-defined method object combines a class, a class instance (or
Fred Drake8dd6ffd2001-08-02 21:34:53 +0000504\code{None}) and any callable object (normally a user-defined
505function).
Fred Drakef6669171998-05-06 19:52:49 +0000506\obindex{method}
507\obindex{user-defined method}
508\indexii{user-defined}{method}
Fred Drakef6669171998-05-06 19:52:49 +0000509
510Special read-only attributes: \member{im_self} is the class instance
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000511object, \member{im_func} is the function object;
Raymond Hettinger03ec6d52003-06-25 18:29:36 +0000512\member{im_class} is the class of \member{im_self} for bound methods
513or the class that asked for the method for unbound methods;
Fred Drake82385871998-10-01 20:40:43 +0000514\member{__doc__} is the method's documentation (same as
515\code{im_func.__doc__}); \member{__name__} is the method name (same as
Jeremy Hyltonf9b0cc72003-01-31 18:52:45 +0000516\code{im_func.__name__}); \member{__module__} is the name of the
517module the method was defined in, or \code{None} if unavailable.
Fred Drakef9d58032001-12-07 23:13:53 +0000518\versionchanged[\member{im_self} used to refer to the class that
519 defined the method]{2.2}
Fred Drake4856d011999-01-12 04:15:20 +0000520\withsubitem{(method attribute)}{
Jeremy Hyltonf9b0cc72003-01-31 18:52:45 +0000521 \ttindex{__doc__}
522 \ttindex{__name__}
523 \ttindex{__module__}
Fred Drake4856d011999-01-12 04:15:20 +0000524 \ttindex{im_func}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000525 \ttindex{im_self}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000526
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000527Methods also support accessing (but not setting) the arbitrary
528function attributes on the underlying function object.
529
Fred Drakeea690c42003-07-17 05:26:53 +0000530User-defined method objects may be created when getting an attribute
531of a class (perhaps via an instance of that class), if that attribute
532is a user-defined function object, an unbound user-defined method object,
533or a class method object.
534When the attribute is a user-defined method object, a new
535method object is only created if the class from which it is being
536retrieved is the same as, or a derived class of, the class stored
537in the original method object; otherwise, the original method object
538is used as it is.
539
540When a user-defined method object is created by retrieving
541a user-defined function object from a class, its \member{im_self}
542attribute is \code{None} and the method object is said to be unbound.
543When one is created by retrieving a user-defined function object
544from a class via one of its instances, its \member{im_self} attribute
545is the instance, and the method object is said to be bound.
546In either case, the new method's \member{im_class} attribute
547is the class from which the retrieval takes place, and
548its \member{im_func} attribute is the original function object.
549\withsubitem{(method attribute)}{
550 \ttindex{im_class}\ttindex{im_func}\ttindex{im_self}}
551
552When a user-defined method object is created by retrieving another
553method object from a class or instance, the behaviour is the same
554as for a function object, except that the \member{im_func} attribute
555of the new instance is not the original method object but its
556\member{im_func} attribute.
557\withsubitem{(method attribute)}{
558 \ttindex{im_func}}
559
560When a user-defined method object is created by retrieving a
561class method object from a class or instance, its \member{im_self}
562attribute is the class itself (the same as the \member{im_class}
563attribute), and its \member{im_func} attribute is the function
564object underlying the class method.
Fred Drake4856d011999-01-12 04:15:20 +0000565\withsubitem{(method attribute)}{
Fred Drake35c09f22000-06-28 20:15:47 +0000566 \ttindex{im_class}\ttindex{im_func}\ttindex{im_self}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000567
568When an unbound user-defined method object is called, the underlying
Fred Drake82385871998-10-01 20:40:43 +0000569function (\member{im_func}) is called, with the restriction that the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000570first argument must be an instance of the proper class
Fred Drake82385871998-10-01 20:40:43 +0000571(\member{im_class}) or of a derived class thereof.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000572
573When a bound user-defined method object is called, the underlying
Fred Drake82385871998-10-01 20:40:43 +0000574function (\member{im_func}) is called, inserting the class instance
575(\member{im_self}) in front of the argument list. For instance, when
576\class{C} is a class which contains a definition for a function
577\method{f()}, and \code{x} is an instance of \class{C}, calling
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000578\code{x.f(1)} is equivalent to calling \code{C.f(x, 1)}.
579
Fred Drakeea690c42003-07-17 05:26:53 +0000580When a user-defined method object is derived from a class method object,
581the ``class instance'' stored in \member{im_self} will actually be the
582class itself, so that calling either \code{x.f(1)} or \code{C.f(1)} is
583equivalent to calling \code{f(C,1)} where \code{f} is the underlying
584function.
585
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000586Note that the transformation from function object to (unbound or
587bound) method object happens each time the attribute is retrieved from
588the class or instance. In some cases, a fruitful optimization is to
589assign the attribute to a local variable and call that local variable.
590Also notice that this transformation only happens for user-defined
591functions; other callable objects (and all non-callable objects) are
Fred Drake35c09f22000-06-28 20:15:47 +0000592retrieved without transformation. It is also important to note that
593user-defined functions which are attributes of a class instance are
594not converted to bound methods; this \emph{only} happens when the
595function is an attribute of the class.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000596
Fred Drakee31e9ce2001-12-11 21:10:08 +0000597\item[Generator functions\index{generator!function}\index{generator!iterator}]
598A function or method which uses the \keyword{yield} statement (see
599section~\ref{yield}, ``The \keyword{yield} statement'') is called a
600\dfn{generator function}. Such a function, when called, always
601returns an iterator object which can be used to execute the body of
602the function: calling the iterator's \method{next()} method will
603cause the function to execute until it provides a value using the
604\keyword{yield} statement. When the function executes a
605\keyword{return} statement or falls off the end, a
606\exception{StopIteration} exception is raised and the iterator will
607have reached the end of the set of values to be returned.
608
Fred Drakef6669171998-05-06 19:52:49 +0000609\item[Built-in functions]
Georg Brandl1c330eb2005-07-02 10:27:31 +0000610A built-in function object is a wrapper around a C function. Examples
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000611of built-in functions are \function{len()} and \function{math.sin()}
612(\module{math} is a standard built-in module).
613The number and type of the arguments are
Fred Drakef6669171998-05-06 19:52:49 +0000614determined by the C function.
Fred Drake82385871998-10-01 20:40:43 +0000615Special read-only attributes: \member{__doc__} is the function's
616documentation string, or \code{None} if unavailable; \member{__name__}
617is the function's name; \member{__self__} is set to \code{None} (but see
Jeremy Hyltonf9b0cc72003-01-31 18:52:45 +0000618the next item); \member{__module__} is the name of the module the
619function was defined in or \code{None} if unavailable.
Fred Drakef6669171998-05-06 19:52:49 +0000620\obindex{built-in function}
621\obindex{function}
622\indexii{C}{language}
623
624\item[Built-in methods]
625This is really a different disguise of a built-in function, this time
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000626containing an object passed to the C function as an implicit extra
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000627argument. An example of a built-in method is
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000628\code{\var{alist}.append()}, assuming
629\var{alist} is a list object.
Fred Drake82385871998-10-01 20:40:43 +0000630In this case, the special read-only attribute \member{__self__} is set
Fred Drakee31e9ce2001-12-11 21:10:08 +0000631to the object denoted by \var{list}.
Fred Drakef6669171998-05-06 19:52:49 +0000632\obindex{built-in method}
633\obindex{method}
634\indexii{built-in}{method}
635
Fred Drakee37b4ed2003-07-15 20:45:16 +0000636\item[Class Types]
637Class types, or ``new-style classes,'' are callable. These objects
638normally act as factories for new instances of themselves, but
639variations are possible for class types that override
640\method{__new__()}. The arguments of the call are passed to
641\method{__new__()} and, in the typical case, to \method{__init__()} to
642initialize the new instance.
643
644\item[Classic Classes]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000645Class objects are described below. When a class object is called,
646a new class instance (also described below) is created and
Fred Drakef6669171998-05-06 19:52:49 +0000647returned. This implies a call to the class's \method{__init__()} method
648if it has one. Any arguments are passed on to the \method{__init__()}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000649method. If there is no \method{__init__()} method, the class must be called
Fred Drakef6669171998-05-06 19:52:49 +0000650without arguments.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000651\withsubitem{(object method)}{\ttindex{__init__()}}
Fred Drakef6669171998-05-06 19:52:49 +0000652\obindex{class}
653\obindex{class instance}
654\obindex{instance}
655\indexii{class object}{call}
656
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000657\item[Class instances]
658Class instances are described below. Class instances are callable
Fred Drake82385871998-10-01 20:40:43 +0000659only when the class has a \method{__call__()} method; \code{x(arguments)}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000660is a shorthand for \code{x.__call__(arguments)}.
661
Fred Drakef6669171998-05-06 19:52:49 +0000662\end{description}
663
664\item[Modules]
Fred Drake62364ff2003-03-20 18:17:16 +0000665Modules are imported by the \keyword{import} statement (see
Fred Draked51ce7d2003-07-15 22:03:00 +0000666section~\ref{import}, ``The \keyword{import} statement'').%
667\stindex{import}\obindex{module}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000668A module object has a namespace implemented by a dictionary object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000669(this is the dictionary referenced by the func_globals attribute of
670functions defined in the module). Attribute references are translated
671to lookups in this dictionary, e.g., \code{m.x} is equivalent to
672\code{m.__dict__["x"]}.
673A module object does not contain the code object used to
Fred Drakef6669171998-05-06 19:52:49 +0000674initialize the module (since it isn't needed once the initialization
675is done).
Fred Drakef6669171998-05-06 19:52:49 +0000676
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000677Attribute assignment updates the module's namespace dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000678e.g., \samp{m.x = 1} is equivalent to \samp{m.__dict__["x"] = 1}.
Fred Drakef6669171998-05-06 19:52:49 +0000679
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000680Special read-only attribute: \member{__dict__} is the module's
681namespace as a dictionary object.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000682\withsubitem{(module attribute)}{\ttindex{__dict__}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000683
684Predefined (writable) attributes: \member{__name__}
685is the module's name; \member{__doc__} is the
686module's documentation string, or
Fred Drake82385871998-10-01 20:40:43 +0000687\code{None} if unavailable; \member{__file__} is the pathname of the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000688file from which the module was loaded, if it was loaded from a file.
Fred Drake82385871998-10-01 20:40:43 +0000689The \member{__file__} attribute is not present for C{} modules that are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000690statically linked into the interpreter; for extension modules loaded
691dynamically from a shared library, it is the pathname of the shared
692library file.
Fred Drake4856d011999-01-12 04:15:20 +0000693\withsubitem{(module attribute)}{
694 \ttindex{__name__}
695 \ttindex{__doc__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000696 \ttindex{__file__}}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000697\indexii{module}{namespace}
Fred Drakef6669171998-05-06 19:52:49 +0000698
699\item[Classes]
Fred Drake62364ff2003-03-20 18:17:16 +0000700Class objects are created by class definitions (see
701section~\ref{class}, ``Class definitions'').
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000702A class has a namespace implemented by a dictionary object.
703Class attribute references are translated to
704lookups in this dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000705e.g., \samp{C.x} is translated to \samp{C.__dict__["x"]}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000706When the attribute name is not found
Fred Drakef6669171998-05-06 19:52:49 +0000707there, the attribute search continues in the base classes. The search
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000708is depth-first, left-to-right in the order of occurrence in the
Fred Drakef6669171998-05-06 19:52:49 +0000709base class list.
Fred Drakeea690c42003-07-17 05:26:53 +0000710
711When a class attribute reference (for class \class{C}, say)
712would yield a user-defined function object or
713an unbound user-defined method object whose associated class is either
714\class{C} or one of its base classes, it is transformed into an unbound
715user-defined method object whose \member{im_class} attribute is~\class{C}.
716When it would yield a class method object, it is transformed into
717a bound user-defined method object whose \member{im_class} and
718\member{im_self} attributes are both~\class{C}. When it would yield
719a static method object, it is transformed into the object wrapped
720by the static method object. See section~\ref{descriptors} for another
721way in which attributes retrieved from a class may differ from those
722actually contained in its \member{__dict__}.
Fred Drakef6669171998-05-06 19:52:49 +0000723\obindex{class}
724\obindex{class instance}
725\obindex{instance}
726\indexii{class object}{call}
727\index{container}
728\obindex{dictionary}
729\indexii{class}{attribute}
730
731Class attribute assignments update the class's dictionary, never the
732dictionary of a base class.
733\indexiii{class}{attribute}{assignment}
734
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000735A class object can be called (see above) to yield a class instance (see
736below).
Fred Drakef6669171998-05-06 19:52:49 +0000737\indexii{class object}{call}
738
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000739Special attributes: \member{__name__} is the class name;
740\member{__module__} is the module name in which the class was defined;
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000741\member{__dict__} is the dictionary containing the class's namespace;
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000742\member{__bases__} is a tuple (possibly empty or a singleton)
743containing the base classes, in the order of their occurrence in the
Fred Drake82385871998-10-01 20:40:43 +0000744base class list; \member{__doc__} is the class's documentation string,
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000745or None if undefined.
Fred Drake4856d011999-01-12 04:15:20 +0000746\withsubitem{(class attribute)}{
747 \ttindex{__name__}
748 \ttindex{__module__}
749 \ttindex{__dict__}
750 \ttindex{__bases__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000751 \ttindex{__doc__}}
Fred Drakef6669171998-05-06 19:52:49 +0000752
753\item[Class instances]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000754A class instance is created by calling a class object (see above).
755A class instance has a namespace implemented as a dictionary which
756is the first place in which
Fred Drakef6669171998-05-06 19:52:49 +0000757attribute references are searched. When an attribute is not found
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000758there, and the instance's class has an attribute by that name,
759the search continues with the class attributes. If a class attribute
Fred Drakeea690c42003-07-17 05:26:53 +0000760is found that is a user-defined function object or an unbound
761user-defined method object whose associated class is the class
762(call it~\class{C}) of the instance for which the attribute reference
763was initiated or one of its bases,
764it is transformed into a bound user-defined method object whose
765\member{im_class} attribute is~\class{C} whose \member{im_self} attribute
766is the instance. Static method and class method objects are also
767transformed, as if they had been retrieved from class~\class{C};
768see above under ``Classes''. See section~\ref{descriptors} for
769another way in which attributes of a class retrieved via its
770instances may differ from the objects actually stored in the
771class's \member{__dict__}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000772If no class attribute is found, and the object's class has a
Fred Drake82385871998-10-01 20:40:43 +0000773\method{__getattr__()} method, that is called to satisfy the lookup.
Fred Drakef6669171998-05-06 19:52:49 +0000774\obindex{class instance}
775\obindex{instance}
776\indexii{class}{instance}
777\indexii{class instance}{attribute}
778
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000779Attribute assignments and deletions update the instance's dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000780never a class's dictionary. If the class has a \method{__setattr__()} or
781\method{__delattr__()} method, this is called instead of updating the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000782instance dictionary directly.
Fred Drakef6669171998-05-06 19:52:49 +0000783\indexiii{class instance}{attribute}{assignment}
784
785Class instances can pretend to be numbers, sequences, or mappings if
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000786they have methods with certain special names. See
Fred Drake62364ff2003-03-20 18:17:16 +0000787section~\ref{specialnames}, ``Special method names.''
Fred Drakee15956b2000-04-03 04:51:13 +0000788\obindex{numeric}
Fred Drakef6669171998-05-06 19:52:49 +0000789\obindex{sequence}
790\obindex{mapping}
791
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000792Special attributes: \member{__dict__} is the attribute
793dictionary; \member{__class__} is the instance's class.
Fred Drake4856d011999-01-12 04:15:20 +0000794\withsubitem{(instance attribute)}{
795 \ttindex{__dict__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000796 \ttindex{__class__}}
Fred Drakef6669171998-05-06 19:52:49 +0000797
798\item[Files]
Fred Drakee15eb351999-11-10 16:13:25 +0000799A file\obindex{file} object represents an open file. File objects are
800created by the \function{open()}\bifuncindex{open} built-in function,
801and also by
802\withsubitem{(in module os)}{\ttindex{popen()}}\function{os.popen()},
803\function{os.fdopen()}, and the
804\method{makefile()}\withsubitem{(socket method)}{\ttindex{makefile()}}
805method of socket objects (and perhaps by other functions or methods
806provided by extension modules). The objects
807\ttindex{sys.stdin}\code{sys.stdin},
808\ttindex{sys.stdout}\code{sys.stdout} and
809\ttindex{sys.stderr}\code{sys.stderr} are initialized to file objects
810corresponding to the interpreter's standard\index{stdio} input, output
811and error streams. See the \citetitle[../lib/lib.html]{Python Library
812Reference} for complete documentation of file objects.
Fred Drake4856d011999-01-12 04:15:20 +0000813\withsubitem{(in module sys)}{
814 \ttindex{stdin}
815 \ttindex{stdout}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000816 \ttindex{stderr}}
Fred Drakee15eb351999-11-10 16:13:25 +0000817
Fred Drakef6669171998-05-06 19:52:49 +0000818
819\item[Internal types]
820A few types used internally by the interpreter are exposed to the user.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000821Their definitions may change with future versions of the interpreter,
Fred Drakef6669171998-05-06 19:52:49 +0000822but they are mentioned here for completeness.
823\index{internal type}
824\index{types, internal}
825
826\begin{description}
827
828\item[Code objects]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000829Code objects represent \emph{byte-compiled} executable Python code, or
830\emph{bytecode}.
Fred Drakef6669171998-05-06 19:52:49 +0000831The difference between a code
832object and a function object is that the function object contains an
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000833explicit reference to the function's globals (the module in which it
834was defined), while a code object contains no context;
835also the default argument values are stored in the function object,
836not in the code object (because they represent values calculated at
837run-time). Unlike function objects, code objects are immutable and
838contain no references (directly or indirectly) to mutable objects.
839\index{bytecode}
Fred Drakef6669171998-05-06 19:52:49 +0000840\obindex{code}
841
Fred Drake1e42d8a1998-11-25 17:58:50 +0000842Special read-only attributes: \member{co_name} gives the function
843name; \member{co_argcount} is the number of positional arguments
844(including arguments with default values); \member{co_nlocals} is the
845number of local variables used by the function (including arguments);
846\member{co_varnames} is a tuple containing the names of the local
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000847variables (starting with the argument names); \member{co_cellvars} is
848a tuple containing the names of local variables that are referenced by
849nested functions; \member{co_freevars} is a tuple containing the names
Jeremy Hylton8392f362002-04-01 18:53:36 +0000850of free variables; \member{co_code} is a string representing the
851sequence of bytecode instructions;
Fred Drake1e42d8a1998-11-25 17:58:50 +0000852\member{co_consts} is a tuple containing the literals used by the
853bytecode; \member{co_names} is a tuple containing the names used by
854the bytecode; \member{co_filename} is the filename from which the code
855was compiled; \member{co_firstlineno} is the first line number of the
856function; \member{co_lnotab} is a string encoding the mapping from
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000857byte code offsets to line numbers (for details see the source code of
Fred Drake1e42d8a1998-11-25 17:58:50 +0000858the interpreter); \member{co_stacksize} is the required stack size
859(including local variables); \member{co_flags} is an integer encoding
860a number of flags for the interpreter.
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000861
Fred Drake4856d011999-01-12 04:15:20 +0000862\withsubitem{(code object attribute)}{
863 \ttindex{co_argcount}
864 \ttindex{co_code}
865 \ttindex{co_consts}
866 \ttindex{co_filename}
867 \ttindex{co_firstlineno}
868 \ttindex{co_flags}
869 \ttindex{co_lnotab}
870 \ttindex{co_name}
871 \ttindex{co_names}
872 \ttindex{co_nlocals}
873 \ttindex{co_stacksize}
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000874 \ttindex{co_varnames}
875 \ttindex{co_cellvars}
876 \ttindex{co_freevars}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000877
Fred Drakee15956b2000-04-03 04:51:13 +0000878The following flag bits are defined for \member{co_flags}: bit
879\code{0x04} is set if the function uses the \samp{*arguments} syntax
880to accept an arbitrary number of positional arguments; bit
881\code{0x08} is set if the function uses the \samp{**keywords} syntax
Jeremy Hylton8392f362002-04-01 18:53:36 +0000882to accept arbitrary keyword arguments; bit \code{0x20} is set if the
Brett Cannon9e6fedd2003-06-15 22:57:44 +0000883function is a generator.
884\obindex{generator}
Jeremy Hylton8392f362002-04-01 18:53:36 +0000885
886Future feature declarations (\samp{from __future__ import division})
887also use bits in \member{co_flags} to indicate whether a code object
888was compiled with a particular feature enabled: bit \code{0x2000} is
889set if the function was compiled with future division enabled; bits
890\code{0x10} and \code{0x1000} were used in earlier versions of Python.
891
892Other bits in \member{co_flags} are reserved for internal use.
893
894If\index{documentation string} a code object represents a function,
895the first item in
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000896\member{co_consts} is the documentation string of the function, or
897\code{None} if undefined.
Fred Drakef6669171998-05-06 19:52:49 +0000898
899\item[Frame objects]
900Frame objects represent execution frames. They may occur in traceback
901objects (see below).
902\obindex{frame}
903
904Special read-only attributes: \member{f_back} is to the previous
905stack frame (towards the caller), or \code{None} if this is the bottom
906stack frame; \member{f_code} is the code object being executed in this
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000907frame; \member{f_locals} is the dictionary used to look up local
908variables; \member{f_globals} is used for global variables;
Fred Drake82385871998-10-01 20:40:43 +0000909\member{f_builtins} is used for built-in (intrinsic) names;
910\member{f_restricted} is a flag indicating whether the function is
Michael W. Hudsoncfd38842002-12-17 16:15:34 +0000911executing in restricted execution mode; \member{f_lasti} gives the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000912precise instruction (this is an index into the bytecode string of
Fred Drakef6669171998-05-06 19:52:49 +0000913the code object).
Fred Drake4856d011999-01-12 04:15:20 +0000914\withsubitem{(frame attribute)}{
915 \ttindex{f_back}
916 \ttindex{f_code}
917 \ttindex{f_globals}
918 \ttindex{f_locals}
Fred Drake4856d011999-01-12 04:15:20 +0000919 \ttindex{f_lasti}
920 \ttindex{f_builtins}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000921 \ttindex{f_restricted}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000922
Georg Brandl1c330eb2005-07-02 10:27:31 +0000923Special writable attributes: \member{f_trace}, if not \code{None}, is
924a function called at the start of each source code line (this is used
925by the debugger); \member{f_exc_type}, \member{f_exc_value},
926\member{f_exc_traceback} represent the last exception raised in the
927parent frame provided another exception was ever raised in the current
928frame (in all other cases they are None); \member{f_lineno} is the
929current line number of the frame --- writing to this from within a
930trace function jumps to the given line (only for the bottom-most
931frame). A debugger can implement a Jump command (aka Set Next
932Statement) by writing to f_lineno.
Fred Drake4856d011999-01-12 04:15:20 +0000933\withsubitem{(frame attribute)}{
934 \ttindex{f_trace}
935 \ttindex{f_exc_type}
936 \ttindex{f_exc_value}
Michael W. Hudsoncfd38842002-12-17 16:15:34 +0000937 \ttindex{f_exc_traceback}
938 \ttindex{f_lineno}}
Fred Drakef6669171998-05-06 19:52:49 +0000939
940\item[Traceback objects] \label{traceback}
941Traceback objects represent a stack trace of an exception. A
942traceback object is created when an exception occurs. When the search
943for an exception handler unwinds the execution stack, at each unwound
944level a traceback object is inserted in front of the current
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000945traceback. When an exception handler is entered, the stack trace is
946made available to the program.
Fred Drake62364ff2003-03-20 18:17:16 +0000947(See section~\ref{try}, ``The \code{try} statement.'')
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000948It is accessible as \code{sys.exc_traceback}, and also as the third
949item of the tuple returned by \code{sys.exc_info()}. The latter is
950the preferred interface, since it works correctly when the program is
951using multiple threads.
952When the program contains no suitable handler, the stack trace is written
Fred Drakef6669171998-05-06 19:52:49 +0000953(nicely formatted) to the standard error stream; if the interpreter is
954interactive, it is also made available to the user as
955\code{sys.last_traceback}.
956\obindex{traceback}
957\indexii{stack}{trace}
958\indexii{exception}{handler}
959\indexii{execution}{stack}
Fred Drake4856d011999-01-12 04:15:20 +0000960\withsubitem{(in module sys)}{
961 \ttindex{exc_info}
962 \ttindex{exc_traceback}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000963 \ttindex{last_traceback}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000964\ttindex{sys.exc_info}
Fred Drakef6669171998-05-06 19:52:49 +0000965\ttindex{sys.exc_traceback}
966\ttindex{sys.last_traceback}
967
968Special read-only attributes: \member{tb_next} is the next level in the
969stack trace (towards the frame where the exception occurred), or
970\code{None} if there is no next level; \member{tb_frame} points to the
971execution frame of the current level; \member{tb_lineno} gives the line
972number where the exception occurred; \member{tb_lasti} indicates the
973precise instruction. The line number and last instruction in the
974traceback may differ from the line number of its frame object if the
975exception occurred in a \keyword{try} statement with no matching
976except clause or with a finally clause.
Fred Drake4856d011999-01-12 04:15:20 +0000977\withsubitem{(traceback attribute)}{
978 \ttindex{tb_next}
979 \ttindex{tb_frame}
980 \ttindex{tb_lineno}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000981 \ttindex{tb_lasti}}
Fred Drakef6669171998-05-06 19:52:49 +0000982\stindex{try}
983
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000984\item[Slice objects]
985Slice objects are used to represent slices when \emph{extended slice
986syntax} is used. This is a slice using two colons, or multiple slices
987or ellipses separated by commas, e.g., \code{a[i:j:step]}, \code{a[i:j,
Raymond Hettinger03ec6d52003-06-25 18:29:36 +0000988k:l]}, or \code{a[..., i:j]}. They are also created by the built-in
Fred Drake1e42d8a1998-11-25 17:58:50 +0000989\function{slice()}\bifuncindex{slice} function.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000990
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000991Special read-only attributes: \member{start} is the lower bound;
992\member{stop} is the upper bound; \member{step} is the step value; each is
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000993\code{None} if omitted. These attributes can have any type.
Fred Drake4856d011999-01-12 04:15:20 +0000994\withsubitem{(slice object attribute)}{
995 \ttindex{start}
996 \ttindex{stop}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000997 \ttindex{step}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000998
Fred Drake5ec22f22002-09-24 21:09:13 +0000999Slice objects support one method:
1000
1001\begin{methoddesc}[slice]{indices}{self, length}
1002This method takes a single integer argument \var{length} and computes
1003information about the extended slice that the slice object would
1004describe if applied to a sequence of \var{length} items. It returns a
1005tuple of three integers; respectively these are the \var{start} and
1006\var{stop} indices and the \var{step} or stride length of the slice.
1007Missing or out-of-bounds indices are handled in a manner consistent
1008with regular slices.
Michael W. Hudsonf0d777c2002-07-19 15:47:06 +00001009\versionadded{2.3}
Fred Drake5ec22f22002-09-24 21:09:13 +00001010\end{methoddesc}
Michael W. Hudsonf0d777c2002-07-19 15:47:06 +00001011
Fred Drakeea690c42003-07-17 05:26:53 +00001012\item[Static method objects]
1013Static method objects provide a way of defeating the transformation
1014of function objects to method objects described above. A static method
1015object is a wrapper around any other object, usually a user-defined
1016method object. When a static method object is retrieved from a class
1017or a class instance, the object actually returned is the wrapped object,
1018which is not subject to any further transformation. Static method
1019objects are not themselves callable, although the objects they
1020wrap usually are. Static method objects are created by the built-in
1021\function{staticmethod()} constructor.
1022
1023\item[Class method objects]
1024A class method object, like a static method object, is a wrapper
1025around another object that alters the way in which that object
1026is retrieved from classes and class instances. The behaviour of
1027class method objects upon such retrieval is described above,
1028under ``User-defined methods''. Class method objects are created
1029by the built-in \function{classmethod()} constructor.
1030
Fred Drakef6669171998-05-06 19:52:49 +00001031\end{description} % Internal types
1032
1033\end{description} % Types
1034
Andrew M. Kuchling6af52392005-12-04 16:07:15 +00001035%=========================================================================
1036\section{New-style and classic classes}
Fred Drakef6669171998-05-06 19:52:49 +00001037
Andrew M. Kuchling6af52392005-12-04 16:07:15 +00001038Classes and instances come in two flavours: old-style or classic, and new-style.
1039
Armin Rigoddddd2f2005-12-26 18:06:17 +00001040Up to Python 2.1, old-style classes were the only flavour available to the
1041user. The concept of (old-style) class is unrelated to the concept of type: if
1042\var{x} is an instance of an old-style class, then \code{x.__class__}
1043designates the class of \var{x}, but \code{type(x)} is always \code{<type
1044'instance'>}. This reflects the fact that all old-style instances,
1045independently of their class, are implemented with a single built-in type,
1046called \code{instance}.
Andrew M. Kuchling6af52392005-12-04 16:07:15 +00001047
Armin Rigoddddd2f2005-12-26 18:06:17 +00001048New-style classes were introduced in Python 2.2 to unify classes and types. A
1049new-style class neither more nor less than a user-defined type. If \var{x} is
1050an instance of a new-style class, then \code{type(x)} is the same as
1051\code{x.__class__}.
1052
1053The major motivation for introducing new-style classes is to provide a unified
1054object model with a full meta-model. It also has a number of immediate
1055benefits, like the ability to subclass most built-in types, or the introduction
1056of "descriptors", which enable computed properties.
1057
1058For compatibility reasons, classes are still old-style by default. New-style
1059classes are created by specifying another new-style class (i.e.\ a type) as a
1060parent class, or the "top-level type" \class{object} if no other parent is
1061needed. The behaviour of new-style classes differs from that of old-style
1062classes in a number of important details in addition to what \function{type}
1063returns. Some of these changes are fundamental to the new object model, like
1064the way special methods are invoked. Others are "fixes" that could not be
1065implemented before for compatibility concerns, like the method resolution order
1066in case of multiple inheritance.
1067
1068This manuel is not up-to-date with respect to new-style classes. For now,
1069please see \url{http://www.python.org/doc/newstyle.html} for more information.
Andrew M. Kuchling6af52392005-12-04 16:07:15 +00001070
1071The plan is to eventually drop old-style classes, leaving only the semantics of new-style classes. This change will probably only be feasible in Python 3.0.
1072
Andrew M. Kuchling6af52392005-12-04 16:07:15 +00001073%=========================================================================
Fred Drake61c77281998-07-28 19:34:22 +00001074\section{Special method names\label{specialnames}}
Fred Drakef6669171998-05-06 19:52:49 +00001075
1076A class can implement certain operations that are invoked by special
Fred Draked82575d1998-08-28 20:03:12 +00001077syntax (such as arithmetic operations or subscripting and slicing) by
Fred Drake7af9f4d2003-05-12 13:50:11 +00001078defining methods with special names.\indexii{operator}{overloading}
1079This is Python's approach to \dfn{operator overloading}, allowing
1080classes to define their own behavior with respect to language
1081operators. For instance, if a class defines
Fred Draked82575d1998-08-28 20:03:12 +00001082a method named \method{__getitem__()}, and \code{x} is an instance of
Armin Rigoddddd2f2005-12-26 18:06:17 +00001083this class, then \code{x[i]} is equivalent\footnote{This, and other
1084statements, are only roughly true for instances of new-style
1085classes.} to
Raymond Hettinger94153092002-05-12 03:09:25 +00001086\code{x.__getitem__(i)}. Except where mentioned, attempts to execute
1087an operation raise an exception when no appropriate method is defined.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001088\withsubitem{(mapping object method)}{\ttindex{__getitem__()}}
Fred Drakef6669171998-05-06 19:52:49 +00001089
Fred Drake0c475592000-12-07 04:49:34 +00001090When implementing a class that emulates any built-in type, it is
1091important that the emulation only be implemented to the degree that it
1092makes sense for the object being modelled. For example, some
1093sequences may work well with retrieval of individual elements, but
1094extracting a slice may not make sense. (One example of this is the
1095\class{NodeList} interface in the W3C's Document Object Model.)
1096
Fred Drakef6669171998-05-06 19:52:49 +00001097
Fred Drake61c77281998-07-28 19:34:22 +00001098\subsection{Basic customization\label{customization}}
Fred Drakef6669171998-05-06 19:52:49 +00001099
Greg Wardff564d32005-03-08 01:10:20 +00001100\begin{methoddesc}[object]{__new__}{cls\optional{, \moreargs}}
1101Called to create a new instance of class \var{cls}. \method{__new__()}
Georg Brandl15ad9352005-08-26 12:56:22 +00001102is a static method (special-cased so you need not declare it as such)
Greg Wardff564d32005-03-08 01:10:20 +00001103that takes the class of which an instance was requested as its first
1104argument. The remaining arguments are those passed to the object
1105constructor expression (the call to the class). The return value of
1106\method{__new__()} should be the new object instance (usually an
1107instance of \var{cls}).
1108
1109Typical implementations create a new instance of the class by invoking
1110the superclass's \method{__new__()} method using
1111\samp{super(\var{currentclass}, \var{cls}).__new__(\var{cls}[, ...])}
1112with appropriate arguments and then modifying the newly-created instance
1113as necessary before returning it.
1114
1115If \method{__new__()} returns an instance of \var{cls}, then the new
1116instance's \method{__init__()} method will be invoked like
1117\samp{__init__(\var{self}[, ...])}, where \var{self} is the new instance
1118and the remaining arguments are the same as were passed to
1119\method{__new__()}.
1120
1121If \method{__new__()} does not return an instance of \var{cls}, then the
1122new instance's \method{__init__()} method will not be invoked.
1123
1124\method{__new__()} is intended mainly to allow subclasses of
1125immutable types (like int, str, or tuple) to customize instance
1126creation.
1127\end{methoddesc}
1128
Fred Drake044bb4d2001-08-02 15:53:05 +00001129\begin{methoddesc}[object]{__init__}{self\optional{, \moreargs}}
1130Called\indexii{class}{constructor} when the instance is created. The
1131arguments are those passed to the class constructor expression. If a
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001132base class has an \method{__init__()} method, the derived class's
1133\method{__init__()} method, if any, must explicitly call it to ensure proper
Fred Drake044bb4d2001-08-02 15:53:05 +00001134initialization of the base class part of the instance; for example:
1135\samp{BaseClass.__init__(\var{self}, [\var{args}...])}. As a special
Martin v. Löwis95cf84a2003-10-19 07:32:24 +00001136constraint on constructors, no value may be returned; doing so will
Fred Drake044bb4d2001-08-02 15:53:05 +00001137cause a \exception{TypeError} to be raised at runtime.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001138\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001139
1140
Fred Drake1e42d8a1998-11-25 17:58:50 +00001141\begin{methoddesc}[object]{__del__}{self}
Guido van Rossum7c0240f1998-07-24 15:36:43 +00001142Called when the instance is about to be destroyed. This is also
1143called a destructor\index{destructor}. If a base class
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001144has a \method{__del__()} method, the derived class's \method{__del__()}
1145method, if any,
Fred Drakef6669171998-05-06 19:52:49 +00001146must explicitly call it to ensure proper deletion of the base class
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001147part of the instance. Note that it is possible (though not recommended!)
1148for the \method{__del__()}
Fred Drakef6669171998-05-06 19:52:49 +00001149method to postpone destruction of the instance by creating a new
1150reference to it. It may then be called at a later time when this new
1151reference is deleted. It is not guaranteed that
1152\method{__del__()} methods are called for objects that still exist when
1153the interpreter exits.
Fred Drakef6669171998-05-06 19:52:49 +00001154\stindex{del}
1155
Fred Drake591dd8f2001-12-14 22:52:41 +00001156\begin{notice}
1157\samp{del x} doesn't directly call
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001158\code{x.__del__()} --- the former decrements the reference count for
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001159\code{x} by one, and the latter is only called when \code{x}'s reference
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001160count reaches zero. Some common situations that may prevent the
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001161reference count of an object from going to zero include: circular
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001162references between objects (e.g., a doubly-linked list or a tree data
1163structure with parent and child pointers); a reference to the object
1164on the stack frame of a function that caught an exception (the
1165traceback stored in \code{sys.exc_traceback} keeps the stack frame
1166alive); or a reference to the object on the stack frame that raised an
1167unhandled exception in interactive mode (the traceback stored in
1168\code{sys.last_traceback} keeps the stack frame alive). The first
1169situation can only be remedied by explicitly breaking the cycles; the
Fred Drake591dd8f2001-12-14 22:52:41 +00001170latter two situations can be resolved by storing \code{None} in
1171\code{sys.exc_traceback} or \code{sys.last_traceback}. Circular
1172references which are garbage are detected when the option cycle
1173detector is enabled (it's on by default), but can only be cleaned up
1174if there are no Python-level \method{__del__()} methods involved.
1175Refer to the documentation for the \ulink{\module{gc}
1176module}{../lib/module-gc.html} for more information about how
1177\method{__del__()} methods are handled by the cycle detector,
1178particularly the description of the \code{garbage} value.
1179\end{notice}
Fred Drakef6669171998-05-06 19:52:49 +00001180
Fred Drake591dd8f2001-12-14 22:52:41 +00001181\begin{notice}[warning]
1182Due to the precarious circumstances under which
Fred Draked82575d1998-08-28 20:03:12 +00001183\method{__del__()} methods are invoked, exceptions that occur during their
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001184execution are ignored, and a warning is printed to \code{sys.stderr}
Fred Drake591dd8f2001-12-14 22:52:41 +00001185instead. Also, when \method{__del__()} is invoked in response to a module
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001186being deleted (e.g., when execution of the program is done), other
Fred Draked82575d1998-08-28 20:03:12 +00001187globals referenced by the \method{__del__()} method may already have been
1188deleted. For this reason, \method{__del__()} methods should do the
Raymond Hettingera0e4d6c2002-09-08 21:10:54 +00001189absolute minimum needed to maintain external invariants. Starting with
1190version 1.5, Python guarantees that globals whose name begins with a single
1191underscore are deleted from their module before other globals are deleted;
1192if no other references to such globals exist, this may help in assuring that
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001193imported modules are still available at the time when the
Fred Drake591dd8f2001-12-14 22:52:41 +00001194\method{__del__()} method is called.
1195\end{notice}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001196\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001197
Fred Drake1e42d8a1998-11-25 17:58:50 +00001198\begin{methoddesc}[object]{__repr__}{self}
Fred Drake82385871998-10-01 20:40:43 +00001199Called by the \function{repr()}\bifuncindex{repr} built-in function
1200and by string conversions (reverse quotes) to compute the ``official''
Andrew M. Kuchling68abe832000-12-19 14:09:21 +00001201string representation of an object. If at all possible, this should
Guido van Rossum035f7e82000-12-19 04:18:13 +00001202look like a valid Python expression that could be used to recreate an
1203object with the same value (given an appropriate environment). If
1204this is not possible, a string of the form \samp{<\var{...some useful
1205description...}>} should be returned. The return value must be a
1206string object.
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001207If a class defines \method{__repr__()} but not \method{__str__()},
1208then \method{__repr__()} is also used when an ``informal'' string
1209representation of instances of that class is required.
Guido van Rossum035f7e82000-12-19 04:18:13 +00001210
1211This is typically used for debugging, so it is important that the
1212representation is information-rich and unambiguous.
Fred Drakef6669171998-05-06 19:52:49 +00001213\indexii{string}{conversion}
1214\indexii{reverse}{quotes}
1215\indexii{backward}{quotes}
1216\index{back-quotes}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001217\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001218
Fred Drake1e42d8a1998-11-25 17:58:50 +00001219\begin{methoddesc}[object]{__str__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001220Called by the \function{str()}\bifuncindex{str} built-in function and
1221by the \keyword{print}\stindex{print} statement to compute the
Fred Drake82385871998-10-01 20:40:43 +00001222``informal'' string representation of an object. This differs from
1223\method{__repr__()} in that it does not have to be a valid Python
1224expression: a more convenient or concise representation may be used
Guido van Rossum035f7e82000-12-19 04:18:13 +00001225instead. The return value must be a string object.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001226\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001227
Guido van Rossumab782dd2001-01-18 15:17:06 +00001228\begin{methoddesc}[object]{__lt__}{self, other}
1229\methodline[object]{__le__}{self, other}
1230\methodline[object]{__eq__}{self, other}
1231\methodline[object]{__ne__}{self, other}
1232\methodline[object]{__gt__}{self, other}
1233\methodline[object]{__ge__}{self, other}
1234\versionadded{2.1}
1235These are the so-called ``rich comparison'' methods, and are called
1236for comparison operators in preference to \method{__cmp__()} below.
1237The correspondence between operator symbols and method names is as
1238follows:
1239\code{\var{x}<\var{y}} calls \code{\var{x}.__lt__(\var{y})},
1240\code{\var{x}<=\var{y}} calls \code{\var{x}.__le__(\var{y})},
1241\code{\var{x}==\var{y}} calls \code{\var{x}.__eq__(\var{y})},
1242\code{\var{x}!=\var{y}} and \code{\var{x}<>\var{y}} call
1243\code{\var{x}.__ne__(\var{y})},
1244\code{\var{x}>\var{y}} calls \code{\var{x}.__gt__(\var{y})}, and
1245\code{\var{x}>=\var{y}} calls \code{\var{x}.__ge__(\var{y})}.
1246These methods can return any value, but if the comparison operator is
1247used in a Boolean context, the return value should be interpretable as
1248a Boolean value, else a \exception{TypeError} will be raised.
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001249By convention, \code{False} is used for false and \code{True} for true.
Guido van Rossumab782dd2001-01-18 15:17:06 +00001250
Raymond Hettinger4d6e8fe2003-07-16 19:40:23 +00001251There are no implied relationships among the comparison operators.
Raymond Hettinger943277e2003-07-17 14:47:12 +00001252The truth of \code{\var{x}==\var{y}} does not imply that \code{\var{x}!=\var{y}}
Fred Drakeb3dfc0a2005-09-07 04:57:56 +00001253is false. Accordingly, when defining \method{__eq__()}, one should also
1254define \method{__ne__()} so that the operators will behave as expected.
Raymond Hettinger4d6e8fe2003-07-16 19:40:23 +00001255
Guido van Rossumab782dd2001-01-18 15:17:06 +00001256There are no reflected (swapped-argument) versions of these methods
1257(to be used when the left argument does not support the operation but
1258the right argument does); rather, \method{__lt__()} and
1259\method{__gt__()} are each other's reflection, \method{__le__()} and
1260\method{__ge__()} are each other's reflection, and \method{__eq__()}
1261and \method{__ne__()} are their own reflection.
1262
1263Arguments to rich comparison methods are never coerced. A rich
1264comparison method may return \code{NotImplemented} if it does not
1265implement the operation for a given pair of arguments.
1266\end{methoddesc}
1267
Fred Drake1e42d8a1998-11-25 17:58:50 +00001268\begin{methoddesc}[object]{__cmp__}{self, other}
Guido van Rossumab782dd2001-01-18 15:17:06 +00001269Called by comparison operations if rich comparison (see above) is not
Fred Drake597bc1d2001-05-29 16:02:35 +00001270defined. Should return a negative integer if \code{self < other},
1271zero if \code{self == other}, a positive integer if \code{self >
1272other}. If no \method{__cmp__()}, \method{__eq__()} or
1273\method{__ne__()} operation is defined, class instances are compared
1274by object identity (``address''). See also the description of
1275\method{__hash__()} for some important notes on creating objects which
1276support custom comparison operations and are usable as dictionary
1277keys.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001278(Note: the restriction that exceptions are not propagated by
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001279\method{__cmp__()} has been removed since Python 1.5.)
Fred Drakef6669171998-05-06 19:52:49 +00001280\bifuncindex{cmp}
1281\index{comparisons}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001282\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001283
Fred Drakee57a1142000-06-15 20:07:25 +00001284\begin{methoddesc}[object]{__rcmp__}{self, other}
Fred Drake445f8322001-01-04 15:11:48 +00001285 \versionchanged[No longer supported]{2.1}
Fred Drakee57a1142000-06-15 20:07:25 +00001286\end{methoddesc}
1287
Fred Drake1e42d8a1998-11-25 17:58:50 +00001288\begin{methoddesc}[object]{__hash__}{self}
Brett Cannona031a082004-06-29 04:14:02 +00001289Called for the key object for dictionary \obindex{dictionary}
Fred Draked82575d1998-08-28 20:03:12 +00001290operations, and by the built-in function
Fred Drakef6669171998-05-06 19:52:49 +00001291\function{hash()}\bifuncindex{hash}. Should return a 32-bit integer
1292usable as a hash value
1293for dictionary operations. The only required property is that objects
1294which compare equal have the same hash value; it is advised to somehow
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001295mix together (e.g., using exclusive or) the hash values for the
Fred Drakef6669171998-05-06 19:52:49 +00001296components of the object that also play a part in comparison of
1297objects. If a class does not define a \method{__cmp__()} method it should
1298not define a \method{__hash__()} operation either; if it defines
Fred Drake597bc1d2001-05-29 16:02:35 +00001299\method{__cmp__()} or \method{__eq__()} but not \method{__hash__()},
1300its instances will not be usable as dictionary keys. If a class
1301defines mutable objects and implements a \method{__cmp__()} or
1302\method{__eq__()} method, it should not implement \method{__hash__()},
1303since the dictionary implementation requires that a key's hash value
1304is immutable (if the object's hash value changes, it will be in the
1305wrong hash bucket).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001306\withsubitem{(object method)}{\ttindex{__cmp__()}}
1307\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001308
Fred Drake1e42d8a1998-11-25 17:58:50 +00001309\begin{methoddesc}[object]{__nonzero__}{self}
Guido van Rossum77f6a652002-04-03 22:41:51 +00001310Called to implement truth value testing, and the built-in operation
1311\code{bool()}; should return \code{False} or \code{True}, or their
1312integer equivalents \code{0} or \code{1}.
1313When this method is not defined, \method{__len__()} is
Fred Draked82575d1998-08-28 20:03:12 +00001314called, if it is defined (see below). If a class defines neither
1315\method{__len__()} nor \method{__nonzero__()}, all its instances are
1316considered true.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001317\withsubitem{(mapping object method)}{\ttindex{__len__()}}
1318\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001319
Martin v. Löwis2a519f82002-04-11 12:39:35 +00001320\begin{methoddesc}[object]{__unicode__}{self}
1321Called to implement \function{unicode()}\bifuncindex{unicode} builtin;
1322should return a Unicode object. When this method is not defined, string
1323conversion is attempted, and the result of string conversion is converted
1324to Unicode using the system default encoding.
1325\end{methoddesc}
1326
Fred Drakef6669171998-05-06 19:52:49 +00001327
Fred Drake61c77281998-07-28 19:34:22 +00001328\subsection{Customizing attribute access\label{attribute-access}}
Fred Drakef6669171998-05-06 19:52:49 +00001329
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001330The following methods can be defined to customize the meaning of
1331attribute access (use of, assignment to, or deletion of \code{x.name})
1332for class instances.
Fred Drakef6669171998-05-06 19:52:49 +00001333
Fred Drake1e42d8a1998-11-25 17:58:50 +00001334\begin{methoddesc}[object]{__getattr__}{self, name}
Fred Drakef6669171998-05-06 19:52:49 +00001335Called when an attribute lookup has not found the attribute in the
1336usual places (i.e. it is not an instance attribute nor is it found in
1337the class tree for \code{self}). \code{name} is the attribute name.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001338This method should return the (computed) attribute value or raise an
Fred Draked82575d1998-08-28 20:03:12 +00001339\exception{AttributeError} exception.
Fred Drakef6669171998-05-06 19:52:49 +00001340
1341Note that if the attribute is found through the normal mechanism,
Fred Draked82575d1998-08-28 20:03:12 +00001342\method{__getattr__()} is not called. (This is an intentional
1343asymmetry between \method{__getattr__()} and \method{__setattr__()}.)
Fred Drakef6669171998-05-06 19:52:49 +00001344This is done both for efficiency reasons and because otherwise
Fred Draked82575d1998-08-28 20:03:12 +00001345\method{__setattr__()} would have no way to access other attributes of
Guido van Rossumd41eea02003-02-28 14:11:45 +00001346the instance. Note that at least for instance variables, you can fake
1347total control by not inserting any values in the instance attribute
1348dictionary (but instead inserting them in another object). See the
1349\method{__getattribute__()} method below for a way to actually get
1350total control in new-style classes.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001351\withsubitem{(object method)}{\ttindex{__setattr__()}}
1352\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001353
Fred Drake1e42d8a1998-11-25 17:58:50 +00001354\begin{methoddesc}[object]{__setattr__}{self, name, value}
Fred Drakef6669171998-05-06 19:52:49 +00001355Called when an attribute assignment is attempted. This is called
Fred Draked82575d1998-08-28 20:03:12 +00001356instead of the normal mechanism (i.e.\ store the value in the instance
1357dictionary). \var{name} is the attribute name, \var{value} is the
Fred Drakef6669171998-05-06 19:52:49 +00001358value to be assigned to it.
Fred Drakef6669171998-05-06 19:52:49 +00001359
Fred Draked82575d1998-08-28 20:03:12 +00001360If \method{__setattr__()} wants to assign to an instance attribute, it
1361should not simply execute \samp{self.\var{name} = value} --- this
1362would cause a recursive call to itself. Instead, it should insert the
1363value in the dictionary of instance attributes, e.g.,
Guido van Rossumd41eea02003-02-28 14:11:45 +00001364\samp{self.__dict__[\var{name}] = value}. For new-style classes,
1365rather than accessing the instance dictionary, it should call the base
1366class method with the same name, for example,
1367\samp{object.__setattr__(self, name, value)}.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001368\withsubitem{(instance attribute)}{\ttindex{__dict__}}
1369\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001370
Fred Drake1e42d8a1998-11-25 17:58:50 +00001371\begin{methoddesc}[object]{__delattr__}{self, name}
Fred Draked82575d1998-08-28 20:03:12 +00001372Like \method{__setattr__()} but for attribute deletion instead of
Fred Drake1e42d8a1998-11-25 17:58:50 +00001373assignment. This should only be implemented if \samp{del
1374obj.\var{name}} is meaningful for the object.
1375\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001376
Michael W. Hudson2ab1d082003-03-05 14:20:58 +00001377\subsubsection{More attribute access for new-style classes \label{new-style-attribute-access}}
Guido van Rossumd41eea02003-02-28 14:11:45 +00001378
1379The following methods only apply to new-style classes.
1380
1381\begin{methoddesc}[object]{__getattribute__}{self, name}
1382Called unconditionally to implement attribute accesses for instances
Fred Drakeb3dfc0a2005-09-07 04:57:56 +00001383of the class. If the class also defines \method{__getattr__()}, the latter
Georg Brandl1c330eb2005-07-02 10:27:31 +00001384will not be called unless \method{__getattribute__()} either calls it
1385explicitly or raises an \exception{AttributeError}.
Guido van Rossumd41eea02003-02-28 14:11:45 +00001386This method should return the (computed) attribute
1387value or raise an \exception{AttributeError} exception.
1388In order to avoid infinite recursion in this method, its
1389implementation should always call the base class method with the same
Fred Drake62364ff2003-03-20 18:17:16 +00001390name to access any attributes it needs, for example,
Guido van Rossumd41eea02003-02-28 14:11:45 +00001391\samp{object.__getattribute__(self, name)}.
1392\end{methoddesc}
1393
Michael W. Hudson2ab1d082003-03-05 14:20:58 +00001394\subsubsection{Implementing Descriptors \label{descriptors}}
Guido van Rossumd41eea02003-02-28 14:11:45 +00001395
1396The following methods only apply when an instance of the class
Fred Drake62364ff2003-03-20 18:17:16 +00001397containing the method (a so-called \emph{descriptor} class) appears in
Guido van Rossumd41eea02003-02-28 14:11:45 +00001398the class dictionary of another new-style class, known as the
1399\emph{owner} class. In the examples below, ``the attribute'' refers to
Fred Drake62364ff2003-03-20 18:17:16 +00001400the attribute whose name is the key of the property in the owner
Fred Drake67a521e2004-05-06 12:44:29 +00001401class' \code{__dict__}. Descriptors can only be implemented as
1402new-style classes themselves.
Guido van Rossumd41eea02003-02-28 14:11:45 +00001403
1404\begin{methoddesc}[object]{__get__}{self, instance, owner}
Fred Drake62364ff2003-03-20 18:17:16 +00001405Called to get the attribute of the owner class (class attribute access)
Raymond Hettinger68804312005-01-01 00:28:46 +00001406or of an instance of that class (instance attribute access).
Guido van Rossumd41eea02003-02-28 14:11:45 +00001407\var{owner} is always the owner class, while \var{instance} is the
1408instance that the attribute was accessed through, or \code{None} when
1409the attribute is accessed through the \var{owner}. This method should
1410return the (computed) attribute value or raise an
1411\exception{AttributeError} exception.
1412\end{methoddesc}
1413
1414\begin{methoddesc}[object]{__set__}{self, instance, value}
Michael W. Hudson2ab1d082003-03-05 14:20:58 +00001415Called to set the attribute on an instance \var{instance} of the owner
Guido van Rossumd41eea02003-02-28 14:11:45 +00001416class to a new value, \var{value}.
1417\end{methoddesc}
1418
1419\begin{methoddesc}[object]{__delete__}{self, instance}
Michael W. Hudson2ab1d082003-03-05 14:20:58 +00001420Called to delete the attribute on an instance \var{instance} of the
1421owner class.
Guido van Rossumd41eea02003-02-28 14:11:45 +00001422\end{methoddesc}
1423
Fred Drakef6669171998-05-06 19:52:49 +00001424
Fred Drake4db36612003-06-26 03:11:20 +00001425\subsubsection{Invoking Descriptors \label{descriptor-invocation}}
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001426
1427In general, a descriptor is an object attribute with ``binding behavior'',
1428one whose attribute access has been overridden by methods in the descriptor
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001429protocol: \method{__get__()}, \method{__set__()}, and \method{__delete__()}.
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001430If any of those methods are defined for an object, it is said to be a
1431descriptor.
1432
1433The default behavior for attribute access is to get, set, or delete the
1434attribute from an object's dictionary. For instance, \code{a.x} has a
1435lookup chain starting with \code{a.__dict__['x']}, then
1436\code{type(a).__dict__['x']}, and continuing
1437through the base classes of \code{type(a)} excluding metaclasses.
1438
1439However, if the looked-up value is an object defining one of the descriptor
1440methods, then Python may override the default behavior and invoke the
1441descriptor method instead. Where this occurs in the precedence chain depends
1442on which descriptor methods were defined and how they were called. Note that
1443descriptors are only invoked for new style objects or classes
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001444(ones that subclass \class{object()} or \class{type()}).
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001445
1446The starting point for descriptor invocation is a binding, \code{a.x}.
1447How the arguments are assembled depends on \code{a}:
1448
1449\begin{itemize}
1450
1451 \item[Direct Call] The simplest and least common call is when user code
1452 directly invokes a descriptor method: \code{x.__get__(a)}.
1453
1454 \item[Instance Binding] If binding to a new-style object instance,
1455 \code{a.x} is transformed into the call:
1456 \code{type(a).__dict__['x'].__get__(a, type(a))}.
1457
1458 \item[Class Binding] If binding to a new-style class, \code{A.x}
1459 is transformed into the call: \code{A.__dict__['x'].__get__(None, A)}.
1460
1461 \item[Super Binding] If \code{a} is an instance of \class{super},
1462 then the binding \code{super(B, obj).m()} searches
1463 \code{obj.__class__.__mro__} for the base class \code{A} immediately
1464 preceding \code{B} and then invokes the descriptor with the call:
1465 \code{A.__dict__['m'].__get__(obj, A)}.
1466
1467\end{itemize}
1468
1469For instance bindings, the precedence of descriptor invocation depends
1470on the which descriptor methods are defined. Data descriptors define
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001471both \method{__get__()} and \method{__set__()}. Non-data descriptors have
1472just the \method{__get__()} method. Data descriptors always override
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001473a redefinition in an instance dictionary. In contrast, non-data
1474descriptors can be overridden by instances.
1475
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001476Python methods (including \function{staticmethod()} and \function{classmethod()})
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001477are implemented as non-data descriptors. Accordingly, instances can
1478redefine and override methods. This allows individual instances to acquire
1479behaviors that differ from other instances of the same class.
1480
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001481The \function{property()} function is implemented as a data descriptor.
1482Accordingly, instances cannot override the behavior of a property.
1483
1484
1485\subsubsection{__slots__\label{slots}}
1486
1487By default, instances of both old and new-style classes have a dictionary
1488for attribute storage. This wastes space for objects having very few instance
1489variables. The space consumption can become acute when creating large numbers
1490of instances.
1491
1492The default can be overridden by defining \var{__slots__} in a new-style class
1493definition. The \var{__slots__} declaration takes a sequence of instance
1494variables and reserves just enough space in each instance to hold a value
1495for each variable. Space is saved because \var{__dict__} is not created for
1496each instance.
1497
1498\begin{datadesc}{__slots__}
1499This class variable can be assigned a string, iterable, or sequence of strings
Raymond Hettinger5918f8d2003-06-29 04:53:23 +00001500with variable names used by instances. If defined in a new-style class,
1501\var{__slots__} reserves space for the declared variables
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001502and prevents the automatic creation of \var{__dict__} and \var{__weakref__}
1503for each instance.
1504\versionadded{2.2}
1505\end{datadesc}
1506
1507\noindent
Raymond Hettinger5918f8d2003-06-29 04:53:23 +00001508Notes on using \var{__slots__}
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001509
1510\begin{itemize}
1511
1512\item Without a \var{__dict__} variable, instances cannot be assigned new
1513variables not listed in the \var{__slots__} definition. Attempts to assign
1514to an unlisted variable name raises \exception{AttributeError}. If dynamic
1515assignment of new variables is desired, then add \code{'__dict__'} to the
1516sequence of strings in the \var{__slots__} declaration.
1517\versionchanged[Previously, adding \code{'__dict__'} to the \var{__slots__}
1518declaration would not enable the assignment of new attributes not
1519specifically listed in the sequence of instance variable names]{2.3}
1520
1521\item Without a \var{__weakref__} variable for each instance, classes
1522defining \var{__slots__} do not support weak references to its instances.
1523If weak reference support is needed, then add \code{'__weakref__'} to the
1524sequence of strings in the \var{__slots__} declaration.
Raymond Hettinger5918f8d2003-06-29 04:53:23 +00001525\versionchanged[Previously, adding \code{'__weakref__'} to the \var{__slots__}
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001526declaration would not enable support for weak references]{2.3}
1527
1528\item \var{__slots__} are implemented at the class level by creating
1529descriptors (\ref{descriptors}) for each variable name. As a result,
1530class attributes cannot be used to set default values for instance
1531variables defined by \var{__slots__}; otherwise, the class attribute would
1532overwrite the descriptor assignment.
1533
1534\item If a class defines a slot also defined in a base class, the instance
1535variable defined by the base class slot is inaccessible (except by retrieving
1536its descriptor directly from the base class). This renders the meaning of the
1537program undefined. In the future, a check may be added to prevent this.
1538
1539\item The action of a \var{__slots__} declaration is limited to the class
1540where it is defined. As a result, subclasses will have a \var{__dict__}
1541unless they also define \var{__slots__}.
1542
1543\item \var{__slots__} do not work for classes derived from ``variable-length''
1544built-in types such as \class{long}, \class{str} and \class{tuple}.
1545
Raymond Hettinger5918f8d2003-06-29 04:53:23 +00001546\item Any non-string iterable may be assigned to \var{__slots__}.
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001547Mappings may also be used; however, in the future, special meaning may
1548be assigned to the values corresponding to each key.
1549
1550\end{itemize}
1551
1552
1553\subsection{Customizing class creation\label{metaclasses}}
1554
1555By default, new-style classes are constructed using \function{type()}.
1556A class definition is read into a separate namespace and the value
1557of class name is bound to the result of \code{type(name, bases, dict)}.
1558
1559When the class definition is read, if \var{__metaclass__} is defined
1560then the callable assigned to it will be called instead of \function{type()}.
1561The allows classes or functions to be written which monitor or alter the class
1562creation process:
1563
1564\begin{itemize}
1565\item Modifying the class dictionary prior to the class being created.
1566\item Returning an instance of another class -- essentially performing
1567the role of a factory function.
1568\end{itemize}
1569
1570\begin{datadesc}{__metaclass__}
1571This variable can be any callable accepting arguments for \code{name},
1572\code{bases}, and \code{dict}. Upon class creation, the callable is
1573used instead of the built-in \function{type()}.
1574\versionadded{2.2}
1575\end{datadesc}
1576
1577The appropriate metaclass is determined by the following precedence rules:
1578
1579\begin{itemize}
1580
1581\item If \code{dict['__metaclass__']} exists, it is used.
1582
1583\item Otherwise, if there is at least one base class, its metaclass is used
1584(this looks for a \var{__class__} attribute first and if not found, uses its
1585type).
1586
1587\item Otherwise, if a global variable named __metaclass__ exists, it is used.
1588
1589\item Otherwise, the old-style, classic metaclass (types.ClassType) is used.
1590
1591\end{itemize}
1592
1593The potential uses for metaclasses are boundless. Some ideas that have
1594been explored including logging, interface checking, automatic delegation,
1595automatic property creation, proxies, frameworks, and automatic resource
1596locking/synchronization.
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001597
1598
Fred Drake61c77281998-07-28 19:34:22 +00001599\subsection{Emulating callable objects\label{callable-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001600
Fred Drake1e42d8a1998-11-25 17:58:50 +00001601\begin{methoddesc}[object]{__call__}{self\optional{, args...}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001602Called when the instance is ``called'' as a function; if this method
Fred Draked82575d1998-08-28 20:03:12 +00001603is defined, \code{\var{x}(arg1, arg2, ...)} is a shorthand for
1604\code{\var{x}.__call__(arg1, arg2, ...)}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001605\indexii{call}{instance}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001606\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001607
1608
Fred Drake73921b02001-10-01 16:32:13 +00001609\subsection{Emulating container types\label{sequence-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001610
Fred Drake73921b02001-10-01 16:32:13 +00001611The following methods can be defined to implement container
1612objects. Containers usually are sequences (such as lists or tuples)
1613or mappings (like dictionaries), but can represent other containers as
1614well. The first set of methods is used either to emulate a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001615sequence or to emulate a mapping; the difference is that for a
1616sequence, the allowable keys should be the integers \var{k} for which
1617\code{0 <= \var{k} < \var{N}} where \var{N} is the length of the
Thomas Wouters1d75a792000-08-17 22:37:32 +00001618sequence, or slice objects, which define a range of items. (For backwards
1619compatibility, the method \method{__getslice__()} (see below) can also be
1620defined to handle simple, but not extended slices.) It is also recommended
Fred Drakea0073822000-08-18 02:42:14 +00001621that mappings provide the methods \method{keys()}, \method{values()},
Thomas Wouters1d75a792000-08-17 22:37:32 +00001622\method{items()}, \method{has_key()}, \method{get()}, \method{clear()},
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001623\method{setdefault()}, \method{iterkeys()}, \method{itervalues()},
Raymond Hettingerf4ca5a22003-01-19 14:57:12 +00001624\method{iteritems()}, \method{pop()}, \method{popitem()},
Thomas Wouters1d75a792000-08-17 22:37:32 +00001625\method{copy()}, and \method{update()} behaving similar to those for
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001626Python's standard dictionary objects. The \module{UserDict} module
1627provides a \class{DictMixin} class to help create those methods
1628from a base set of \method{__getitem__()}, \method{__setitem__()},
1629\method{__delitem__()}, and \method{keys()}.
1630Mutable sequences should provide
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001631methods \method{append()}, \method{count()}, \method{index()},
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001632\method{extend()},
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001633\method{insert()}, \method{pop()}, \method{remove()}, \method{reverse()}
1634and \method{sort()}, like Python standard list objects. Finally,
1635sequence types should implement addition (meaning concatenation) and
1636multiplication (meaning repetition) by defining the methods
Thomas Wouters12bba852000-08-24 20:06:04 +00001637\method{__add__()}, \method{__radd__()}, \method{__iadd__()},
1638\method{__mul__()}, \method{__rmul__()} and \method{__imul__()} described
1639below; they should not define \method{__coerce__()} or other numerical
Guido van Rossum0dbb4fb2001-04-20 16:50:40 +00001640operators. It is recommended that both mappings and sequences
Fred Drake18d8d5a2001-09-18 17:58:20 +00001641implement the \method{__contains__()} method to allow efficient use of
1642the \code{in} operator; for mappings, \code{in} should be equivalent
1643of \method{has_key()}; for sequences, it should search through the
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001644values. It is further recommended that both mappings and sequences
1645implement the \method{__iter__()} method to allow efficient iteration
1646through the container; for mappings, \method{__iter__()} should be
1647the same as \method{iterkeys()}; for sequences, it should iterate
1648through the values.
Fred Drake4856d011999-01-12 04:15:20 +00001649\withsubitem{(mapping object method)}{
1650 \ttindex{keys()}
1651 \ttindex{values()}
1652 \ttindex{items()}
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001653 \ttindex{iterkeys()}
1654 \ttindex{itervalues()}
1655 \ttindex{iteritems()}
Fred Drake4856d011999-01-12 04:15:20 +00001656 \ttindex{has_key()}
1657 \ttindex{get()}
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001658 \ttindex{setdefault()}
1659 \ttindex{pop()}
1660 \ttindex{popitem()}
Fred Drake4856d011999-01-12 04:15:20 +00001661 \ttindex{clear()}
1662 \ttindex{copy()}
Guido van Rossum0dbb4fb2001-04-20 16:50:40 +00001663 \ttindex{update()}
1664 \ttindex{__contains__()}}
Fred Drake4856d011999-01-12 04:15:20 +00001665\withsubitem{(sequence object method)}{
1666 \ttindex{append()}
1667 \ttindex{count()}
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001668 \ttindex{extend()}
Fred Drake4856d011999-01-12 04:15:20 +00001669 \ttindex{index()}
1670 \ttindex{insert()}
1671 \ttindex{pop()}
1672 \ttindex{remove()}
1673 \ttindex{reverse()}
1674 \ttindex{sort()}
1675 \ttindex{__add__()}
1676 \ttindex{__radd__()}
Thomas Wouters12bba852000-08-24 20:06:04 +00001677 \ttindex{__iadd__()}
Fred Drake4856d011999-01-12 04:15:20 +00001678 \ttindex{__mul__()}
Thomas Wouters12bba852000-08-24 20:06:04 +00001679 \ttindex{__rmul__()}
Guido van Rossum0dbb4fb2001-04-20 16:50:40 +00001680 \ttindex{__imul__()}
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001681 \ttindex{__contains__()}
1682 \ttindex{__iter__()}}
Fred Drakeae3e5741999-01-28 23:21:49 +00001683\withsubitem{(numeric object method)}{\ttindex{__coerce__()}}
Fred Drakef6669171998-05-06 19:52:49 +00001684
Fred Drake73921b02001-10-01 16:32:13 +00001685\begin{methoddesc}[container object]{__len__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001686Called to implement the built-in function
1687\function{len()}\bifuncindex{len}. Should return the length of the
1688object, an integer \code{>=} 0. Also, an object that doesn't define a
1689\method{__nonzero__()} method and whose \method{__len__()} method
1690returns zero is considered to be false in a Boolean context.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001691\withsubitem{(object method)}{\ttindex{__nonzero__()}}
1692\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001693
Fred Drake73921b02001-10-01 16:32:13 +00001694\begin{methoddesc}[container object]{__getitem__}{self, key}
Fred Draked82575d1998-08-28 20:03:12 +00001695Called to implement evaluation of \code{\var{self}[\var{key}]}.
Fred Drake31575ce2000-09-21 05:28:26 +00001696For sequence types, the accepted keys should be integers and slice
1697objects.\obindex{slice} Note that
1698the special interpretation of negative indexes (if the class wishes to
Fred Drakef6669171998-05-06 19:52:49 +00001699emulate a sequence type) is up to the \method{__getitem__()} method.
Fred Drake91826ed2000-07-13 04:57:58 +00001700If \var{key} is of an inappropriate type, \exception{TypeError} may be
1701raised; if of a value outside the set of indexes for the sequence
1702(after any special interpretation of negative values),
1703\exception{IndexError} should be raised.
Raymond Hettingera30616a2005-08-21 11:26:14 +00001704For mapping types, if \var{key} is missing (not in the container),
1705\exception{KeyError} should be raised.
Fred Drake0aa811c2001-10-20 04:24:09 +00001706\note{\keyword{for} loops expect that an
Fred Drake91826ed2000-07-13 04:57:58 +00001707\exception{IndexError} will be raised for illegal indexes to allow
Fred Drake0aa811c2001-10-20 04:24:09 +00001708proper detection of the end of the sequence.}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001709\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001710
Fred Drake73921b02001-10-01 16:32:13 +00001711\begin{methoddesc}[container object]{__setitem__}{self, key, value}
Fred Draked82575d1998-08-28 20:03:12 +00001712Called to implement assignment to \code{\var{self}[\var{key}]}. Same
Fred Drake1e42d8a1998-11-25 17:58:50 +00001713note as for \method{__getitem__()}. This should only be implemented
1714for mappings if the objects support changes to the values for keys, or
1715if new keys can be added, or for sequences if elements can be
Fred Drake91826ed2000-07-13 04:57:58 +00001716replaced. The same exceptions should be raised for improper
1717\var{key} values as for the \method{__getitem__()} method.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001718\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001719
Fred Drake73921b02001-10-01 16:32:13 +00001720\begin{methoddesc}[container object]{__delitem__}{self, key}
Fred Draked82575d1998-08-28 20:03:12 +00001721Called to implement deletion of \code{\var{self}[\var{key}]}. Same
Fred Drake1e42d8a1998-11-25 17:58:50 +00001722note as for \method{__getitem__()}. This should only be implemented
1723for mappings if the objects support removal of keys, or for sequences
Fred Drake91826ed2000-07-13 04:57:58 +00001724if elements can be removed from the sequence. The same exceptions
1725should be raised for improper \var{key} values as for the
1726\method{__getitem__()} method.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001727\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001728
Fred Drake73921b02001-10-01 16:32:13 +00001729\begin{methoddesc}[container object]{__iter__}{self}
1730This method is called when an iterator is required for a container.
1731This method should return a new iterator object that can iterate over
1732all the objects in the container. For mappings, it should iterate
1733over the keys of the container, and should also be made available as
1734the method \method{iterkeys()}.
1735
1736Iterator objects also need to implement this method; they are required
1737to return themselves. For more information on iterator objects, see
1738``\ulink{Iterator Types}{../lib/typeiter.html}'' in the
1739\citetitle[../lib/lib.html]{Python Library Reference}.
1740\end{methoddesc}
1741
1742The membership test operators (\keyword{in} and \keyword{not in}) are
1743normally implemented as an iteration through a sequence. However,
1744container objects can supply the following special method with a more
1745efficient implementation, which also does not require the object be a
1746sequence.
1747
1748\begin{methoddesc}[container object]{__contains__}{self, item}
1749Called to implement membership test operators. Should return true if
1750\var{item} is in \var{self}, false otherwise. For mapping objects,
1751this should consider the keys of the mapping rather than the values or
1752the key-item pairs.
1753\end{methoddesc}
1754
Fred Drakef6669171998-05-06 19:52:49 +00001755
Fred Drake3041b071998-10-21 00:25:32 +00001756\subsection{Additional methods for emulation of sequence types
Fred Drake61c77281998-07-28 19:34:22 +00001757 \label{sequence-methods}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001758
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001759The following optional methods can be defined to further emulate sequence
1760objects. Immutable sequences methods should at most only define
1761\method{__getslice__()}; mutable sequences might define all three
Raymond Hettinger92016dc2003-09-22 15:27:11 +00001762methods.
Fred Drakef6669171998-05-06 19:52:49 +00001763
Fred Drake1e42d8a1998-11-25 17:58:50 +00001764\begin{methoddesc}[sequence object]{__getslice__}{self, i, j}
Fred Drakea0073822000-08-18 02:42:14 +00001765\deprecated{2.0}{Support slice objects as parameters to the
1766\method{__getitem__()} method.}
Fred Draked82575d1998-08-28 20:03:12 +00001767Called to implement evaluation of \code{\var{self}[\var{i}:\var{j}]}.
1768The returned object should be of the same type as \var{self}. Note
1769that missing \var{i} or \var{j} in the slice expression are replaced
Fred Drakee15956b2000-04-03 04:51:13 +00001770by zero or \code{sys.maxint}, respectively. If negative indexes are
1771used in the slice, the length of the sequence is added to that index.
1772If the instance does not implement the \method{__len__()} method, an
1773\exception{AttributeError} is raised.
1774No guarantee is made that indexes adjusted this way are not still
1775negative. Indexes which are greater than the length of the sequence
1776are not modified.
Fred Drakea0073822000-08-18 02:42:14 +00001777If no \method{__getslice__()} is found, a slice
Thomas Wouters1d75a792000-08-17 22:37:32 +00001778object is created instead, and passed to \method{__getitem__()} instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001779\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001780
Fred Drake1e42d8a1998-11-25 17:58:50 +00001781\begin{methoddesc}[sequence object]{__setslice__}{self, i, j, sequence}
Fred Draked82575d1998-08-28 20:03:12 +00001782Called to implement assignment to \code{\var{self}[\var{i}:\var{j}]}.
1783Same notes for \var{i} and \var{j} as for \method{__getslice__()}.
Thomas Wouters1d75a792000-08-17 22:37:32 +00001784
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001785This method is deprecated. If no \method{__setslice__()} is found,
1786or for extended slicing of the form
1787\code{\var{self}[\var{i}:\var{j}:\var{k}]}, a
1788slice object is created, and passed to \method{__setitem__()},
1789instead of \method{__setslice__()} being called.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001790\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001791
Fred Drake1e42d8a1998-11-25 17:58:50 +00001792\begin{methoddesc}[sequence object]{__delslice__}{self, i, j}
Fred Draked82575d1998-08-28 20:03:12 +00001793Called to implement deletion of \code{\var{self}[\var{i}:\var{j}]}.
1794Same notes for \var{i} and \var{j} as for \method{__getslice__()}.
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001795This method is deprecated. If no \method{__delslice__()} is found,
1796or for extended slicing of the form
1797\code{\var{self}[\var{i}:\var{j}:\var{k}]}, a
1798slice object is created, and passed to \method{__delitem__()},
1799instead of \method{__delslice__()} being called.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001800\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001801
Fred Drakefb8ffe62001-04-13 15:54:41 +00001802Notice that these methods are only invoked when a single slice with a
1803single colon is used, and the slice method is available. For slice
1804operations involving extended slice notation, or in absence of the
1805slice methods, \method{__getitem__()}, \method{__setitem__()} or
1806\method{__delitem__()} is called with a slice object as argument.
Fred Drakef6669171998-05-06 19:52:49 +00001807
Fred Drakef89259782000-09-21 22:27:16 +00001808The following example demonstrate how to make your program or module
1809compatible with earlier versions of Python (assuming that methods
1810\method{__getitem__()}, \method{__setitem__()} and \method{__delitem__()}
1811support slice objects as arguments):
1812
1813\begin{verbatim}
1814class MyClass:
1815 ...
1816 def __getitem__(self, index):
1817 ...
1818 def __setitem__(self, index, value):
1819 ...
1820 def __delitem__(self, index):
1821 ...
1822
1823 if sys.version_info < (2, 0):
1824 # They won't be defined if version is at least 2.0 final
1825
1826 def __getslice__(self, i, j):
1827 return self[max(0, i):max(0, j):]
1828 def __setslice__(self, i, j, seq):
1829 self[max(0, i):max(0, j):] = seq
1830 def __delslice__(self, i, j):
1831 del self[max(0, i):max(0, j):]
1832 ...
1833\end{verbatim}
1834
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001835Note the calls to \function{max()}; these are necessary because of
1836the handling of negative indices before the
Fred Drakef89259782000-09-21 22:27:16 +00001837\method{__*slice__()} methods are called. When negative indexes are
1838used, the \method{__*item__()} methods receive them as provided, but
1839the \method{__*slice__()} methods get a ``cooked'' form of the index
1840values. For each negative index value, the length of the sequence is
1841added to the index before calling the method (which may still result
1842in a negative index); this is the customary handling of negative
1843indexes by the built-in sequence types, and the \method{__*item__()}
1844methods are expected to do this as well. However, since they should
1845already be doing that, negative indexes cannot be passed in; they must
Raymond Hettingere41d4c82003-08-25 04:39:55 +00001846be constrained to the bounds of the sequence before being passed to
Fred Drakef89259782000-09-21 22:27:16 +00001847the \method{__*item__()} methods.
1848Calling \code{max(0, i)} conveniently returns the proper value.
1849
Fred Drake15988fd1999-02-12 18:14:57 +00001850
Fred Drake61c77281998-07-28 19:34:22 +00001851\subsection{Emulating numeric types\label{numeric-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001852
1853The following methods can be defined to emulate numeric objects.
1854Methods corresponding to operations that are not supported by the
1855particular kind of number implemented (e.g., bitwise operations for
1856non-integral numbers) should be left undefined.
Fred Drakef6669171998-05-06 19:52:49 +00001857
Fred Drakeb8943701999-05-10 13:43:22 +00001858\begin{methoddesc}[numeric object]{__add__}{self, other}
1859\methodline[numeric object]{__sub__}{self, other}
1860\methodline[numeric object]{__mul__}{self, other}
Fred Drake3e2aca42001-08-14 20:28:08 +00001861\methodline[numeric object]{__floordiv__}{self, other}
Fred Drakeb8943701999-05-10 13:43:22 +00001862\methodline[numeric object]{__mod__}{self, other}
1863\methodline[numeric object]{__divmod__}{self, other}
1864\methodline[numeric object]{__pow__}{self, other\optional{, modulo}}
1865\methodline[numeric object]{__lshift__}{self, other}
1866\methodline[numeric object]{__rshift__}{self, other}
1867\methodline[numeric object]{__and__}{self, other}
1868\methodline[numeric object]{__xor__}{self, other}
1869\methodline[numeric object]{__or__}{self, other}
Fred Drake3e2aca42001-08-14 20:28:08 +00001870These methods are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001871called to implement the binary arithmetic operations (\code{+},
Fred Drake3e2aca42001-08-14 20:28:08 +00001872\code{-}, \code{*}, \code{//}, \code{\%},
Fred Draked82575d1998-08-28 20:03:12 +00001873\function{divmod()}\bifuncindex{divmod},
Fred Drakefb8ffe62001-04-13 15:54:41 +00001874\function{pow()}\bifuncindex{pow}, \code{**}, \code{<}\code{<},
1875\code{>}\code{>}, \code{\&}, \code{\^}, \code{|}). For instance, to
1876evaluate the expression \var{x}\code{+}\var{y}, where \var{x} is an
1877instance of a class that has an \method{__add__()} method,
Fred Drake3e2aca42001-08-14 20:28:08 +00001878\code{\var{x}.__add__(\var{y})} is called. The \method{__divmod__()}
1879method should be the equivalent to using \method{__floordiv__()} and
1880\method{__mod__()}; it should not be related to \method{__truediv__()}
1881(described below). Note that
Fred Draked82575d1998-08-28 20:03:12 +00001882\method{__pow__()} should be defined to accept an optional third
1883argument if the ternary version of the built-in
1884\function{pow()}\bifuncindex{pow} function is to be supported.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001885\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001886
Fred Drake3e2aca42001-08-14 20:28:08 +00001887\begin{methoddesc}[numeric object]{__div__}{self, other}
1888\methodline[numeric object]{__truediv__}{self, other}
1889The division operator (\code{/}) is implemented by these methods. The
1890\method{__truediv__()} method is used when \code{__future__.division}
1891is in effect, otherwise \method{__div__()} is used. If only one of
1892these two methods is defined, the object will not support division in
1893the alternate context; \exception{TypeError} will be raised instead.
1894\end{methoddesc}
1895
Fred Drakeb8943701999-05-10 13:43:22 +00001896\begin{methoddesc}[numeric object]{__radd__}{self, other}
1897\methodline[numeric object]{__rsub__}{self, other}
1898\methodline[numeric object]{__rmul__}{self, other}
1899\methodline[numeric object]{__rdiv__}{self, other}
Raymond Hettinger10cbe8d2002-06-20 06:12:37 +00001900\methodline[numeric object]{__rtruediv__}{self, other}
1901\methodline[numeric object]{__rfloordiv__}{self, other}
Fred Drakeb8943701999-05-10 13:43:22 +00001902\methodline[numeric object]{__rmod__}{self, other}
1903\methodline[numeric object]{__rdivmod__}{self, other}
1904\methodline[numeric object]{__rpow__}{self, other}
1905\methodline[numeric object]{__rlshift__}{self, other}
1906\methodline[numeric object]{__rrshift__}{self, other}
1907\methodline[numeric object]{__rand__}{self, other}
1908\methodline[numeric object]{__rxor__}{self, other}
1909\methodline[numeric object]{__ror__}{self, other}
Fred Drake3e2aca42001-08-14 20:28:08 +00001910These methods are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001911called to implement the binary arithmetic operations (\code{+},
Fred Draked82575d1998-08-28 20:03:12 +00001912\code{-}, \code{*}, \code{/}, \code{\%},
1913\function{divmod()}\bifuncindex{divmod},
Fred Drakefb8ffe62001-04-13 15:54:41 +00001914\function{pow()}\bifuncindex{pow}, \code{**}, \code{<}\code{<},
1915\code{>}\code{>}, \code{\&}, \code{\^}, \code{|}) with reflected
1916(swapped) operands. These functions are only called if the left
1917operand does not support the corresponding operation. For instance,
1918to evaluate the expression \var{x}\code{-}\var{y}, where \var{y} is an
1919instance of a class that has an \method{__rsub__()} method,
1920\code{\var{y}.__rsub__(\var{x})} is called. Note that ternary
1921\function{pow()}\bifuncindex{pow} will not try calling
1922\method{__rpow__()} (the coercion rules would become too
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001923complicated).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001924\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001925
Thomas Woutersdc90cc22000-12-11 23:11:51 +00001926\begin{methoddesc}[numeric object]{__iadd__}{self, other}
1927\methodline[numeric object]{__isub__}{self, other}
1928\methodline[numeric object]{__imul__}{self, other}
1929\methodline[numeric object]{__idiv__}{self, other}
Raymond Hettinger10cbe8d2002-06-20 06:12:37 +00001930\methodline[numeric object]{__itruediv__}{self, other}
1931\methodline[numeric object]{__ifloordiv__}{self, other}
1932\methodline[numeric object]{__imod__}{self, other}
Thomas Woutersdc90cc22000-12-11 23:11:51 +00001933\methodline[numeric object]{__ipow__}{self, other\optional{, modulo}}
1934\methodline[numeric object]{__ilshift__}{self, other}
1935\methodline[numeric object]{__irshift__}{self, other}
1936\methodline[numeric object]{__iand__}{self, other}
1937\methodline[numeric object]{__ixor__}{self, other}
1938\methodline[numeric object]{__ior__}{self, other}
Fred Drakefb8ffe62001-04-13 15:54:41 +00001939These methods are called to implement the augmented arithmetic
1940operations (\code{+=}, \code{-=}, \code{*=}, \code{/=}, \code{\%=},
1941\code{**=}, \code{<}\code{<=}, \code{>}\code{>=}, \code{\&=},
Fred Drakea3788642003-07-23 15:18:03 +00001942\code{\textasciicircum=}, \code{|=}). These methods should attempt to do the
Fred Drakefb8ffe62001-04-13 15:54:41 +00001943operation in-place (modifying \var{self}) and return the result (which
1944could be, but does not have to be, \var{self}). If a specific method
1945is not defined, the augmented operation falls back to the normal
1946methods. For instance, to evaluate the expression
1947\var{x}\code{+=}\var{y}, where \var{x} is an instance of a class that
1948has an \method{__iadd__()} method, \code{\var{x}.__iadd__(\var{y})} is
1949called. If \var{x} is an instance of a class that does not define a
Fred Drakeb3dfc0a2005-09-07 04:57:56 +00001950\method{__iadd__()} method, \code{\var{x}.__add__(\var{y})} and
Fred Drakefb8ffe62001-04-13 15:54:41 +00001951\code{\var{y}.__radd__(\var{x})} are considered, as with the
1952evaluation of \var{x}\code{+}\var{y}.
Thomas Woutersdc90cc22000-12-11 23:11:51 +00001953\end{methoddesc}
1954
Fred Drakeb8943701999-05-10 13:43:22 +00001955\begin{methoddesc}[numeric object]{__neg__}{self}
1956\methodline[numeric object]{__pos__}{self}
1957\methodline[numeric object]{__abs__}{self}
1958\methodline[numeric object]{__invert__}{self}
Fred Drakefb8ffe62001-04-13 15:54:41 +00001959Called to implement the unary arithmetic operations (\code{-},
1960\code{+}, \function{abs()}\bifuncindex{abs} and \code{\~{}}).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001961\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001962
Fred Drakeb8943701999-05-10 13:43:22 +00001963\begin{methoddesc}[numeric object]{__complex__}{self}
1964\methodline[numeric object]{__int__}{self}
1965\methodline[numeric object]{__long__}{self}
1966\methodline[numeric object]{__float__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001967Called to implement the built-in functions
Fred Drake15988fd1999-02-12 18:14:57 +00001968\function{complex()}\bifuncindex{complex},
1969\function{int()}\bifuncindex{int}, \function{long()}\bifuncindex{long},
Fred Draked82575d1998-08-28 20:03:12 +00001970and \function{float()}\bifuncindex{float}. Should return a value of
1971the appropriate type.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001972\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001973
Fred Drakeb8943701999-05-10 13:43:22 +00001974\begin{methoddesc}[numeric object]{__oct__}{self}
1975\methodline[numeric object]{__hex__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001976Called to implement the built-in functions
1977\function{oct()}\bifuncindex{oct} and
1978\function{hex()}\bifuncindex{hex}. Should return a string value.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001979\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001980
Guido van Rossum38fff8c2006-03-07 18:50:55 +00001981\begin{methoddesc}[numeric object]{__index__}{self}
1982Called to implement operator.index(). Also called whenever Python
1983needs an integer object (such as in slicing). Must return an integer
1984(int or long).
1985\versionadded{2.5}
1986\end{methoddesc}
1987
Fred Drakeb8943701999-05-10 13:43:22 +00001988\begin{methoddesc}[numeric object]{__coerce__}{self, other}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001989Called to implement ``mixed-mode'' numeric arithmetic. Should either
Fred Draked82575d1998-08-28 20:03:12 +00001990return a 2-tuple containing \var{self} and \var{other} converted to
Fred Drakeb8943701999-05-10 13:43:22 +00001991a common numeric type, or \code{None} if conversion is impossible. When
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001992the common type would be the type of \code{other}, it is sufficient to
1993return \code{None}, since the interpreter will also ask the other
1994object to attempt a coercion (but sometimes, if the implementation of
1995the other type cannot be changed, it is useful to do the conversion to
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001996the other type here). A return value of \code{NotImplemented} is
1997equivalent to returning \code{None}.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001998\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001999
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002000\subsection{Coercion rules\label{coercion-rules}}
2001
2002This section used to document the rules for coercion. As the language
2003has evolved, the coercion rules have become hard to document
2004precisely; documenting what one version of one particular
2005implementation does is undesirable. Instead, here are some informal
2006guidelines regarding coercion. In Python 3.0, coercion will not be
2007supported.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002008
2009\begin{itemize}
2010
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002011\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002012
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002013If the left operand of a \% operator is a string or Unicode object, no
2014coercion takes place and the string formatting operation is invoked
2015instead.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002016
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002017\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002018
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002019It is no longer recommended to define a coercion operation.
2020Mixed-mode operations on types that don't define coercion pass the
2021original arguments to the operation.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002022
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002023\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002024
Fred Drake293dd4b2002-06-04 16:25:57 +00002025New-style classes (those derived from \class{object}) never invoke the
2026\method{__coerce__()} method in response to a binary operator; the only
2027time \method{__coerce__()} is invoked is when the built-in function
2028\function{coerce()} is called.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002029
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002030\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002031
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002032For most intents and purposes, an operator that returns
2033\code{NotImplemented} is treated the same as one that is not
2034implemented at all.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002035
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002036\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002037
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002038Below, \method{__op__()} and \method{__rop__()} are used to signify
2039the generic method names corresponding to an operator;
Fred Drakeb3dfc0a2005-09-07 04:57:56 +00002040\method{__iop__()} is used for the corresponding in-place operator. For
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002041example, for the operator `\code{+}', \method{__add__()} and
2042\method{__radd__()} are used for the left and right variant of the
Fred Drakeb3dfc0a2005-09-07 04:57:56 +00002043binary operator, and \method{__iadd__()} for the in-place variant.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002044
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002045\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002046
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002047For objects \var{x} and \var{y}, first \code{\var{x}.__op__(\var{y})}
2048is tried. If this is not implemented or returns \code{NotImplemented},
2049\code{\var{y}.__rop__(\var{x})} is tried. If this is also not
Fred Drake293dd4b2002-06-04 16:25:57 +00002050implemented or returns \code{NotImplemented}, a \exception{TypeError}
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002051exception is raised. But see the following exception:
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002052
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002053\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002054
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002055Exception to the previous item: if the left operand is an instance of
2056a built-in type or a new-style class, and the right operand is an
2057instance of a proper subclass of that type or class, the right
Fred Drake293dd4b2002-06-04 16:25:57 +00002058operand's \method{__rop__()} method is tried \emph{before} the left
2059operand's \method{__op__()} method. This is done so that a subclass can
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002060completely override binary operators. Otherwise, the left operand's
2061__op__ method would always accept the right operand: when an instance
2062of a given class is expected, an instance of a subclass of that class
2063is always acceptable.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002064
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002065\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002066
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002067When either operand type defines a coercion, this coercion is called
Fred Drake293dd4b2002-06-04 16:25:57 +00002068before that type's \method{__op__()} or \method{__rop__()} method is
2069called, but no sooner. If the coercion returns an object of a
2070different type for the operand whose coercion is invoked, part of the
2071process is redone using the new object.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002072
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002073\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002074
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002075When an in-place operator (like `\code{+=}') is used, if the left
Fred Drake293dd4b2002-06-04 16:25:57 +00002076operand implements \method{__iop__()}, it is invoked without any
2077coercion. When the operation falls back to \method{__op__()} and/or
2078\method{__rop__()}, the normal coercion rules apply.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002079
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002080\item
2081
2082In \var{x}\code{+}\var{y}, if \var{x} is a sequence that implements
2083sequence concatenation, sequence concatenation is invoked.
2084
2085\item
2086
2087In \var{x}\code{*}\var{y}, if one operator is a sequence that
2088implements sequence repetition, and the other is an integer
Fred Drake293dd4b2002-06-04 16:25:57 +00002089(\class{int} or \class{long}), sequence repetition is invoked.
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002090
2091\item
2092
Fred Drake293dd4b2002-06-04 16:25:57 +00002093Rich comparisons (implemented by methods \method{__eq__()} and so on)
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002094never use coercion. Three-way comparison (implemented by
Fred Drake293dd4b2002-06-04 16:25:57 +00002095\method{__cmp__()}) does use coercion under the same conditions as
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002096other binary operations use it.
2097
2098\item
2099
Fred Drake293dd4b2002-06-04 16:25:57 +00002100In the current implementation, the built-in numeric types \class{int},
2101\class{long} and \class{float} do not use coercion; the type
2102\class{complex} however does use it. The difference can become
Guido van Rossum92cf95f2002-06-03 19:06:41 +00002103apparent when subclassing these types. Over time, the type
Fred Drake293dd4b2002-06-04 16:25:57 +00002104\class{complex} may be fixed to avoid coercion. All these types
2105implement a \method{__coerce__()} method, for use by the built-in
2106\function{coerce()} function.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00002107
2108\end{itemize}