blob: 3f82a8ccff404eb9b5ed451f061d5408cf999b38 [file] [log] [blame]
Fred Drake61c77281998-07-28 19:34:22 +00001\chapter{Data model\label{datamodel}}
Fred Drakef6669171998-05-06 19:52:49 +00002
Fred Drake2829f1c2001-06-23 05:27:20 +00003
Fred Drake61c77281998-07-28 19:34:22 +00004\section{Objects, values and types\label{objects}}
Fred Drakef6669171998-05-06 19:52:49 +00005
6\dfn{Objects} are Python's abstraction for data. All data in a Python
7program is represented by objects or by relations between objects.
8(In a sense, and in conformance to Von Neumann's model of a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00009``stored program computer,'' code is also represented by objects.)
Fred Drakef6669171998-05-06 19:52:49 +000010\index{object}
11\index{data}
12
13Every object has an identity, a type and a value. An object's
14\emph{identity} never changes once it has been created; you may think
Fred Drake293dd4b2002-06-04 16:25:57 +000015of it as the object's address in memory. The `\keyword{is}' operator
Fred Drake82385871998-10-01 20:40:43 +000016compares the identity of two objects; the
17\function{id()}\bifuncindex{id} function returns an integer
18representing its identity (currently implemented as its address).
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000019An object's \dfn{type} is
Raymond Hettingere701dcb2003-01-19 13:08:18 +000020also unchangeable.\footnote{Since Python 2.2, a gradual merging of
21types and classes has been started that makes this and a few other
22assertions made in this manual not 100\% accurate and complete:
23for example, it \emph{is} now possible in some cases to change an
24object's type, under certain controlled conditions. Until this manual
25undergoes extensive revision, it must now be taken as authoritative
26only regarding ``classic classes'', that are still the default, for
Armin Rigoddddd2f2005-12-26 18:06:17 +000027compatibility purposes, in Python 2.2 and 2.3. For more information,
28see \url{http://www.python.org/doc/newstyle.html}.}
Raymond Hettingere701dcb2003-01-19 13:08:18 +000029An object's type determines the operations that the object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000030supports (e.g., ``does it have a length?'') and also defines the
Fred Drake82385871998-10-01 20:40:43 +000031possible values for objects of that type. The
32\function{type()}\bifuncindex{type} function returns an object's type
33(which is an object itself). The \emph{value} of some
Fred Drakef6669171998-05-06 19:52:49 +000034objects can change. Objects whose value can change are said to be
35\emph{mutable}; objects whose value is unchangeable once they are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000036created are called \emph{immutable}.
Guido van Rossum264bd591999-02-23 16:40:55 +000037(The value of an immutable container object that contains a reference
38to a mutable object can change when the latter's value is changed;
39however the container is still considered immutable, because the
40collection of objects it contains cannot be changed. So, immutability
41is not strictly the same as having an unchangeable value, it is more
42subtle.)
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000043An object's mutability is determined by its type; for instance,
44numbers, strings and tuples are immutable, while dictionaries and
45lists are mutable.
Fred Drakef6669171998-05-06 19:52:49 +000046\index{identity of an object}
47\index{value of an object}
48\index{type of an object}
49\index{mutable object}
50\index{immutable object}
51
52Objects are never explicitly destroyed; however, when they become
53unreachable they may be garbage-collected. An implementation is
Barry Warsaw92a6ed91998-08-07 16:33:51 +000054allowed to postpone garbage collection or omit it altogether --- it is
55a matter of implementation quality how garbage collection is
Fred Drakef6669171998-05-06 19:52:49 +000056implemented, as long as no objects are collected that are still
57reachable. (Implementation note: the current implementation uses a
Fred Drakec8e82812001-01-22 17:46:18 +000058reference-counting scheme with (optional) delayed detection of
Raymond Hettingere701dcb2003-01-19 13:08:18 +000059cyclically linked garbage, which collects most objects as soon as they
Fred Drakec8e82812001-01-22 17:46:18 +000060become unreachable, but is not guaranteed to collect garbage
61containing circular references. See the
62\citetitle[../lib/module-gc.html]{Python Library Reference} for
63information on controlling the collection of cyclic garbage.)
Fred Drakef6669171998-05-06 19:52:49 +000064\index{garbage collection}
65\index{reference counting}
66\index{unreachable object}
67
68Note that the use of the implementation's tracing or debugging
69facilities may keep objects alive that would normally be collectable.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000070Also note that catching an exception with a
Fred Drake4856d011999-01-12 04:15:20 +000071`\keyword{try}...\keyword{except}' statement may keep objects alive.
Fred Drakef6669171998-05-06 19:52:49 +000072
73Some objects contain references to ``external'' resources such as open
74files or windows. It is understood that these resources are freed
75when the object is garbage-collected, but since garbage collection is
76not guaranteed to happen, such objects also provide an explicit way to
77release the external resource, usually a \method{close()} method.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000078Programs are strongly recommended to explicitly close such
Fred Drake4856d011999-01-12 04:15:20 +000079objects. The `\keyword{try}...\keyword{finally}' statement provides
80a convenient way to do this.
Fred Drakef6669171998-05-06 19:52:49 +000081
82Some objects contain references to other objects; these are called
83\emph{containers}. Examples of containers are tuples, lists and
84dictionaries. The references are part of a container's value. In
85most cases, when we talk about the value of a container, we imply the
86values, not the identities of the contained objects; however, when we
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000087talk about the mutability of a container, only the identities of
88the immediately contained objects are implied. So, if an immutable
89container (like a tuple)
90contains a reference to a mutable object, its value changes
91if that mutable object is changed.
Fred Drakef6669171998-05-06 19:52:49 +000092\index{container}
93
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000094Types affect almost all aspects of object behavior. Even the importance
Fred Drakef6669171998-05-06 19:52:49 +000095of object identity is affected in some sense: for immutable types,
96operations that compute new values may actually return a reference to
97any existing object with the same type and value, while for mutable
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000098objects this is not allowed. E.g., after
Fred Drake82385871998-10-01 20:40:43 +000099\samp{a = 1; b = 1},
Fred Drakef6669171998-05-06 19:52:49 +0000100\code{a} and \code{b} may or may not refer to the same object with the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000101value one, depending on the implementation, but after
Fred Drake82385871998-10-01 20:40:43 +0000102\samp{c = []; d = []}, \code{c} and \code{d}
Fred Drakef6669171998-05-06 19:52:49 +0000103are guaranteed to refer to two different, unique, newly created empty
104lists.
Fred Drake82385871998-10-01 20:40:43 +0000105(Note that \samp{c = d = []} assigns the same object to both
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000106\code{c} and \code{d}.)
Fred Drakef6669171998-05-06 19:52:49 +0000107
Fred Drake2829f1c2001-06-23 05:27:20 +0000108
Fred Drake61c77281998-07-28 19:34:22 +0000109\section{The standard type hierarchy\label{types}}
Fred Drakef6669171998-05-06 19:52:49 +0000110
111Below is a list of the types that are built into Python. Extension
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000112modules (written in C, Java, or other languages, depending on
113the implementation) can define additional types. Future versions of
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000114Python may add types to the type hierarchy (e.g., rational
Fred Drakef6669171998-05-06 19:52:49 +0000115numbers, efficiently stored arrays of integers, etc.).
116\index{type}
117\indexii{data}{type}
118\indexii{type}{hierarchy}
119\indexii{extension}{module}
120\indexii{C}{language}
121
122Some of the type descriptions below contain a paragraph listing
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000123`special attributes.' These are attributes that provide access to the
Fred Drakef6669171998-05-06 19:52:49 +0000124implementation and are not intended for general use. Their definition
Fred Drake35705512001-12-03 17:32:27 +0000125may change in the future.
Fred Drakef6669171998-05-06 19:52:49 +0000126\index{attribute}
127\indexii{special}{attribute}
128\indexiii{generic}{special}{attribute}
Fred Drakef6669171998-05-06 19:52:49 +0000129
130\begin{description}
131
132\item[None]
133This type has a single value. There is a single object with this value.
134This object is accessed through the built-in name \code{None}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000135It is used to signify the absence of a value in many situations, e.g.,
136it is returned from functions that don't explicitly return anything.
137Its truth value is false.
Fred Drake7a700b82004-01-01 05:43:53 +0000138\obindex{None}
Fred Drakef6669171998-05-06 19:52:49 +0000139
Neil Schemenauer48c2eb92001-01-04 01:25:50 +0000140\item[NotImplemented]
141This type has a single value. There is a single object with this value.
142This object is accessed through the built-in name \code{NotImplemented}.
Guido van Rossumab782dd2001-01-18 15:17:06 +0000143Numeric methods and rich comparison methods may return this value if
144they do not implement the operation for the operands provided. (The
145interpreter will then try the reflected operation, or some other
146fallback, depending on the operator.) Its truth value is true.
Fred Drake7a700b82004-01-01 05:43:53 +0000147\obindex{NotImplemented}
Neil Schemenauer48c2eb92001-01-04 01:25:50 +0000148
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000149\item[Ellipsis]
150This type has a single value. There is a single object with this value.
Georg Brandl52318d62006-09-06 07:06:08 +0000151This object is accessed through the literal \code{...} or the
152built-in name \code{Ellipsis}. Its truth value is true.
Fred Drakec0a02c02002-04-16 02:03:05 +0000153\obindex{Ellipsis}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000154
Fred Drakef6669171998-05-06 19:52:49 +0000155\item[Numbers]
156These are created by numeric literals and returned as results by
157arithmetic operators and arithmetic built-in functions. Numeric
158objects are immutable; once created their value never changes. Python
159numbers are of course strongly related to mathematical numbers, but
160subject to the limitations of numerical representation in computers.
Fred Drakef6669171998-05-06 19:52:49 +0000161\obindex{numeric}
162
Fred Drakeb3384d32001-05-14 16:04:22 +0000163Python distinguishes between integers, floating point numbers, and
164complex numbers:
Fred Drakef6669171998-05-06 19:52:49 +0000165
166\begin{description}
167\item[Integers]
Georg Brandld4307262005-09-12 12:49:38 +0000168These represent elements from the mathematical set of integers
169(positive and negative).
Fred Drakef6669171998-05-06 19:52:49 +0000170\obindex{integer}
171
Guido van Rossum77f6a652002-04-03 22:41:51 +0000172There are three types of integers:
Fred Drakef6669171998-05-06 19:52:49 +0000173
174\begin{description}
175
176\item[Plain integers]
177These represent numbers in the range -2147483648 through 2147483647.
178(The range may be larger on machines with a larger natural word
179size, but not smaller.)
Fred Drakee15956b2000-04-03 04:51:13 +0000180When the result of an operation would fall outside this range, the
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000181result is normally returned as a long integer (in some cases, the
182exception \exception{OverflowError} is raised instead).
Fred Drakef6669171998-05-06 19:52:49 +0000183For the purpose of shift and mask operations, integers are assumed to
184have a binary, 2's complement notation using 32 or more bits, and
185hiding no bits from the user (i.e., all 4294967296 different bit
186patterns correspond to different values).
187\obindex{plain integer}
188\withsubitem{(built-in exception)}{\ttindex{OverflowError}}
189
190\item[Long integers]
191These represent numbers in an unlimited range, subject to available
192(virtual) memory only. For the purpose of shift and mask operations,
193a binary representation is assumed, and negative numbers are
194represented in a variant of 2's complement which gives the illusion of
195an infinite string of sign bits extending to the left.
196\obindex{long integer}
197
Guido van Rossum77f6a652002-04-03 22:41:51 +0000198\item[Booleans]
199These represent the truth values False and True. The two objects
200representing the values False and True are the only Boolean objects.
201The Boolean type is a subtype of plain integers, and Boolean values
202behave like the values 0 and 1, respectively, in almost all contexts,
203the exception being that when converted to a string, the strings
204\code{"False"} or \code{"True"} are returned, respectively.
205\obindex{Boolean}
206\ttindex{False}
207\ttindex{True}
208
Fred Drakef6669171998-05-06 19:52:49 +0000209\end{description} % Integers
210
211The rules for integer representation are intended to give the most
212meaningful interpretation of shift and mask operations involving
213negative integers and the least surprises when switching between the
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000214plain and long integer domains. Any operation except left shift,
Fred Drakef6669171998-05-06 19:52:49 +0000215if it yields a result in the plain integer domain without causing
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000216overflow, will yield the same result in the long integer domain or
Fred Drakef6669171998-05-06 19:52:49 +0000217when using mixed operands.
218\indexii{integer}{representation}
219
220\item[Floating point numbers]
Guido van Rossumd8faa362007-04-27 19:54:29 +0000221These represent machine-level double precision floating point numbers.
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000222You are at the mercy of the underlying machine architecture (and
223C or Java implementation) for the accepted range and handling of overflow.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000224Python does not support single-precision floating point numbers; the
Fred Drake6e5e1d92001-07-14 02:12:27 +0000225savings in processor and memory usage that are usually the reason for using
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000226these is dwarfed by the overhead of using objects in Python, so there
227is no reason to complicate the language with two kinds of floating
228point numbers.
Fred Drakef6669171998-05-06 19:52:49 +0000229\obindex{floating point}
230\indexii{floating point}{number}
231\indexii{C}{language}
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000232\indexii{Java}{language}
Fred Drakef6669171998-05-06 19:52:49 +0000233
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000234\item[Complex numbers]
235These represent complex numbers as a pair of machine-level double
236precision floating point numbers. The same caveats apply as for
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000237floating point numbers. The real and imaginary parts of a complex
238number \code{z} can be retrieved through the read-only attributes
239\code{z.real} and \code{z.imag}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000240\obindex{complex}
241\indexii{complex}{number}
242
Fred Drakef6669171998-05-06 19:52:49 +0000243\end{description} % Numbers
244
Guido van Rossum77f6a652002-04-03 22:41:51 +0000245
Fred Drakef6669171998-05-06 19:52:49 +0000246\item[Sequences]
Fred Drake230d17d2001-02-22 21:28:04 +0000247These represent finite ordered sets indexed by non-negative numbers.
Fred Drakef6669171998-05-06 19:52:49 +0000248The built-in function \function{len()}\bifuncindex{len} returns the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000249number of items of a sequence.
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000250When the length of a sequence is \var{n}, the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000251index set contains the numbers 0, 1, \ldots, \var{n}-1. Item
Fred Drakef6669171998-05-06 19:52:49 +0000252\var{i} of sequence \var{a} is selected by \code{\var{a}[\var{i}]}.
Fred Drakee15956b2000-04-03 04:51:13 +0000253\obindex{sequence}
Fred Drakef6669171998-05-06 19:52:49 +0000254\index{index operation}
255\index{item selection}
256\index{subscription}
257
258Sequences also support slicing: \code{\var{a}[\var{i}:\var{j}]}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000259selects all items with index \var{k} such that \var{i} \code{<=}
Fred Drakef6669171998-05-06 19:52:49 +0000260\var{k} \code{<} \var{j}. When used as an expression, a slice is a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000261sequence of the same type. This implies that the index set is
262renumbered so that it starts at 0.
Fred Drakef6669171998-05-06 19:52:49 +0000263\index{slicing}
264
Michael W. Hudson5efaf7e2002-06-11 10:55:12 +0000265Some sequences also support ``extended slicing'' with a third ``step''
266parameter: \code{\var{a}[\var{i}:\var{j}:\var{k}]} selects all items
267of \var{a} with index \var{x} where \code{\var{x} = \var{i} +
268\var{n}*\var{k}}, \var{n} \code{>=} \code{0} and \var{i} \code{<=}
269\var{x} \code{<} \var{j}.
270\index{extended slicing}
271
Fred Drakef6669171998-05-06 19:52:49 +0000272Sequences are distinguished according to their mutability:
273
274\begin{description}
Fred Drake4856d011999-01-12 04:15:20 +0000275
Fred Drakef6669171998-05-06 19:52:49 +0000276\item[Immutable sequences]
277An object of an immutable sequence type cannot change once it is
278created. (If the object contains references to other objects,
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000279these other objects may be mutable and may be changed; however,
Fred Drakef6669171998-05-06 19:52:49 +0000280the collection of objects directly referenced by an immutable object
281cannot change.)
282\obindex{immutable sequence}
283\obindex{immutable}
284
285The following types are immutable sequences:
286
287\begin{description}
288
289\item[Strings]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000290The items of a string are characters. There is no separate
291character type; a character is represented by a string of one item.
Fred Drakef6669171998-05-06 19:52:49 +0000292Characters represent (at least) 8-bit bytes. The built-in
293functions \function{chr()}\bifuncindex{chr} and
294\function{ord()}\bifuncindex{ord} convert between characters and
295nonnegative integers representing the byte values. Bytes with the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000296values 0-127 usually represent the corresponding \ASCII{} values, but
297the interpretation of values is up to the program. The string
298data type is also used to represent arrays of bytes, e.g., to hold data
Fred Drakef6669171998-05-06 19:52:49 +0000299read from a file.
300\obindex{string}
301\index{character}
302\index{byte}
Fred Drakec37b65e2001-11-28 07:26:15 +0000303\index{ASCII@\ASCII}
Fred Drakef6669171998-05-06 19:52:49 +0000304
Fred Drakec37b65e2001-11-28 07:26:15 +0000305(On systems whose native character set is not \ASCII, strings may use
Fred Drakef6669171998-05-06 19:52:49 +0000306EBCDIC in their internal representation, provided the functions
307\function{chr()} and \function{ord()} implement a mapping between \ASCII{} and
308EBCDIC, and string comparison preserves the \ASCII{} order.
309Or perhaps someone can propose a better rule?)
Fred Drakec37b65e2001-11-28 07:26:15 +0000310\index{ASCII@\ASCII}
Fred Drakef6669171998-05-06 19:52:49 +0000311\index{EBCDIC}
312\index{character set}
313\indexii{string}{comparison}
314\bifuncindex{chr}
315\bifuncindex{ord}
316
Fred Drakef0aff8e2000-04-06 13:57:21 +0000317\item[Unicode]
Fred Drake5ec22f22002-09-24 21:09:13 +0000318The items of a Unicode object are Unicode code units. A Unicode code
319unit is represented by a Unicode object of one item and can hold
320either a 16-bit or 32-bit value representing a Unicode ordinal (the
321maximum value for the ordinal is given in \code{sys.maxunicode}, and
322depends on how Python is configured at compile time). Surrogate pairs
323may be present in the Unicode object, and will be reported as two
324separate items. The built-in functions
Fred Drakef0aff8e2000-04-06 13:57:21 +0000325\function{unichr()}\bifuncindex{unichr} and
Fred Drake5ec22f22002-09-24 21:09:13 +0000326\function{ord()}\bifuncindex{ord} convert between code units and
Fred Drakef0aff8e2000-04-06 13:57:21 +0000327nonnegative integers representing the Unicode ordinals as defined in
328the Unicode Standard 3.0. Conversion from and to other encodings are
Fred Drakeb3dfc0a2005-09-07 04:57:56 +0000329possible through the Unicode method \method{encode()} and the built-in
Fred Drake5ec22f22002-09-24 21:09:13 +0000330function \function{unicode()}.\bifuncindex{unicode}
Fred Drakef0aff8e2000-04-06 13:57:21 +0000331\obindex{unicode}
332\index{character}
333\index{integer}
Fred Drake8b3ce9e2000-04-06 14:00:14 +0000334\index{Unicode}
Fred Drakef0aff8e2000-04-06 13:57:21 +0000335
Fred Drakef6669171998-05-06 19:52:49 +0000336\item[Tuples]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000337The items of a tuple are arbitrary Python objects.
338Tuples of two or more items are formed by comma-separated lists
339of expressions. A tuple of one item (a `singleton') can be formed
Fred Drakef6669171998-05-06 19:52:49 +0000340by affixing a comma to an expression (an expression by itself does
341not create a tuple, since parentheses must be usable for grouping of
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000342expressions). An empty tuple can be formed by an empty pair of
Fred Drakef6669171998-05-06 19:52:49 +0000343parentheses.
344\obindex{tuple}
345\indexii{singleton}{tuple}
346\indexii{empty}{tuple}
347
348\end{description} % Immutable sequences
349
350\item[Mutable sequences]
351Mutable sequences can be changed after they are created. The
352subscription and slicing notations can be used as the target of
353assignment and \keyword{del} (delete) statements.
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000354\obindex{mutable sequence}
Fred Drakef6669171998-05-06 19:52:49 +0000355\obindex{mutable}
356\indexii{assignment}{statement}
357\index{delete}
358\stindex{del}
359\index{subscription}
360\index{slicing}
361
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000362There is currently a single intrinsic mutable sequence type:
Fred Drakef6669171998-05-06 19:52:49 +0000363
364\begin{description}
365
366\item[Lists]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000367The items of a list are arbitrary Python objects. Lists are formed
Fred Drakef6669171998-05-06 19:52:49 +0000368by placing a comma-separated list of expressions in square brackets.
369(Note that there are no special cases needed to form lists of length 0
370or 1.)
371\obindex{list}
372
373\end{description} % Mutable sequences
374
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000375The extension module \module{array}\refstmodindex{array} provides an
376additional example of a mutable sequence type.
377
378
Fred Drakef6669171998-05-06 19:52:49 +0000379\end{description} % Sequences
380
Thomas Wouters89f507f2006-12-13 04:49:30 +0000381
382\item[Set types]
383These represent unordered, finite sets of unique, immutable objects.
384As such, they cannot be indexed by any subscript. However, they can be
385iterated over, and the built-in function \function{len()} returns the
386number of items in a set. Common uses for sets are
387fast membership testing, removing duplicates from a sequence, and
388computing mathematical operations such as intersection, union, difference,
389and symmetric difference.
390\bifuncindex{len}
391\obindex{set type}
392
393For set elements, the same immutability rules apply as for dictionary
394keys. Note that numeric types obey the normal rules for numeric
395comparison: if two numbers compare equal (e.g., \code{1} and
396\code{1.0}), only one of them can be contained in a set.
397
398There are currently two intrinsic set types:
399
400\begin{description}
401
402\item[Sets]
403These\obindex{set} represent a mutable set. They are created by the
404built-in \function{set()} constructor and can be modified afterwards
405by several methods, such as \method{add()}.
406
407\item[Frozen sets]
408These\obindex{frozenset} represent an immutable set. They are created by
409the built-in \function{frozenset()} constructor. As a frozenset is
410immutable and hashable, it can be used again as an element of another set,
411or as a dictionary key.
412
413\end{description} % Set types
414
415
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000416\item[Mappings]
Fred Drakef6669171998-05-06 19:52:49 +0000417These represent finite sets of objects indexed by arbitrary index sets.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000418The subscript notation \code{a[k]} selects the item indexed
Fred Drakef6669171998-05-06 19:52:49 +0000419by \code{k} from the mapping \code{a}; this can be used in
420expressions and as the target of assignments or \keyword{del} statements.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000421The built-in function \function{len()} returns the number of items
Fred Drakef6669171998-05-06 19:52:49 +0000422in a mapping.
423\bifuncindex{len}
424\index{subscription}
425\obindex{mapping}
426
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000427There is currently a single intrinsic mapping type:
Fred Drakef6669171998-05-06 19:52:49 +0000428
429\begin{description}
430
431\item[Dictionaries]
Fred Drake8cdee961999-02-23 18:50:38 +0000432These\obindex{dictionary} represent finite sets of objects indexed by
433nearly arbitrary values. The only types of values not acceptable as
434keys are values containing lists or dictionaries or other mutable
435types that are compared by value rather than by object identity, the
436reason being that the efficient implementation of dictionaries
437requires a key's hash value to remain constant.
Fred Drakef6669171998-05-06 19:52:49 +0000438Numeric types used for keys obey the normal rules for numeric
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000439comparison: if two numbers compare equal (e.g., \code{1} and
Fred Drakef6669171998-05-06 19:52:49 +0000440\code{1.0}) then they can be used interchangeably to index the same
441dictionary entry.
442
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000443Dictionaries are mutable; they can be created by the
Fred Drake62364ff2003-03-20 18:17:16 +0000444\code{\{...\}} notation (see section~\ref{dict}, ``Dictionary
Fred Drake8cdee961999-02-23 18:50:38 +0000445Displays'').
Fred Drakef6669171998-05-06 19:52:49 +0000446
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000447The extension modules \module{dbm}\refstmodindex{dbm},
Fred Drake59c61912005-10-30 04:29:49 +0000448\module{gdbm}\refstmodindex{gdbm}, and
449\module{bsddb}\refstmodindex{bsddb} provide additional examples of
450mapping types.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000451
Fred Drakef6669171998-05-06 19:52:49 +0000452\end{description} % Mapping types
453
454\item[Callable types]
Fred Drake8cdee961999-02-23 18:50:38 +0000455These\obindex{callable} are the types to which the function call
Fred Drake62364ff2003-03-20 18:17:16 +0000456operation (see section~\ref{calls}, ``Calls'') can be applied:
Fred Drakef6669171998-05-06 19:52:49 +0000457\indexii{function}{call}
458\index{invocation}
459\indexii{function}{argument}
Fred Drakef6669171998-05-06 19:52:49 +0000460
461\begin{description}
462
463\item[User-defined functions]
464A user-defined function object is created by a function definition
Fred Drake62364ff2003-03-20 18:17:16 +0000465(see section~\ref{function}, ``Function definitions''). It should be
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000466called with an argument
Fred Drakef6669171998-05-06 19:52:49 +0000467list containing the same number of items as the function's formal
468parameter list.
469\indexii{user-defined}{function}
470\obindex{function}
471\obindex{user-defined function}
472
Guido van Rossumd8faa362007-04-27 19:54:29 +0000473Special attributes:
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000474
Michael W. Hudson5e897952004-08-12 18:12:44 +0000475\begin{tableiii}{lll}{member}{Attribute}{Meaning}{}
Neal Norwitz221085d2007-02-25 20:55:47 +0000476 \lineiii{__doc__}{The function's documentation string, or
Michael W. Hudson5e897952004-08-12 18:12:44 +0000477 \code{None} if unavailable}{Writable}
478
Neal Norwitz221085d2007-02-25 20:55:47 +0000479 \lineiii{__name__}{The function's name}{Writable}
Michael W. Hudson5e897952004-08-12 18:12:44 +0000480
481 \lineiii{__module__}{The name of the module the function was defined
482 in, or \code{None} if unavailable.}{Writable}
483
Neal Norwitz221085d2007-02-25 20:55:47 +0000484 \lineiii{__defaults__}{A tuple containing default argument values
Michael W. Hudson5e897952004-08-12 18:12:44 +0000485 for those arguments that have defaults, or \code{None} if no
486 arguments have a default value}{Writable}
487
Neal Norwitz221085d2007-02-25 20:55:47 +0000488 \lineiii{__code__}{The code object representing the compiled
Michael W. Hudson5e897952004-08-12 18:12:44 +0000489 function body.}{Writable}
490
Neal Norwitz221085d2007-02-25 20:55:47 +0000491 \lineiii{__globals__}{A reference to the dictionary that holds the
Michael W. Hudson5e897952004-08-12 18:12:44 +0000492 function's global variables --- the global namespace of the module
493 in which the function was defined.}{Read-only}
494
Neal Norwitz221085d2007-02-25 20:55:47 +0000495 \lineiii{__dict__}{The namespace supporting arbitrary function
Michael W. Hudson5e897952004-08-12 18:12:44 +0000496 attributes.}{Writable}
497
Neal Norwitz221085d2007-02-25 20:55:47 +0000498 \lineiii{__closure__}{\code{None} or a tuple of cells that contain
Michael W. Hudson5e897952004-08-12 18:12:44 +0000499 bindings for the function's free variables.}{Read-only}
Neal Norwitz221085d2007-02-25 20:55:47 +0000500
501 \lineiii{__annotations__}{A dict containing annotations of parameters.}
502 {Writable}
503
504 \lineiii{__kwdefaults__}{A dict containing defaults for keyword-only
505 parameters.}{Writable}
Michael W. Hudson5e897952004-08-12 18:12:44 +0000506\end{tableiii}
507
508Most of the attributes labelled ``Writable'' check the type of the
509assigned value.
510
Neal Norwitz221085d2007-02-25 20:55:47 +0000511\versionchanged[\code{__name__} is now writable]{2.4}
Michael W. Hudson5e897952004-08-12 18:12:44 +0000512
513Function objects also support getting and setting arbitrary
514attributes, which can be used, for example, to attach metadata to
515functions. Regular attribute dot-notation is used to get and set such
516attributes. \emph{Note that the current implementation only supports
517function attributes on user-defined functions. Function attributes on
518built-in functions may be supported in the future.}
519
520Additional information about a function's definition can be retrieved
521from its code object; see the description of internal types below.
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000522
Fred Drake4856d011999-01-12 04:15:20 +0000523\withsubitem{(function attribute)}{
Fred Drake4856d011999-01-12 04:15:20 +0000524 \ttindex{__doc__}
525 \ttindex{__name__}
Jeremy Hyltonf9b0cc72003-01-31 18:52:45 +0000526 \ttindex{__module__}
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000527 \ttindex{__dict__}
Neal Norwitz221085d2007-02-25 20:55:47 +0000528 \ttindex{__defaults__}
529 \ttindex{__closure__}
530 \ttindex{__code__}
531 \ttindex{__globals__}
532 \ttindex{__annotations__}
George Yoshida5e0af3c2007-02-26 01:58:37 +0000533 \ttindex{__kwdefaults__}}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000534\indexii{global}{namespace}
Fred Drakef6669171998-05-06 19:52:49 +0000535
536\item[User-defined methods]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000537A user-defined method object combines a class, a class instance (or
Fred Drake8dd6ffd2001-08-02 21:34:53 +0000538\code{None}) and any callable object (normally a user-defined
539function).
Fred Drakef6669171998-05-06 19:52:49 +0000540\obindex{method}
541\obindex{user-defined method}
542\indexii{user-defined}{method}
Fred Drakef6669171998-05-06 19:52:49 +0000543
544Special read-only attributes: \member{im_self} is the class instance
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000545object, \member{im_func} is the function object;
Raymond Hettinger03ec6d52003-06-25 18:29:36 +0000546\member{im_class} is the class of \member{im_self} for bound methods
547or the class that asked for the method for unbound methods;
Fred Drake82385871998-10-01 20:40:43 +0000548\member{__doc__} is the method's documentation (same as
549\code{im_func.__doc__}); \member{__name__} is the method name (same as
Jeremy Hyltonf9b0cc72003-01-31 18:52:45 +0000550\code{im_func.__name__}); \member{__module__} is the name of the
551module the method was defined in, or \code{None} if unavailable.
Fred Drakef9d58032001-12-07 23:13:53 +0000552\versionchanged[\member{im_self} used to refer to the class that
553 defined the method]{2.2}
Fred Drake4856d011999-01-12 04:15:20 +0000554\withsubitem{(method attribute)}{
Jeremy Hyltonf9b0cc72003-01-31 18:52:45 +0000555 \ttindex{__doc__}
556 \ttindex{__name__}
557 \ttindex{__module__}
Fred Drake4856d011999-01-12 04:15:20 +0000558 \ttindex{im_func}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000559 \ttindex{im_self}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000560
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000561Methods also support accessing (but not setting) the arbitrary
562function attributes on the underlying function object.
563
Fred Drakeea690c42003-07-17 05:26:53 +0000564User-defined method objects may be created when getting an attribute
565of a class (perhaps via an instance of that class), if that attribute
566is a user-defined function object, an unbound user-defined method object,
567or a class method object.
568When the attribute is a user-defined method object, a new
569method object is only created if the class from which it is being
570retrieved is the same as, or a derived class of, the class stored
571in the original method object; otherwise, the original method object
572is used as it is.
573
574When a user-defined method object is created by retrieving
575a user-defined function object from a class, its \member{im_self}
576attribute is \code{None} and the method object is said to be unbound.
577When one is created by retrieving a user-defined function object
578from a class via one of its instances, its \member{im_self} attribute
579is the instance, and the method object is said to be bound.
580In either case, the new method's \member{im_class} attribute
581is the class from which the retrieval takes place, and
582its \member{im_func} attribute is the original function object.
583\withsubitem{(method attribute)}{
584 \ttindex{im_class}\ttindex{im_func}\ttindex{im_self}}
585
586When a user-defined method object is created by retrieving another
587method object from a class or instance, the behaviour is the same
588as for a function object, except that the \member{im_func} attribute
589of the new instance is not the original method object but its
590\member{im_func} attribute.
591\withsubitem{(method attribute)}{
592 \ttindex{im_func}}
593
594When a user-defined method object is created by retrieving a
595class method object from a class or instance, its \member{im_self}
596attribute is the class itself (the same as the \member{im_class}
597attribute), and its \member{im_func} attribute is the function
598object underlying the class method.
Fred Drake4856d011999-01-12 04:15:20 +0000599\withsubitem{(method attribute)}{
Fred Drake35c09f22000-06-28 20:15:47 +0000600 \ttindex{im_class}\ttindex{im_func}\ttindex{im_self}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000601
602When an unbound user-defined method object is called, the underlying
Fred Drake82385871998-10-01 20:40:43 +0000603function (\member{im_func}) is called, with the restriction that the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000604first argument must be an instance of the proper class
Fred Drake82385871998-10-01 20:40:43 +0000605(\member{im_class}) or of a derived class thereof.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000606
607When a bound user-defined method object is called, the underlying
Fred Drake82385871998-10-01 20:40:43 +0000608function (\member{im_func}) is called, inserting the class instance
609(\member{im_self}) in front of the argument list. For instance, when
610\class{C} is a class which contains a definition for a function
611\method{f()}, and \code{x} is an instance of \class{C}, calling
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000612\code{x.f(1)} is equivalent to calling \code{C.f(x, 1)}.
613
Fred Drakeea690c42003-07-17 05:26:53 +0000614When a user-defined method object is derived from a class method object,
615the ``class instance'' stored in \member{im_self} will actually be the
616class itself, so that calling either \code{x.f(1)} or \code{C.f(1)} is
617equivalent to calling \code{f(C,1)} where \code{f} is the underlying
618function.
619
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000620Note that the transformation from function object to (unbound or
621bound) method object happens each time the attribute is retrieved from
622the class or instance. In some cases, a fruitful optimization is to
623assign the attribute to a local variable and call that local variable.
624Also notice that this transformation only happens for user-defined
625functions; other callable objects (and all non-callable objects) are
Fred Drake35c09f22000-06-28 20:15:47 +0000626retrieved without transformation. It is also important to note that
627user-defined functions which are attributes of a class instance are
628not converted to bound methods; this \emph{only} happens when the
629function is an attribute of the class.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000630
Fred Drakee31e9ce2001-12-11 21:10:08 +0000631\item[Generator functions\index{generator!function}\index{generator!iterator}]
632A function or method which uses the \keyword{yield} statement (see
633section~\ref{yield}, ``The \keyword{yield} statement'') is called a
634\dfn{generator function}. Such a function, when called, always
635returns an iterator object which can be used to execute the body of
Georg Brandla18af4e2007-04-21 15:47:16 +0000636the function: calling the iterator's \method{__next__()} method will
Fred Drakee31e9ce2001-12-11 21:10:08 +0000637cause the function to execute until it provides a value using the
638\keyword{yield} statement. When the function executes a
639\keyword{return} statement or falls off the end, a
640\exception{StopIteration} exception is raised and the iterator will
641have reached the end of the set of values to be returned.
642
Fred Drakef6669171998-05-06 19:52:49 +0000643\item[Built-in functions]
Georg Brandl1c330eb2005-07-02 10:27:31 +0000644A built-in function object is a wrapper around a C function. Examples
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000645of built-in functions are \function{len()} and \function{math.sin()}
646(\module{math} is a standard built-in module).
647The number and type of the arguments are
Fred Drakef6669171998-05-06 19:52:49 +0000648determined by the C function.
Fred Drake82385871998-10-01 20:40:43 +0000649Special read-only attributes: \member{__doc__} is the function's
650documentation string, or \code{None} if unavailable; \member{__name__}
651is the function's name; \member{__self__} is set to \code{None} (but see
Jeremy Hyltonf9b0cc72003-01-31 18:52:45 +0000652the next item); \member{__module__} is the name of the module the
653function was defined in or \code{None} if unavailable.
Fred Drakef6669171998-05-06 19:52:49 +0000654\obindex{built-in function}
655\obindex{function}
656\indexii{C}{language}
657
658\item[Built-in methods]
659This is really a different disguise of a built-in function, this time
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000660containing an object passed to the C function as an implicit extra
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000661argument. An example of a built-in method is
Raymond Hettingere701dcb2003-01-19 13:08:18 +0000662\code{\var{alist}.append()}, assuming
663\var{alist} is a list object.
Fred Drake82385871998-10-01 20:40:43 +0000664In this case, the special read-only attribute \member{__self__} is set
Fred Drakee31e9ce2001-12-11 21:10:08 +0000665to the object denoted by \var{list}.
Fred Drakef6669171998-05-06 19:52:49 +0000666\obindex{built-in method}
667\obindex{method}
668\indexii{built-in}{method}
669
Fred Drakee37b4ed2003-07-15 20:45:16 +0000670\item[Class Types]
671Class types, or ``new-style classes,'' are callable. These objects
672normally act as factories for new instances of themselves, but
673variations are possible for class types that override
674\method{__new__()}. The arguments of the call are passed to
675\method{__new__()} and, in the typical case, to \method{__init__()} to
676initialize the new instance.
677
678\item[Classic Classes]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000679Class objects are described below. When a class object is called,
680a new class instance (also described below) is created and
Fred Drakef6669171998-05-06 19:52:49 +0000681returned. This implies a call to the class's \method{__init__()} method
682if it has one. Any arguments are passed on to the \method{__init__()}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000683method. If there is no \method{__init__()} method, the class must be called
Fred Drakef6669171998-05-06 19:52:49 +0000684without arguments.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000685\withsubitem{(object method)}{\ttindex{__init__()}}
Fred Drakef6669171998-05-06 19:52:49 +0000686\obindex{class}
687\obindex{class instance}
688\obindex{instance}
689\indexii{class object}{call}
690
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000691\item[Class instances]
692Class instances are described below. Class instances are callable
Fred Drake82385871998-10-01 20:40:43 +0000693only when the class has a \method{__call__()} method; \code{x(arguments)}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000694is a shorthand for \code{x.__call__(arguments)}.
695
Fred Drakef6669171998-05-06 19:52:49 +0000696\end{description}
697
698\item[Modules]
Fred Drake62364ff2003-03-20 18:17:16 +0000699Modules are imported by the \keyword{import} statement (see
Fred Draked51ce7d2003-07-15 22:03:00 +0000700section~\ref{import}, ``The \keyword{import} statement'').%
701\stindex{import}\obindex{module}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000702A module object has a namespace implemented by a dictionary object
Neal Norwitz221085d2007-02-25 20:55:47 +0000703(this is the dictionary referenced by the __globals__ attribute of
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000704functions defined in the module). Attribute references are translated
705to lookups in this dictionary, e.g., \code{m.x} is equivalent to
706\code{m.__dict__["x"]}.
707A module object does not contain the code object used to
Fred Drakef6669171998-05-06 19:52:49 +0000708initialize the module (since it isn't needed once the initialization
709is done).
Fred Drakef6669171998-05-06 19:52:49 +0000710
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000711Attribute assignment updates the module's namespace dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000712e.g., \samp{m.x = 1} is equivalent to \samp{m.__dict__["x"] = 1}.
Fred Drakef6669171998-05-06 19:52:49 +0000713
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000714Special read-only attribute: \member{__dict__} is the module's
715namespace as a dictionary object.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000716\withsubitem{(module attribute)}{\ttindex{__dict__}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000717
718Predefined (writable) attributes: \member{__name__}
719is the module's name; \member{__doc__} is the
720module's documentation string, or
Fred Drake82385871998-10-01 20:40:43 +0000721\code{None} if unavailable; \member{__file__} is the pathname of the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000722file from which the module was loaded, if it was loaded from a file.
Fred Drake82385871998-10-01 20:40:43 +0000723The \member{__file__} attribute is not present for C{} modules that are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000724statically linked into the interpreter; for extension modules loaded
725dynamically from a shared library, it is the pathname of the shared
726library file.
Fred Drake4856d011999-01-12 04:15:20 +0000727\withsubitem{(module attribute)}{
728 \ttindex{__name__}
729 \ttindex{__doc__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000730 \ttindex{__file__}}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000731\indexii{module}{namespace}
Fred Drakef6669171998-05-06 19:52:49 +0000732
733\item[Classes]
Fred Drake62364ff2003-03-20 18:17:16 +0000734Class objects are created by class definitions (see
735section~\ref{class}, ``Class definitions'').
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000736A class has a namespace implemented by a dictionary object.
737Class attribute references are translated to
738lookups in this dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000739e.g., \samp{C.x} is translated to \samp{C.__dict__["x"]}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000740When the attribute name is not found
Fred Drakef6669171998-05-06 19:52:49 +0000741there, the attribute search continues in the base classes. The search
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000742is depth-first, left-to-right in the order of occurrence in the
Fred Drakef6669171998-05-06 19:52:49 +0000743base class list.
Fred Drakeea690c42003-07-17 05:26:53 +0000744
745When a class attribute reference (for class \class{C}, say)
746would yield a user-defined function object or
747an unbound user-defined method object whose associated class is either
748\class{C} or one of its base classes, it is transformed into an unbound
749user-defined method object whose \member{im_class} attribute is~\class{C}.
750When it would yield a class method object, it is transformed into
751a bound user-defined method object whose \member{im_class} and
752\member{im_self} attributes are both~\class{C}. When it would yield
753a static method object, it is transformed into the object wrapped
754by the static method object. See section~\ref{descriptors} for another
755way in which attributes retrieved from a class may differ from those
756actually contained in its \member{__dict__}.
Fred Drakef6669171998-05-06 19:52:49 +0000757\obindex{class}
758\obindex{class instance}
759\obindex{instance}
760\indexii{class object}{call}
761\index{container}
762\obindex{dictionary}
763\indexii{class}{attribute}
764
765Class attribute assignments update the class's dictionary, never the
766dictionary of a base class.
767\indexiii{class}{attribute}{assignment}
768
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000769A class object can be called (see above) to yield a class instance (see
770below).
Fred Drakef6669171998-05-06 19:52:49 +0000771\indexii{class object}{call}
772
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000773Special attributes: \member{__name__} is the class name;
774\member{__module__} is the module name in which the class was defined;
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000775\member{__dict__} is the dictionary containing the class's namespace;
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000776\member{__bases__} is a tuple (possibly empty or a singleton)
777containing the base classes, in the order of their occurrence in the
Fred Drake82385871998-10-01 20:40:43 +0000778base class list; \member{__doc__} is the class's documentation string,
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000779or None if undefined.
Fred Drake4856d011999-01-12 04:15:20 +0000780\withsubitem{(class attribute)}{
781 \ttindex{__name__}
782 \ttindex{__module__}
783 \ttindex{__dict__}
784 \ttindex{__bases__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000785 \ttindex{__doc__}}
Fred Drakef6669171998-05-06 19:52:49 +0000786
787\item[Class instances]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000788A class instance is created by calling a class object (see above).
789A class instance has a namespace implemented as a dictionary which
790is the first place in which
Fred Drakef6669171998-05-06 19:52:49 +0000791attribute references are searched. When an attribute is not found
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000792there, and the instance's class has an attribute by that name,
793the search continues with the class attributes. If a class attribute
Fred Drakeea690c42003-07-17 05:26:53 +0000794is found that is a user-defined function object or an unbound
795user-defined method object whose associated class is the class
796(call it~\class{C}) of the instance for which the attribute reference
797was initiated or one of its bases,
798it is transformed into a bound user-defined method object whose
Thomas Wouters89f507f2006-12-13 04:49:30 +0000799\member{im_class} attribute is~\class{C} and whose \member{im_self} attribute
Fred Drakeea690c42003-07-17 05:26:53 +0000800is the instance. Static method and class method objects are also
801transformed, as if they had been retrieved from class~\class{C};
802see above under ``Classes''. See section~\ref{descriptors} for
803another way in which attributes of a class retrieved via its
804instances may differ from the objects actually stored in the
805class's \member{__dict__}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000806If no class attribute is found, and the object's class has a
Fred Drake82385871998-10-01 20:40:43 +0000807\method{__getattr__()} method, that is called to satisfy the lookup.
Fred Drakef6669171998-05-06 19:52:49 +0000808\obindex{class instance}
809\obindex{instance}
810\indexii{class}{instance}
811\indexii{class instance}{attribute}
812
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000813Attribute assignments and deletions update the instance's dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000814never a class's dictionary. If the class has a \method{__setattr__()} or
815\method{__delattr__()} method, this is called instead of updating the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000816instance dictionary directly.
Fred Drakef6669171998-05-06 19:52:49 +0000817\indexiii{class instance}{attribute}{assignment}
818
819Class instances can pretend to be numbers, sequences, or mappings if
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000820they have methods with certain special names. See
Fred Drake62364ff2003-03-20 18:17:16 +0000821section~\ref{specialnames}, ``Special method names.''
Fred Drakee15956b2000-04-03 04:51:13 +0000822\obindex{numeric}
Fred Drakef6669171998-05-06 19:52:49 +0000823\obindex{sequence}
824\obindex{mapping}
825
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000826Special attributes: \member{__dict__} is the attribute
827dictionary; \member{__class__} is the instance's class.
Fred Drake4856d011999-01-12 04:15:20 +0000828\withsubitem{(instance attribute)}{
829 \ttindex{__dict__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000830 \ttindex{__class__}}
Fred Drakef6669171998-05-06 19:52:49 +0000831
832\item[Files]
Fred Drakee15eb351999-11-10 16:13:25 +0000833A file\obindex{file} object represents an open file. File objects are
834created by the \function{open()}\bifuncindex{open} built-in function,
835and also by
836\withsubitem{(in module os)}{\ttindex{popen()}}\function{os.popen()},
837\function{os.fdopen()}, and the
838\method{makefile()}\withsubitem{(socket method)}{\ttindex{makefile()}}
839method of socket objects (and perhaps by other functions or methods
840provided by extension modules). The objects
841\ttindex{sys.stdin}\code{sys.stdin},
842\ttindex{sys.stdout}\code{sys.stdout} and
843\ttindex{sys.stderr}\code{sys.stderr} are initialized to file objects
844corresponding to the interpreter's standard\index{stdio} input, output
845and error streams. See the \citetitle[../lib/lib.html]{Python Library
846Reference} for complete documentation of file objects.
Fred Drake4856d011999-01-12 04:15:20 +0000847\withsubitem{(in module sys)}{
848 \ttindex{stdin}
849 \ttindex{stdout}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000850 \ttindex{stderr}}
Fred Drakee15eb351999-11-10 16:13:25 +0000851
Fred Drakef6669171998-05-06 19:52:49 +0000852
853\item[Internal types]
854A few types used internally by the interpreter are exposed to the user.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000855Their definitions may change with future versions of the interpreter,
Fred Drakef6669171998-05-06 19:52:49 +0000856but they are mentioned here for completeness.
857\index{internal type}
858\index{types, internal}
859
860\begin{description}
861
862\item[Code objects]
Guido van Rossumd8faa362007-04-27 19:54:29 +0000863Code objects represent \emph{byte-compiled} executable Python code, or
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000864\emph{bytecode}.
Fred Drakef6669171998-05-06 19:52:49 +0000865The difference between a code
866object and a function object is that the function object contains an
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000867explicit reference to the function's globals (the module in which it
Guido van Rossumd8faa362007-04-27 19:54:29 +0000868was defined), while a code object contains no context;
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000869also the default argument values are stored in the function object,
870not in the code object (because they represent values calculated at
871run-time). Unlike function objects, code objects are immutable and
872contain no references (directly or indirectly) to mutable objects.
873\index{bytecode}
Fred Drakef6669171998-05-06 19:52:49 +0000874\obindex{code}
875
Fred Drake1e42d8a1998-11-25 17:58:50 +0000876Special read-only attributes: \member{co_name} gives the function
877name; \member{co_argcount} is the number of positional arguments
878(including arguments with default values); \member{co_nlocals} is the
879number of local variables used by the function (including arguments);
880\member{co_varnames} is a tuple containing the names of the local
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000881variables (starting with the argument names); \member{co_cellvars} is
882a tuple containing the names of local variables that are referenced by
883nested functions; \member{co_freevars} is a tuple containing the names
Jeremy Hylton8392f362002-04-01 18:53:36 +0000884of free variables; \member{co_code} is a string representing the
885sequence of bytecode instructions;
Fred Drake1e42d8a1998-11-25 17:58:50 +0000886\member{co_consts} is a tuple containing the literals used by the
887bytecode; \member{co_names} is a tuple containing the names used by
888the bytecode; \member{co_filename} is the filename from which the code
889was compiled; \member{co_firstlineno} is the first line number of the
890function; \member{co_lnotab} is a string encoding the mapping from
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000891byte code offsets to line numbers (for details see the source code of
Fred Drake1e42d8a1998-11-25 17:58:50 +0000892the interpreter); \member{co_stacksize} is the required stack size
893(including local variables); \member{co_flags} is an integer encoding
894a number of flags for the interpreter.
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000895
Fred Drake4856d011999-01-12 04:15:20 +0000896\withsubitem{(code object attribute)}{
897 \ttindex{co_argcount}
898 \ttindex{co_code}
899 \ttindex{co_consts}
900 \ttindex{co_filename}
901 \ttindex{co_firstlineno}
902 \ttindex{co_flags}
903 \ttindex{co_lnotab}
904 \ttindex{co_name}
905 \ttindex{co_names}
906 \ttindex{co_nlocals}
907 \ttindex{co_stacksize}
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000908 \ttindex{co_varnames}
909 \ttindex{co_cellvars}
910 \ttindex{co_freevars}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000911
Fred Drakee15956b2000-04-03 04:51:13 +0000912The following flag bits are defined for \member{co_flags}: bit
913\code{0x04} is set if the function uses the \samp{*arguments} syntax
914to accept an arbitrary number of positional arguments; bit
915\code{0x08} is set if the function uses the \samp{**keywords} syntax
Jeremy Hylton8392f362002-04-01 18:53:36 +0000916to accept arbitrary keyword arguments; bit \code{0x20} is set if the
Brett Cannon9e6fedd2003-06-15 22:57:44 +0000917function is a generator.
918\obindex{generator}
Jeremy Hylton8392f362002-04-01 18:53:36 +0000919
920Future feature declarations (\samp{from __future__ import division})
921also use bits in \member{co_flags} to indicate whether a code object
922was compiled with a particular feature enabled: bit \code{0x2000} is
923set if the function was compiled with future division enabled; bits
924\code{0x10} and \code{0x1000} were used in earlier versions of Python.
925
926Other bits in \member{co_flags} are reserved for internal use.
927
928If\index{documentation string} a code object represents a function,
929the first item in
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000930\member{co_consts} is the documentation string of the function, or
931\code{None} if undefined.
Fred Drakef6669171998-05-06 19:52:49 +0000932
933\item[Frame objects]
934Frame objects represent execution frames. They may occur in traceback
935objects (see below).
936\obindex{frame}
937
938Special read-only attributes: \member{f_back} is to the previous
939stack frame (towards the caller), or \code{None} if this is the bottom
940stack frame; \member{f_code} is the code object being executed in this
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000941frame; \member{f_locals} is the dictionary used to look up local
942variables; \member{f_globals} is used for global variables;
Fred Drake82385871998-10-01 20:40:43 +0000943\member{f_builtins} is used for built-in (intrinsic) names;
Guido van Rossuma8add0e2007-05-14 22:03:55 +0000944 \member{f_lasti} gives the precise instruction (this is an index into
945 the bytecode string of the code object).
Fred Drake4856d011999-01-12 04:15:20 +0000946\withsubitem{(frame attribute)}{
947 \ttindex{f_back}
948 \ttindex{f_code}
949 \ttindex{f_globals}
950 \ttindex{f_locals}
Fred Drake4856d011999-01-12 04:15:20 +0000951 \ttindex{f_lasti}
Guido van Rossuma8add0e2007-05-14 22:03:55 +0000952 \ttindex{f_builtins}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000953
Georg Brandl1c330eb2005-07-02 10:27:31 +0000954Special writable attributes: \member{f_trace}, if not \code{None}, is
955a function called at the start of each source code line (this is used
956by the debugger); \member{f_exc_type}, \member{f_exc_value},
957\member{f_exc_traceback} represent the last exception raised in the
958parent frame provided another exception was ever raised in the current
959frame (in all other cases they are None); \member{f_lineno} is the
960current line number of the frame --- writing to this from within a
961trace function jumps to the given line (only for the bottom-most
962frame). A debugger can implement a Jump command (aka Set Next
963Statement) by writing to f_lineno.
Fred Drake4856d011999-01-12 04:15:20 +0000964\withsubitem{(frame attribute)}{
965 \ttindex{f_trace}
966 \ttindex{f_exc_type}
967 \ttindex{f_exc_value}
Michael W. Hudsoncfd38842002-12-17 16:15:34 +0000968 \ttindex{f_exc_traceback}
969 \ttindex{f_lineno}}
Fred Drakef6669171998-05-06 19:52:49 +0000970
971\item[Traceback objects] \label{traceback}
972Traceback objects represent a stack trace of an exception. A
973traceback object is created when an exception occurs. When the search
974for an exception handler unwinds the execution stack, at each unwound
975level a traceback object is inserted in front of the current
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000976traceback. When an exception handler is entered, the stack trace is
977made available to the program.
Fred Drake62364ff2003-03-20 18:17:16 +0000978(See section~\ref{try}, ``The \code{try} statement.'')
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000979It is accessible as \code{sys.exc_traceback}, and also as the third
980item of the tuple returned by \code{sys.exc_info()}. The latter is
981the preferred interface, since it works correctly when the program is
982using multiple threads.
983When the program contains no suitable handler, the stack trace is written
Fred Drakef6669171998-05-06 19:52:49 +0000984(nicely formatted) to the standard error stream; if the interpreter is
985interactive, it is also made available to the user as
986\code{sys.last_traceback}.
987\obindex{traceback}
988\indexii{stack}{trace}
989\indexii{exception}{handler}
990\indexii{execution}{stack}
Fred Drake4856d011999-01-12 04:15:20 +0000991\withsubitem{(in module sys)}{
992 \ttindex{exc_info}
993 \ttindex{exc_traceback}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000994 \ttindex{last_traceback}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000995\ttindex{sys.exc_info}
Fred Drakef6669171998-05-06 19:52:49 +0000996\ttindex{sys.exc_traceback}
997\ttindex{sys.last_traceback}
998
999Special read-only attributes: \member{tb_next} is the next level in the
1000stack trace (towards the frame where the exception occurred), or
1001\code{None} if there is no next level; \member{tb_frame} points to the
1002execution frame of the current level; \member{tb_lineno} gives the line
1003number where the exception occurred; \member{tb_lasti} indicates the
1004precise instruction. The line number and last instruction in the
1005traceback may differ from the line number of its frame object if the
1006exception occurred in a \keyword{try} statement with no matching
1007except clause or with a finally clause.
Fred Drake4856d011999-01-12 04:15:20 +00001008\withsubitem{(traceback attribute)}{
1009 \ttindex{tb_next}
1010 \ttindex{tb_frame}
1011 \ttindex{tb_lineno}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001012 \ttindex{tb_lasti}}
Fred Drakef6669171998-05-06 19:52:49 +00001013\stindex{try}
1014
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001015\item[Slice objects]
1016Slice objects are used to represent slices when \emph{extended slice
1017syntax} is used. This is a slice using two colons, or multiple slices
1018or ellipses separated by commas, e.g., \code{a[i:j:step]}, \code{a[i:j,
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001019k:l]}, or \code{a[..., i:j]}. They are also created by the built-in
Fred Drake1e42d8a1998-11-25 17:58:50 +00001020\function{slice()}\bifuncindex{slice} function.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001021
Thomas Woutersf9b526d2000-07-16 19:05:38 +00001022Special read-only attributes: \member{start} is the lower bound;
1023\member{stop} is the upper bound; \member{step} is the step value; each is
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001024\code{None} if omitted. These attributes can have any type.
Fred Drake4856d011999-01-12 04:15:20 +00001025\withsubitem{(slice object attribute)}{
1026 \ttindex{start}
1027 \ttindex{stop}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001028 \ttindex{step}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001029
Fred Drake5ec22f22002-09-24 21:09:13 +00001030Slice objects support one method:
1031
1032\begin{methoddesc}[slice]{indices}{self, length}
1033This method takes a single integer argument \var{length} and computes
1034information about the extended slice that the slice object would
1035describe if applied to a sequence of \var{length} items. It returns a
1036tuple of three integers; respectively these are the \var{start} and
1037\var{stop} indices and the \var{step} or stride length of the slice.
1038Missing or out-of-bounds indices are handled in a manner consistent
1039with regular slices.
Michael W. Hudsonf0d777c2002-07-19 15:47:06 +00001040\versionadded{2.3}
Fred Drake5ec22f22002-09-24 21:09:13 +00001041\end{methoddesc}
Michael W. Hudsonf0d777c2002-07-19 15:47:06 +00001042
Fred Drakeea690c42003-07-17 05:26:53 +00001043\item[Static method objects]
1044Static method objects provide a way of defeating the transformation
1045of function objects to method objects described above. A static method
1046object is a wrapper around any other object, usually a user-defined
1047method object. When a static method object is retrieved from a class
1048or a class instance, the object actually returned is the wrapped object,
1049which is not subject to any further transformation. Static method
1050objects are not themselves callable, although the objects they
1051wrap usually are. Static method objects are created by the built-in
1052\function{staticmethod()} constructor.
1053
1054\item[Class method objects]
1055A class method object, like a static method object, is a wrapper
1056around another object that alters the way in which that object
1057is retrieved from classes and class instances. The behaviour of
1058class method objects upon such retrieval is described above,
1059under ``User-defined methods''. Class method objects are created
1060by the built-in \function{classmethod()} constructor.
1061
Fred Drakef6669171998-05-06 19:52:49 +00001062\end{description} % Internal types
1063
1064\end{description} % Types
1065
Andrew M. Kuchling6af52392005-12-04 16:07:15 +00001066%=========================================================================
1067\section{New-style and classic classes}
Fred Drakef6669171998-05-06 19:52:49 +00001068
Guido van Rossumd8faa362007-04-27 19:54:29 +00001069Classes and instances come in two flavors: old-style or classic, and new-style.
Andrew M. Kuchling6af52392005-12-04 16:07:15 +00001070
Armin Rigoddddd2f2005-12-26 18:06:17 +00001071Up to Python 2.1, old-style classes were the only flavour available to the
1072user. The concept of (old-style) class is unrelated to the concept of type: if
1073\var{x} is an instance of an old-style class, then \code{x.__class__}
1074designates the class of \var{x}, but \code{type(x)} is always \code{<type
1075'instance'>}. This reflects the fact that all old-style instances,
1076independently of their class, are implemented with a single built-in type,
1077called \code{instance}.
Andrew M. Kuchling6af52392005-12-04 16:07:15 +00001078
Armin Rigoddddd2f2005-12-26 18:06:17 +00001079New-style classes were introduced in Python 2.2 to unify classes and types. A
1080new-style class neither more nor less than a user-defined type. If \var{x} is
1081an instance of a new-style class, then \code{type(x)} is the same as
1082\code{x.__class__}.
1083
1084The major motivation for introducing new-style classes is to provide a unified
1085object model with a full meta-model. It also has a number of immediate
1086benefits, like the ability to subclass most built-in types, or the introduction
1087of "descriptors", which enable computed properties.
1088
1089For compatibility reasons, classes are still old-style by default. New-style
1090classes are created by specifying another new-style class (i.e.\ a type) as a
1091parent class, or the "top-level type" \class{object} if no other parent is
1092needed. The behaviour of new-style classes differs from that of old-style
1093classes in a number of important details in addition to what \function{type}
1094returns. Some of these changes are fundamental to the new object model, like
1095the way special methods are invoked. Others are "fixes" that could not be
1096implemented before for compatibility concerns, like the method resolution order
1097in case of multiple inheritance.
1098
Thomas Wouters49fd7fa2006-04-21 10:40:58 +00001099This manual is not up-to-date with respect to new-style classes. For now,
Armin Rigoddddd2f2005-12-26 18:06:17 +00001100please see \url{http://www.python.org/doc/newstyle.html} for more information.
Andrew M. Kuchling6af52392005-12-04 16:07:15 +00001101
Thomas Wouters49fd7fa2006-04-21 10:40:58 +00001102The plan is to eventually drop old-style classes, leaving only the semantics of
1103new-style classes. This change will probably only be feasible in Python 3.0.
1104\index{class}{new-style}
1105\index{class}{classic}
1106\index{class}{old-style}
Andrew M. Kuchling6af52392005-12-04 16:07:15 +00001107
Andrew M. Kuchling6af52392005-12-04 16:07:15 +00001108%=========================================================================
Fred Drake61c77281998-07-28 19:34:22 +00001109\section{Special method names\label{specialnames}}
Fred Drakef6669171998-05-06 19:52:49 +00001110
1111A class can implement certain operations that are invoked by special
Fred Draked82575d1998-08-28 20:03:12 +00001112syntax (such as arithmetic operations or subscripting and slicing) by
Fred Drake7af9f4d2003-05-12 13:50:11 +00001113defining methods with special names.\indexii{operator}{overloading}
1114This is Python's approach to \dfn{operator overloading}, allowing
1115classes to define their own behavior with respect to language
1116operators. For instance, if a class defines
Fred Draked82575d1998-08-28 20:03:12 +00001117a method named \method{__getitem__()}, and \code{x} is an instance of
Armin Rigoddddd2f2005-12-26 18:06:17 +00001118this class, then \code{x[i]} is equivalent\footnote{This, and other
1119statements, are only roughly true for instances of new-style
1120classes.} to
Raymond Hettinger94153092002-05-12 03:09:25 +00001121\code{x.__getitem__(i)}. Except where mentioned, attempts to execute
1122an operation raise an exception when no appropriate method is defined.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001123\withsubitem{(mapping object method)}{\ttindex{__getitem__()}}
Fred Drakef6669171998-05-06 19:52:49 +00001124
Fred Drake0c475592000-12-07 04:49:34 +00001125When implementing a class that emulates any built-in type, it is
1126important that the emulation only be implemented to the degree that it
1127makes sense for the object being modelled. For example, some
1128sequences may work well with retrieval of individual elements, but
1129extracting a slice may not make sense. (One example of this is the
1130\class{NodeList} interface in the W3C's Document Object Model.)
1131
Fred Drakef6669171998-05-06 19:52:49 +00001132
Fred Drake61c77281998-07-28 19:34:22 +00001133\subsection{Basic customization\label{customization}}
Fred Drakef6669171998-05-06 19:52:49 +00001134
Greg Wardff564d32005-03-08 01:10:20 +00001135\begin{methoddesc}[object]{__new__}{cls\optional{, \moreargs}}
1136Called to create a new instance of class \var{cls}. \method{__new__()}
Georg Brandl15ad9352005-08-26 12:56:22 +00001137is a static method (special-cased so you need not declare it as such)
Greg Wardff564d32005-03-08 01:10:20 +00001138that takes the class of which an instance was requested as its first
1139argument. The remaining arguments are those passed to the object
1140constructor expression (the call to the class). The return value of
1141\method{__new__()} should be the new object instance (usually an
1142instance of \var{cls}).
1143
1144Typical implementations create a new instance of the class by invoking
1145the superclass's \method{__new__()} method using
1146\samp{super(\var{currentclass}, \var{cls}).__new__(\var{cls}[, ...])}
1147with appropriate arguments and then modifying the newly-created instance
1148as necessary before returning it.
1149
1150If \method{__new__()} returns an instance of \var{cls}, then the new
1151instance's \method{__init__()} method will be invoked like
1152\samp{__init__(\var{self}[, ...])}, where \var{self} is the new instance
1153and the remaining arguments are the same as were passed to
1154\method{__new__()}.
1155
1156If \method{__new__()} does not return an instance of \var{cls}, then the
1157new instance's \method{__init__()} method will not be invoked.
1158
1159\method{__new__()} is intended mainly to allow subclasses of
1160immutable types (like int, str, or tuple) to customize instance
1161creation.
1162\end{methoddesc}
1163
Fred Drake044bb4d2001-08-02 15:53:05 +00001164\begin{methoddesc}[object]{__init__}{self\optional{, \moreargs}}
1165Called\indexii{class}{constructor} when the instance is created. The
1166arguments are those passed to the class constructor expression. If a
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001167base class has an \method{__init__()} method, the derived class's
1168\method{__init__()} method, if any, must explicitly call it to ensure proper
Fred Drake044bb4d2001-08-02 15:53:05 +00001169initialization of the base class part of the instance; for example:
1170\samp{BaseClass.__init__(\var{self}, [\var{args}...])}. As a special
Martin v. Löwis95cf84a2003-10-19 07:32:24 +00001171constraint on constructors, no value may be returned; doing so will
Fred Drake044bb4d2001-08-02 15:53:05 +00001172cause a \exception{TypeError} to be raised at runtime.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001173\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001174
1175
Fred Drake1e42d8a1998-11-25 17:58:50 +00001176\begin{methoddesc}[object]{__del__}{self}
Guido van Rossum7c0240f1998-07-24 15:36:43 +00001177Called when the instance is about to be destroyed. This is also
1178called a destructor\index{destructor}. If a base class
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001179has a \method{__del__()} method, the derived class's \method{__del__()}
1180method, if any,
Fred Drakef6669171998-05-06 19:52:49 +00001181must explicitly call it to ensure proper deletion of the base class
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001182part of the instance. Note that it is possible (though not recommended!)
1183for the \method{__del__()}
Fred Drakef6669171998-05-06 19:52:49 +00001184method to postpone destruction of the instance by creating a new
1185reference to it. It may then be called at a later time when this new
1186reference is deleted. It is not guaranteed that
1187\method{__del__()} methods are called for objects that still exist when
1188the interpreter exits.
Fred Drakef6669171998-05-06 19:52:49 +00001189\stindex{del}
1190
Fred Drake591dd8f2001-12-14 22:52:41 +00001191\begin{notice}
1192\samp{del x} doesn't directly call
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001193\code{x.__del__()} --- the former decrements the reference count for
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001194\code{x} by one, and the latter is only called when \code{x}'s reference
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001195count reaches zero. Some common situations that may prevent the
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001196reference count of an object from going to zero include: circular
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001197references between objects (e.g., a doubly-linked list or a tree data
1198structure with parent and child pointers); a reference to the object
1199on the stack frame of a function that caught an exception (the
1200traceback stored in \code{sys.exc_traceback} keeps the stack frame
1201alive); or a reference to the object on the stack frame that raised an
1202unhandled exception in interactive mode (the traceback stored in
1203\code{sys.last_traceback} keeps the stack frame alive). The first
1204situation can only be remedied by explicitly breaking the cycles; the
Fred Drake591dd8f2001-12-14 22:52:41 +00001205latter two situations can be resolved by storing \code{None} in
1206\code{sys.exc_traceback} or \code{sys.last_traceback}. Circular
1207references which are garbage are detected when the option cycle
1208detector is enabled (it's on by default), but can only be cleaned up
1209if there are no Python-level \method{__del__()} methods involved.
1210Refer to the documentation for the \ulink{\module{gc}
1211module}{../lib/module-gc.html} for more information about how
1212\method{__del__()} methods are handled by the cycle detector,
1213particularly the description of the \code{garbage} value.
1214\end{notice}
Fred Drakef6669171998-05-06 19:52:49 +00001215
Fred Drake591dd8f2001-12-14 22:52:41 +00001216\begin{notice}[warning]
1217Due to the precarious circumstances under which
Fred Draked82575d1998-08-28 20:03:12 +00001218\method{__del__()} methods are invoked, exceptions that occur during their
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001219execution are ignored, and a warning is printed to \code{sys.stderr}
Fred Drake591dd8f2001-12-14 22:52:41 +00001220instead. Also, when \method{__del__()} is invoked in response to a module
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001221being deleted (e.g., when execution of the program is done), other
Fred Draked82575d1998-08-28 20:03:12 +00001222globals referenced by the \method{__del__()} method may already have been
1223deleted. For this reason, \method{__del__()} methods should do the
Raymond Hettingera0e4d6c2002-09-08 21:10:54 +00001224absolute minimum needed to maintain external invariants. Starting with
1225version 1.5, Python guarantees that globals whose name begins with a single
1226underscore are deleted from their module before other globals are deleted;
1227if no other references to such globals exist, this may help in assuring that
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001228imported modules are still available at the time when the
Fred Drake591dd8f2001-12-14 22:52:41 +00001229\method{__del__()} method is called.
1230\end{notice}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001231\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001232
Fred Drake1e42d8a1998-11-25 17:58:50 +00001233\begin{methoddesc}[object]{__repr__}{self}
Fred Drake82385871998-10-01 20:40:43 +00001234Called by the \function{repr()}\bifuncindex{repr} built-in function
1235and by string conversions (reverse quotes) to compute the ``official''
Andrew M. Kuchling68abe832000-12-19 14:09:21 +00001236string representation of an object. If at all possible, this should
Guido van Rossum035f7e82000-12-19 04:18:13 +00001237look like a valid Python expression that could be used to recreate an
1238object with the same value (given an appropriate environment). If
1239this is not possible, a string of the form \samp{<\var{...some useful
1240description...}>} should be returned. The return value must be a
1241string object.
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001242If a class defines \method{__repr__()} but not \method{__str__()},
1243then \method{__repr__()} is also used when an ``informal'' string
Guido van Rossumd8faa362007-04-27 19:54:29 +00001244representation of instances of that class is required.
Guido van Rossum035f7e82000-12-19 04:18:13 +00001245
1246This is typically used for debugging, so it is important that the
1247representation is information-rich and unambiguous.
Fred Drakef6669171998-05-06 19:52:49 +00001248\indexii{string}{conversion}
1249\indexii{reverse}{quotes}
1250\indexii{backward}{quotes}
1251\index{back-quotes}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001252\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001253
Fred Drake1e42d8a1998-11-25 17:58:50 +00001254\begin{methoddesc}[object]{__str__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001255Called by the \function{str()}\bifuncindex{str} built-in function and
1256by the \keyword{print}\stindex{print} statement to compute the
Fred Drake82385871998-10-01 20:40:43 +00001257``informal'' string representation of an object. This differs from
1258\method{__repr__()} in that it does not have to be a valid Python
1259expression: a more convenient or concise representation may be used
Guido van Rossum035f7e82000-12-19 04:18:13 +00001260instead. The return value must be a string object.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001261\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001262
Guido van Rossumab782dd2001-01-18 15:17:06 +00001263\begin{methoddesc}[object]{__lt__}{self, other}
1264\methodline[object]{__le__}{self, other}
1265\methodline[object]{__eq__}{self, other}
1266\methodline[object]{__ne__}{self, other}
1267\methodline[object]{__gt__}{self, other}
1268\methodline[object]{__ge__}{self, other}
1269\versionadded{2.1}
1270These are the so-called ``rich comparison'' methods, and are called
1271for comparison operators in preference to \method{__cmp__()} below.
1272The correspondence between operator symbols and method names is as
1273follows:
1274\code{\var{x}<\var{y}} calls \code{\var{x}.__lt__(\var{y})},
1275\code{\var{x}<=\var{y}} calls \code{\var{x}.__le__(\var{y})},
1276\code{\var{x}==\var{y}} calls \code{\var{x}.__eq__(\var{y})},
Neal Norwitz3bd844e2006-08-29 04:39:12 +00001277\code{\var{x}!=\var{y}} calls \code{\var{x}.__ne__(\var{y})},
Guido van Rossumab782dd2001-01-18 15:17:06 +00001278\code{\var{x}>\var{y}} calls \code{\var{x}.__gt__(\var{y})}, and
1279\code{\var{x}>=\var{y}} calls \code{\var{x}.__ge__(\var{y})}.
Guido van Rossumd8faa362007-04-27 19:54:29 +00001280
1281A rich comparison method may return the singleton \code{NotImplemented} if it
1282does not implement the operation for a given pair of arguments.
1283By convention, \code{False} and \code{True} are returned for a successful
1284comparison. However, these methods can return any value, so if the
1285comparison operator is used in a Boolean context (e.g., in the condition
1286of an \code{if} statement), Python will call \function{bool()} on the
1287value to determine if the result is true or false.
Guido van Rossumab782dd2001-01-18 15:17:06 +00001288
Raymond Hettinger4d6e8fe2003-07-16 19:40:23 +00001289There are no implied relationships among the comparison operators.
Raymond Hettinger943277e2003-07-17 14:47:12 +00001290The truth of \code{\var{x}==\var{y}} does not imply that \code{\var{x}!=\var{y}}
Fred Drakeb3dfc0a2005-09-07 04:57:56 +00001291is false. Accordingly, when defining \method{__eq__()}, one should also
1292define \method{__ne__()} so that the operators will behave as expected.
Raymond Hettinger4d6e8fe2003-07-16 19:40:23 +00001293
Guido van Rossumab782dd2001-01-18 15:17:06 +00001294There are no reflected (swapped-argument) versions of these methods
1295(to be used when the left argument does not support the operation but
1296the right argument does); rather, \method{__lt__()} and
1297\method{__gt__()} are each other's reflection, \method{__le__()} and
1298\method{__ge__()} are each other's reflection, and \method{__eq__()}
1299and \method{__ne__()} are their own reflection.
1300
Guido van Rossumd8faa362007-04-27 19:54:29 +00001301Arguments to rich comparison methods are never coerced.
Guido van Rossumab782dd2001-01-18 15:17:06 +00001302\end{methoddesc}
1303
Fred Drake1e42d8a1998-11-25 17:58:50 +00001304\begin{methoddesc}[object]{__cmp__}{self, other}
Guido van Rossumab782dd2001-01-18 15:17:06 +00001305Called by comparison operations if rich comparison (see above) is not
Fred Drake597bc1d2001-05-29 16:02:35 +00001306defined. Should return a negative integer if \code{self < other},
1307zero if \code{self == other}, a positive integer if \code{self >
1308other}. If no \method{__cmp__()}, \method{__eq__()} or
1309\method{__ne__()} operation is defined, class instances are compared
1310by object identity (``address''). See also the description of
1311\method{__hash__()} for some important notes on creating objects which
1312support custom comparison operations and are usable as dictionary
1313keys.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001314(Note: the restriction that exceptions are not propagated by
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001315\method{__cmp__()} has been removed since Python 1.5.)
Fred Drakef6669171998-05-06 19:52:49 +00001316\bifuncindex{cmp}
1317\index{comparisons}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001318\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001319
Fred Drakee57a1142000-06-15 20:07:25 +00001320\begin{methoddesc}[object]{__rcmp__}{self, other}
Fred Drake445f8322001-01-04 15:11:48 +00001321 \versionchanged[No longer supported]{2.1}
Fred Drakee57a1142000-06-15 20:07:25 +00001322\end{methoddesc}
1323
Fred Drake1e42d8a1998-11-25 17:58:50 +00001324\begin{methoddesc}[object]{__hash__}{self}
Brett Cannona031a082004-06-29 04:14:02 +00001325Called for the key object for dictionary \obindex{dictionary}
Fred Draked82575d1998-08-28 20:03:12 +00001326operations, and by the built-in function
Fred Drakef6669171998-05-06 19:52:49 +00001327\function{hash()}\bifuncindex{hash}. Should return a 32-bit integer
1328usable as a hash value
1329for dictionary operations. The only required property is that objects
1330which compare equal have the same hash value; it is advised to somehow
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001331mix together (e.g., using exclusive or) the hash values for the
Fred Drakef6669171998-05-06 19:52:49 +00001332components of the object that also play a part in comparison of
1333objects. If a class does not define a \method{__cmp__()} method it should
1334not define a \method{__hash__()} operation either; if it defines
Fred Drake597bc1d2001-05-29 16:02:35 +00001335\method{__cmp__()} or \method{__eq__()} but not \method{__hash__()},
1336its instances will not be usable as dictionary keys. If a class
1337defines mutable objects and implements a \method{__cmp__()} or
1338\method{__eq__()} method, it should not implement \method{__hash__()},
1339since the dictionary implementation requires that a key's hash value
1340is immutable (if the object's hash value changes, it will be in the
1341wrong hash bucket).
Thomas Wouters0e3f5912006-08-11 14:57:12 +00001342
1343\versionchanged[\method{__hash__()} may now also return a long
1344integer object; the 32-bit integer is then derived from the hash
1345of that object]{2.5}
1346
Fred Drake1e42d8a1998-11-25 17:58:50 +00001347\withsubitem{(object method)}{\ttindex{__cmp__()}}
1348\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001349
Jack Diederich4dafcc42006-11-28 19:15:13 +00001350\begin{methoddesc}[object]{__bool__}{self}
Guido van Rossum77f6a652002-04-03 22:41:51 +00001351Called to implement truth value testing, and the built-in operation
Jack Diederich4dafcc42006-11-28 19:15:13 +00001352\code{bool()}; should return \code{False} or \code{True}.
Guido van Rossum77f6a652002-04-03 22:41:51 +00001353When this method is not defined, \method{__len__()} is
Jack Diederich4dafcc42006-11-28 19:15:13 +00001354called, if it is defined (see below) and \code{True} is returned when
1355the length is not zero. If a class defines neither
1356\method{__len__()} nor \method{__bool__()}, all its instances are
Fred Draked82575d1998-08-28 20:03:12 +00001357considered true.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001358\withsubitem{(mapping object method)}{\ttindex{__len__()}}
1359\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001360
Martin v. Löwis2a519f82002-04-11 12:39:35 +00001361\begin{methoddesc}[object]{__unicode__}{self}
1362Called to implement \function{unicode()}\bifuncindex{unicode} builtin;
1363should return a Unicode object. When this method is not defined, string
1364conversion is attempted, and the result of string conversion is converted
1365to Unicode using the system default encoding.
1366\end{methoddesc}
1367
Fred Drakef6669171998-05-06 19:52:49 +00001368
Fred Drake61c77281998-07-28 19:34:22 +00001369\subsection{Customizing attribute access\label{attribute-access}}
Fred Drakef6669171998-05-06 19:52:49 +00001370
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001371The following methods can be defined to customize the meaning of
1372attribute access (use of, assignment to, or deletion of \code{x.name})
1373for class instances.
Fred Drakef6669171998-05-06 19:52:49 +00001374
Fred Drake1e42d8a1998-11-25 17:58:50 +00001375\begin{methoddesc}[object]{__getattr__}{self, name}
Fred Drakef6669171998-05-06 19:52:49 +00001376Called when an attribute lookup has not found the attribute in the
1377usual places (i.e. it is not an instance attribute nor is it found in
1378the class tree for \code{self}). \code{name} is the attribute name.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001379This method should return the (computed) attribute value or raise an
Fred Draked82575d1998-08-28 20:03:12 +00001380\exception{AttributeError} exception.
Fred Drakef6669171998-05-06 19:52:49 +00001381
1382Note that if the attribute is found through the normal mechanism,
Fred Draked82575d1998-08-28 20:03:12 +00001383\method{__getattr__()} is not called. (This is an intentional
1384asymmetry between \method{__getattr__()} and \method{__setattr__()}.)
Fred Drakef6669171998-05-06 19:52:49 +00001385This is done both for efficiency reasons and because otherwise
Fred Draked82575d1998-08-28 20:03:12 +00001386\method{__setattr__()} would have no way to access other attributes of
Guido van Rossumd41eea02003-02-28 14:11:45 +00001387the instance. Note that at least for instance variables, you can fake
1388total control by not inserting any values in the instance attribute
1389dictionary (but instead inserting them in another object). See the
1390\method{__getattribute__()} method below for a way to actually get
1391total control in new-style classes.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001392\withsubitem{(object method)}{\ttindex{__setattr__()}}
1393\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001394
Fred Drake1e42d8a1998-11-25 17:58:50 +00001395\begin{methoddesc}[object]{__setattr__}{self, name, value}
Fred Drakef6669171998-05-06 19:52:49 +00001396Called when an attribute assignment is attempted. This is called
Fred Draked82575d1998-08-28 20:03:12 +00001397instead of the normal mechanism (i.e.\ store the value in the instance
1398dictionary). \var{name} is the attribute name, \var{value} is the
Fred Drakef6669171998-05-06 19:52:49 +00001399value to be assigned to it.
Fred Drakef6669171998-05-06 19:52:49 +00001400
Guido van Rossumd8faa362007-04-27 19:54:29 +00001401If \method{__setattr__()} wants to assign to an instance attribute, it
Fred Draked82575d1998-08-28 20:03:12 +00001402should not simply execute \samp{self.\var{name} = value} --- this
1403would cause a recursive call to itself. Instead, it should insert the
1404value in the dictionary of instance attributes, e.g.,
Guido van Rossumd41eea02003-02-28 14:11:45 +00001405\samp{self.__dict__[\var{name}] = value}. For new-style classes,
1406rather than accessing the instance dictionary, it should call the base
1407class method with the same name, for example,
1408\samp{object.__setattr__(self, name, value)}.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001409\withsubitem{(instance attribute)}{\ttindex{__dict__}}
1410\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001411
Fred Drake1e42d8a1998-11-25 17:58:50 +00001412\begin{methoddesc}[object]{__delattr__}{self, name}
Fred Draked82575d1998-08-28 20:03:12 +00001413Like \method{__setattr__()} but for attribute deletion instead of
Fred Drake1e42d8a1998-11-25 17:58:50 +00001414assignment. This should only be implemented if \samp{del
1415obj.\var{name}} is meaningful for the object.
1416\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001417
Michael W. Hudson2ab1d082003-03-05 14:20:58 +00001418\subsubsection{More attribute access for new-style classes \label{new-style-attribute-access}}
Guido van Rossumd41eea02003-02-28 14:11:45 +00001419
1420The following methods only apply to new-style classes.
1421
1422\begin{methoddesc}[object]{__getattribute__}{self, name}
1423Called unconditionally to implement attribute accesses for instances
Guido van Rossumd8faa362007-04-27 19:54:29 +00001424of the class. If the class also defines \method{__getattr__()}, the latter
1425will not be called unless \method{__getattribute__()} either calls it
Georg Brandl1c330eb2005-07-02 10:27:31 +00001426explicitly or raises an \exception{AttributeError}.
Guido van Rossumd41eea02003-02-28 14:11:45 +00001427This method should return the (computed) attribute
1428value or raise an \exception{AttributeError} exception.
1429In order to avoid infinite recursion in this method, its
1430implementation should always call the base class method with the same
Fred Drake62364ff2003-03-20 18:17:16 +00001431name to access any attributes it needs, for example,
Guido van Rossumd41eea02003-02-28 14:11:45 +00001432\samp{object.__getattribute__(self, name)}.
1433\end{methoddesc}
1434
Michael W. Hudson2ab1d082003-03-05 14:20:58 +00001435\subsubsection{Implementing Descriptors \label{descriptors}}
Guido van Rossumd41eea02003-02-28 14:11:45 +00001436
1437The following methods only apply when an instance of the class
Fred Drake62364ff2003-03-20 18:17:16 +00001438containing the method (a so-called \emph{descriptor} class) appears in
Guido van Rossumd41eea02003-02-28 14:11:45 +00001439the class dictionary of another new-style class, known as the
1440\emph{owner} class. In the examples below, ``the attribute'' refers to
Fred Drake62364ff2003-03-20 18:17:16 +00001441the attribute whose name is the key of the property in the owner
Fred Drake67a521e2004-05-06 12:44:29 +00001442class' \code{__dict__}. Descriptors can only be implemented as
1443new-style classes themselves.
Guido van Rossumd41eea02003-02-28 14:11:45 +00001444
1445\begin{methoddesc}[object]{__get__}{self, instance, owner}
Fred Drake62364ff2003-03-20 18:17:16 +00001446Called to get the attribute of the owner class (class attribute access)
Raymond Hettinger68804312005-01-01 00:28:46 +00001447or of an instance of that class (instance attribute access).
Guido van Rossumd41eea02003-02-28 14:11:45 +00001448\var{owner} is always the owner class, while \var{instance} is the
1449instance that the attribute was accessed through, or \code{None} when
1450the attribute is accessed through the \var{owner}. This method should
1451return the (computed) attribute value or raise an
1452\exception{AttributeError} exception.
1453\end{methoddesc}
1454
1455\begin{methoddesc}[object]{__set__}{self, instance, value}
Michael W. Hudson2ab1d082003-03-05 14:20:58 +00001456Called to set the attribute on an instance \var{instance} of the owner
Guido van Rossumd41eea02003-02-28 14:11:45 +00001457class to a new value, \var{value}.
1458\end{methoddesc}
1459
1460\begin{methoddesc}[object]{__delete__}{self, instance}
Michael W. Hudson2ab1d082003-03-05 14:20:58 +00001461Called to delete the attribute on an instance \var{instance} of the
1462owner class.
Guido van Rossumd41eea02003-02-28 14:11:45 +00001463\end{methoddesc}
1464
Fred Drakef6669171998-05-06 19:52:49 +00001465
Fred Drake4db36612003-06-26 03:11:20 +00001466\subsubsection{Invoking Descriptors \label{descriptor-invocation}}
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001467
1468In general, a descriptor is an object attribute with ``binding behavior'',
1469one whose attribute access has been overridden by methods in the descriptor
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001470protocol: \method{__get__()}, \method{__set__()}, and \method{__delete__()}.
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001471If any of those methods are defined for an object, it is said to be a
1472descriptor.
1473
1474The default behavior for attribute access is to get, set, or delete the
1475attribute from an object's dictionary. For instance, \code{a.x} has a
1476lookup chain starting with \code{a.__dict__['x']}, then
Guido van Rossumd8faa362007-04-27 19:54:29 +00001477\code{type(a).__dict__['x']}, and continuing
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001478through the base classes of \code{type(a)} excluding metaclasses.
1479
1480However, if the looked-up value is an object defining one of the descriptor
1481methods, then Python may override the default behavior and invoke the
1482descriptor method instead. Where this occurs in the precedence chain depends
1483on which descriptor methods were defined and how they were called. Note that
1484descriptors are only invoked for new style objects or classes
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001485(ones that subclass \class{object()} or \class{type()}).
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001486
1487The starting point for descriptor invocation is a binding, \code{a.x}.
1488How the arguments are assembled depends on \code{a}:
1489
1490\begin{itemize}
Guido van Rossumd8faa362007-04-27 19:54:29 +00001491
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001492 \item[Direct Call] The simplest and least common call is when user code
1493 directly invokes a descriptor method: \code{x.__get__(a)}.
1494
1495 \item[Instance Binding] If binding to a new-style object instance,
1496 \code{a.x} is transformed into the call:
1497 \code{type(a).__dict__['x'].__get__(a, type(a))}.
Guido van Rossumd8faa362007-04-27 19:54:29 +00001498
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001499 \item[Class Binding] If binding to a new-style class, \code{A.x}
1500 is transformed into the call: \code{A.__dict__['x'].__get__(None, A)}.
1501
1502 \item[Super Binding] If \code{a} is an instance of \class{super},
1503 then the binding \code{super(B, obj).m()} searches
1504 \code{obj.__class__.__mro__} for the base class \code{A} immediately
1505 preceding \code{B} and then invokes the descriptor with the call:
1506 \code{A.__dict__['m'].__get__(obj, A)}.
Guido van Rossumd8faa362007-04-27 19:54:29 +00001507
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001508\end{itemize}
1509
1510For instance bindings, the precedence of descriptor invocation depends
1511on the which descriptor methods are defined. Data descriptors define
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001512both \method{__get__()} and \method{__set__()}. Non-data descriptors have
1513just the \method{__get__()} method. Data descriptors always override
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001514a redefinition in an instance dictionary. In contrast, non-data
1515descriptors can be overridden by instances.
1516
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001517Python methods (including \function{staticmethod()} and \function{classmethod()})
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001518are implemented as non-data descriptors. Accordingly, instances can
1519redefine and override methods. This allows individual instances to acquire
Guido van Rossumd8faa362007-04-27 19:54:29 +00001520behaviors that differ from other instances of the same class.
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001521
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001522The \function{property()} function is implemented as a data descriptor.
1523Accordingly, instances cannot override the behavior of a property.
1524
1525
1526\subsubsection{__slots__\label{slots}}
1527
1528By default, instances of both old and new-style classes have a dictionary
1529for attribute storage. This wastes space for objects having very few instance
1530variables. The space consumption can become acute when creating large numbers
1531of instances.
1532
1533The default can be overridden by defining \var{__slots__} in a new-style class
1534definition. The \var{__slots__} declaration takes a sequence of instance
1535variables and reserves just enough space in each instance to hold a value
1536for each variable. Space is saved because \var{__dict__} is not created for
1537each instance.
Guido van Rossumd8faa362007-04-27 19:54:29 +00001538
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001539\begin{datadesc}{__slots__}
1540This class variable can be assigned a string, iterable, or sequence of strings
Raymond Hettinger5918f8d2003-06-29 04:53:23 +00001541with variable names used by instances. If defined in a new-style class,
1542\var{__slots__} reserves space for the declared variables
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001543and prevents the automatic creation of \var{__dict__} and \var{__weakref__}
1544for each instance.
Guido van Rossumd8faa362007-04-27 19:54:29 +00001545\versionadded{2.2}
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001546\end{datadesc}
1547
1548\noindent
Raymond Hettinger5918f8d2003-06-29 04:53:23 +00001549Notes on using \var{__slots__}
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001550
1551\begin{itemize}
1552
1553\item Without a \var{__dict__} variable, instances cannot be assigned new
1554variables not listed in the \var{__slots__} definition. Attempts to assign
1555to an unlisted variable name raises \exception{AttributeError}. If dynamic
1556assignment of new variables is desired, then add \code{'__dict__'} to the
Guido van Rossumd8faa362007-04-27 19:54:29 +00001557sequence of strings in the \var{__slots__} declaration.
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001558\versionchanged[Previously, adding \code{'__dict__'} to the \var{__slots__}
1559declaration would not enable the assignment of new attributes not
Guido van Rossumd8faa362007-04-27 19:54:29 +00001560specifically listed in the sequence of instance variable names]{2.3}
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001561
1562\item Without a \var{__weakref__} variable for each instance, classes
1563defining \var{__slots__} do not support weak references to its instances.
1564If weak reference support is needed, then add \code{'__weakref__'} to the
Guido van Rossumd8faa362007-04-27 19:54:29 +00001565sequence of strings in the \var{__slots__} declaration.
Raymond Hettinger5918f8d2003-06-29 04:53:23 +00001566\versionchanged[Previously, adding \code{'__weakref__'} to the \var{__slots__}
Guido van Rossumd8faa362007-04-27 19:54:29 +00001567declaration would not enable support for weak references]{2.3}
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001568
1569\item \var{__slots__} are implemented at the class level by creating
1570descriptors (\ref{descriptors}) for each variable name. As a result,
1571class attributes cannot be used to set default values for instance
1572variables defined by \var{__slots__}; otherwise, the class attribute would
Guido van Rossumd8faa362007-04-27 19:54:29 +00001573overwrite the descriptor assignment.
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001574
1575\item If a class defines a slot also defined in a base class, the instance
1576variable defined by the base class slot is inaccessible (except by retrieving
1577its descriptor directly from the base class). This renders the meaning of the
1578program undefined. In the future, a check may be added to prevent this.
1579
1580\item The action of a \var{__slots__} declaration is limited to the class
1581where it is defined. As a result, subclasses will have a \var{__dict__}
Guido van Rossumd8faa362007-04-27 19:54:29 +00001582unless they also define \var{__slots__}.
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001583
1584\item \var{__slots__} do not work for classes derived from ``variable-length''
Guido van Rossumd8faa362007-04-27 19:54:29 +00001585built-in types such as \class{long}, \class{str} and \class{tuple}.
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001586
Raymond Hettinger5918f8d2003-06-29 04:53:23 +00001587\item Any non-string iterable may be assigned to \var{__slots__}.
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001588Mappings may also be used; however, in the future, special meaning may
Guido van Rossumd8faa362007-04-27 19:54:29 +00001589be assigned to the values corresponding to each key.
1590
1591\item \var{__class__} assignment works only if both classes have the
1592same \var{__slots__}.
1593\versionchanged[Previously, \var{__class__} assignment raised an error
1594if either new or old class had \var{__slots__}]{2.6}
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001595
1596\end{itemize}
1597
1598
1599\subsection{Customizing class creation\label{metaclasses}}
1600
1601By default, new-style classes are constructed using \function{type()}.
1602A class definition is read into a separate namespace and the value
1603of class name is bound to the result of \code{type(name, bases, dict)}.
1604
1605When the class definition is read, if \var{__metaclass__} is defined
1606then the callable assigned to it will be called instead of \function{type()}.
1607The allows classes or functions to be written which monitor or alter the class
1608creation process:
1609
1610\begin{itemize}
1611\item Modifying the class dictionary prior to the class being created.
1612\item Returning an instance of another class -- essentially performing
1613the role of a factory function.
1614\end{itemize}
1615
1616\begin{datadesc}{__metaclass__}
1617This variable can be any callable accepting arguments for \code{name},
1618\code{bases}, and \code{dict}. Upon class creation, the callable is
1619used instead of the built-in \function{type()}.
Guido van Rossumd8faa362007-04-27 19:54:29 +00001620\versionadded{2.2}
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001621\end{datadesc}
1622
1623The appropriate metaclass is determined by the following precedence rules:
1624
1625\begin{itemize}
1626
1627\item If \code{dict['__metaclass__']} exists, it is used.
1628
1629\item Otherwise, if there is at least one base class, its metaclass is used
1630(this looks for a \var{__class__} attribute first and if not found, uses its
1631type).
1632
1633\item Otherwise, if a global variable named __metaclass__ exists, it is used.
1634
1635\item Otherwise, the old-style, classic metaclass (types.ClassType) is used.
1636
Guido van Rossumd8faa362007-04-27 19:54:29 +00001637\end{itemize}
Raymond Hettingerdf9eff02003-06-27 06:57:56 +00001638
1639The potential uses for metaclasses are boundless. Some ideas that have
1640been explored including logging, interface checking, automatic delegation,
1641automatic property creation, proxies, frameworks, and automatic resource
1642locking/synchronization.
Raymond Hettinger03ec6d52003-06-25 18:29:36 +00001643
1644
Fred Drake61c77281998-07-28 19:34:22 +00001645\subsection{Emulating callable objects\label{callable-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001646
Fred Drake1e42d8a1998-11-25 17:58:50 +00001647\begin{methoddesc}[object]{__call__}{self\optional{, args...}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001648Called when the instance is ``called'' as a function; if this method
Fred Draked82575d1998-08-28 20:03:12 +00001649is defined, \code{\var{x}(arg1, arg2, ...)} is a shorthand for
1650\code{\var{x}.__call__(arg1, arg2, ...)}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001651\indexii{call}{instance}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001652\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001653
1654
Fred Drake73921b02001-10-01 16:32:13 +00001655\subsection{Emulating container types\label{sequence-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001656
Fred Drake73921b02001-10-01 16:32:13 +00001657The following methods can be defined to implement container
1658objects. Containers usually are sequences (such as lists or tuples)
1659or mappings (like dictionaries), but can represent other containers as
1660well. The first set of methods is used either to emulate a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001661sequence or to emulate a mapping; the difference is that for a
1662sequence, the allowable keys should be the integers \var{k} for which
1663\code{0 <= \var{k} < \var{N}} where \var{N} is the length of the
Thomas Wouters1d75a792000-08-17 22:37:32 +00001664sequence, or slice objects, which define a range of items. (For backwards
1665compatibility, the method \method{__getslice__()} (see below) can also be
1666defined to handle simple, but not extended slices.) It is also recommended
Fred Drakea0073822000-08-18 02:42:14 +00001667that mappings provide the methods \method{keys()}, \method{values()},
Thomas Wouters1d75a792000-08-17 22:37:32 +00001668\method{items()}, \method{has_key()}, \method{get()}, \method{clear()},
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001669\method{setdefault()}, \method{iterkeys()}, \method{itervalues()},
Guido van Rossumd8faa362007-04-27 19:54:29 +00001670\method{iteritems()}, \method{pop()}, \method{popitem()},
Thomas Wouters1d75a792000-08-17 22:37:32 +00001671\method{copy()}, and \method{update()} behaving similar to those for
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001672Python's standard dictionary objects. The \module{UserDict} module
1673provides a \class{DictMixin} class to help create those methods
1674from a base set of \method{__getitem__()}, \method{__setitem__()},
Guido van Rossumd8faa362007-04-27 19:54:29 +00001675\method{__delitem__()}, and \method{keys()}.
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001676Mutable sequences should provide
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001677methods \method{append()}, \method{count()}, \method{index()},
Guido van Rossumd8faa362007-04-27 19:54:29 +00001678\method{extend()},
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001679\method{insert()}, \method{pop()}, \method{remove()}, \method{reverse()}
1680and \method{sort()}, like Python standard list objects. Finally,
1681sequence types should implement addition (meaning concatenation) and
1682multiplication (meaning repetition) by defining the methods
Thomas Wouters12bba852000-08-24 20:06:04 +00001683\method{__add__()}, \method{__radd__()}, \method{__iadd__()},
1684\method{__mul__()}, \method{__rmul__()} and \method{__imul__()} described
Neal Norwitz4886cc32006-08-21 17:06:07 +00001685below; they should not define other numerical
Guido van Rossum0dbb4fb2001-04-20 16:50:40 +00001686operators. It is recommended that both mappings and sequences
Fred Drake18d8d5a2001-09-18 17:58:20 +00001687implement the \method{__contains__()} method to allow efficient use of
1688the \code{in} operator; for mappings, \code{in} should be equivalent
1689of \method{has_key()}; for sequences, it should search through the
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001690values. It is further recommended that both mappings and sequences
1691implement the \method{__iter__()} method to allow efficient iteration
1692through the container; for mappings, \method{__iter__()} should be
1693the same as \method{iterkeys()}; for sequences, it should iterate
1694through the values.
Fred Drake4856d011999-01-12 04:15:20 +00001695\withsubitem{(mapping object method)}{
1696 \ttindex{keys()}
1697 \ttindex{values()}
1698 \ttindex{items()}
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001699 \ttindex{iterkeys()}
1700 \ttindex{itervalues()}
Guido van Rossumd8faa362007-04-27 19:54:29 +00001701 \ttindex{iteritems()}
Fred Drake4856d011999-01-12 04:15:20 +00001702 \ttindex{has_key()}
1703 \ttindex{get()}
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001704 \ttindex{setdefault()}
Guido van Rossumd8faa362007-04-27 19:54:29 +00001705 \ttindex{pop()}
1706 \ttindex{popitem()}
Fred Drake4856d011999-01-12 04:15:20 +00001707 \ttindex{clear()}
1708 \ttindex{copy()}
Guido van Rossum0dbb4fb2001-04-20 16:50:40 +00001709 \ttindex{update()}
1710 \ttindex{__contains__()}}
Fred Drake4856d011999-01-12 04:15:20 +00001711\withsubitem{(sequence object method)}{
1712 \ttindex{append()}
1713 \ttindex{count()}
Guido van Rossumd8faa362007-04-27 19:54:29 +00001714 \ttindex{extend()}
Fred Drake4856d011999-01-12 04:15:20 +00001715 \ttindex{index()}
1716 \ttindex{insert()}
1717 \ttindex{pop()}
1718 \ttindex{remove()}
1719 \ttindex{reverse()}
1720 \ttindex{sort()}
1721 \ttindex{__add__()}
1722 \ttindex{__radd__()}
Thomas Wouters12bba852000-08-24 20:06:04 +00001723 \ttindex{__iadd__()}
Fred Drake4856d011999-01-12 04:15:20 +00001724 \ttindex{__mul__()}
Thomas Wouters12bba852000-08-24 20:06:04 +00001725 \ttindex{__rmul__()}
Guido van Rossum0dbb4fb2001-04-20 16:50:40 +00001726 \ttindex{__imul__()}
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001727 \ttindex{__contains__()}
Guido van Rossumd8faa362007-04-27 19:54:29 +00001728 \ttindex{__iter__()}}
Neal Norwitz4886cc32006-08-21 17:06:07 +00001729\withsubitem{(numeric object method)}
Fred Drakef6669171998-05-06 19:52:49 +00001730
Fred Drake73921b02001-10-01 16:32:13 +00001731\begin{methoddesc}[container object]{__len__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001732Called to implement the built-in function
1733\function{len()}\bifuncindex{len}. Should return the length of the
1734object, an integer \code{>=} 0. Also, an object that doesn't define a
Jack Diederich4dafcc42006-11-28 19:15:13 +00001735\method{__bool__()} method and whose \method{__len__()} method
Fred Draked82575d1998-08-28 20:03:12 +00001736returns zero is considered to be false in a Boolean context.
Jack Diederich4dafcc42006-11-28 19:15:13 +00001737\withsubitem{(object method)}{\ttindex{__bool__()}}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001738\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001739
Fred Drake73921b02001-10-01 16:32:13 +00001740\begin{methoddesc}[container object]{__getitem__}{self, key}
Fred Draked82575d1998-08-28 20:03:12 +00001741Called to implement evaluation of \code{\var{self}[\var{key}]}.
Fred Drake31575ce2000-09-21 05:28:26 +00001742For sequence types, the accepted keys should be integers and slice
1743objects.\obindex{slice} Note that
1744the special interpretation of negative indexes (if the class wishes to
Fred Drakef6669171998-05-06 19:52:49 +00001745emulate a sequence type) is up to the \method{__getitem__()} method.
Fred Drake91826ed2000-07-13 04:57:58 +00001746If \var{key} is of an inappropriate type, \exception{TypeError} may be
1747raised; if of a value outside the set of indexes for the sequence
1748(after any special interpretation of negative values),
1749\exception{IndexError} should be raised.
Raymond Hettingera30616a2005-08-21 11:26:14 +00001750For mapping types, if \var{key} is missing (not in the container),
Guido van Rossumd8faa362007-04-27 19:54:29 +00001751\exception{KeyError} should be raised.
Fred Drake0aa811c2001-10-20 04:24:09 +00001752\note{\keyword{for} loops expect that an
Fred Drake91826ed2000-07-13 04:57:58 +00001753\exception{IndexError} will be raised for illegal indexes to allow
Fred Drake0aa811c2001-10-20 04:24:09 +00001754proper detection of the end of the sequence.}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001755\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001756
Fred Drake73921b02001-10-01 16:32:13 +00001757\begin{methoddesc}[container object]{__setitem__}{self, key, value}
Fred Draked82575d1998-08-28 20:03:12 +00001758Called to implement assignment to \code{\var{self}[\var{key}]}. Same
Fred Drake1e42d8a1998-11-25 17:58:50 +00001759note as for \method{__getitem__()}. This should only be implemented
1760for mappings if the objects support changes to the values for keys, or
1761if new keys can be added, or for sequences if elements can be
Fred Drake91826ed2000-07-13 04:57:58 +00001762replaced. The same exceptions should be raised for improper
1763\var{key} values as for the \method{__getitem__()} method.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001764\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001765
Fred Drake73921b02001-10-01 16:32:13 +00001766\begin{methoddesc}[container object]{__delitem__}{self, key}
Fred Draked82575d1998-08-28 20:03:12 +00001767Called to implement deletion of \code{\var{self}[\var{key}]}. Same
Fred Drake1e42d8a1998-11-25 17:58:50 +00001768note as for \method{__getitem__()}. This should only be implemented
1769for mappings if the objects support removal of keys, or for sequences
Fred Drake91826ed2000-07-13 04:57:58 +00001770if elements can be removed from the sequence. The same exceptions
1771should be raised for improper \var{key} values as for the
1772\method{__getitem__()} method.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001773\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001774
Fred Drake73921b02001-10-01 16:32:13 +00001775\begin{methoddesc}[container object]{__iter__}{self}
1776This method is called when an iterator is required for a container.
1777This method should return a new iterator object that can iterate over
1778all the objects in the container. For mappings, it should iterate
1779over the keys of the container, and should also be made available as
1780the method \method{iterkeys()}.
1781
1782Iterator objects also need to implement this method; they are required
1783to return themselves. For more information on iterator objects, see
1784``\ulink{Iterator Types}{../lib/typeiter.html}'' in the
1785\citetitle[../lib/lib.html]{Python Library Reference}.
1786\end{methoddesc}
1787
1788The membership test operators (\keyword{in} and \keyword{not in}) are
1789normally implemented as an iteration through a sequence. However,
1790container objects can supply the following special method with a more
1791efficient implementation, which also does not require the object be a
1792sequence.
1793
1794\begin{methoddesc}[container object]{__contains__}{self, item}
1795Called to implement membership test operators. Should return true if
1796\var{item} is in \var{self}, false otherwise. For mapping objects,
1797this should consider the keys of the mapping rather than the values or
1798the key-item pairs.
1799\end{methoddesc}
1800
Fred Drakef6669171998-05-06 19:52:49 +00001801
Fred Drake3041b071998-10-21 00:25:32 +00001802\subsection{Additional methods for emulation of sequence types
Fred Drake61c77281998-07-28 19:34:22 +00001803 \label{sequence-methods}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001804
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001805The following optional methods can be defined to further emulate sequence
1806objects. Immutable sequences methods should at most only define
1807\method{__getslice__()}; mutable sequences might define all three
Raymond Hettinger92016dc2003-09-22 15:27:11 +00001808methods.
Fred Drakef6669171998-05-06 19:52:49 +00001809
Fred Drake1e42d8a1998-11-25 17:58:50 +00001810\begin{methoddesc}[sequence object]{__getslice__}{self, i, j}
Fred Drakea0073822000-08-18 02:42:14 +00001811\deprecated{2.0}{Support slice objects as parameters to the
1812\method{__getitem__()} method.}
Fred Draked82575d1998-08-28 20:03:12 +00001813Called to implement evaluation of \code{\var{self}[\var{i}:\var{j}]}.
1814The returned object should be of the same type as \var{self}. Note
1815that missing \var{i} or \var{j} in the slice expression are replaced
Fred Drakee15956b2000-04-03 04:51:13 +00001816by zero or \code{sys.maxint}, respectively. If negative indexes are
1817used in the slice, the length of the sequence is added to that index.
1818If the instance does not implement the \method{__len__()} method, an
1819\exception{AttributeError} is raised.
1820No guarantee is made that indexes adjusted this way are not still
1821negative. Indexes which are greater than the length of the sequence
1822are not modified.
Fred Drakea0073822000-08-18 02:42:14 +00001823If no \method{__getslice__()} is found, a slice
Thomas Wouters1d75a792000-08-17 22:37:32 +00001824object is created instead, and passed to \method{__getitem__()} instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001825\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001826
Fred Drake1e42d8a1998-11-25 17:58:50 +00001827\begin{methoddesc}[sequence object]{__setslice__}{self, i, j, sequence}
Fred Draked82575d1998-08-28 20:03:12 +00001828Called to implement assignment to \code{\var{self}[\var{i}:\var{j}]}.
1829Same notes for \var{i} and \var{j} as for \method{__getslice__()}.
Thomas Wouters1d75a792000-08-17 22:37:32 +00001830
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001831This method is deprecated. If no \method{__setslice__()} is found,
1832or for extended slicing of the form
1833\code{\var{self}[\var{i}:\var{j}:\var{k}]}, a
1834slice object is created, and passed to \method{__setitem__()},
1835instead of \method{__setslice__()} being called.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001836\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001837
Fred Drake1e42d8a1998-11-25 17:58:50 +00001838\begin{methoddesc}[sequence object]{__delslice__}{self, i, j}
Fred Draked82575d1998-08-28 20:03:12 +00001839Called to implement deletion of \code{\var{self}[\var{i}:\var{j}]}.
1840Same notes for \var{i} and \var{j} as for \method{__getslice__()}.
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001841This method is deprecated. If no \method{__delslice__()} is found,
1842or for extended slicing of the form
1843\code{\var{self}[\var{i}:\var{j}:\var{k}]}, a
1844slice object is created, and passed to \method{__delitem__()},
1845instead of \method{__delslice__()} being called.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001846\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001847
Fred Drakefb8ffe62001-04-13 15:54:41 +00001848Notice that these methods are only invoked when a single slice with a
1849single colon is used, and the slice method is available. For slice
1850operations involving extended slice notation, or in absence of the
1851slice methods, \method{__getitem__()}, \method{__setitem__()} or
1852\method{__delitem__()} is called with a slice object as argument.
Fred Drakef6669171998-05-06 19:52:49 +00001853
Fred Drakef89259782000-09-21 22:27:16 +00001854The following example demonstrate how to make your program or module
1855compatible with earlier versions of Python (assuming that methods
1856\method{__getitem__()}, \method{__setitem__()} and \method{__delitem__()}
1857support slice objects as arguments):
1858
1859\begin{verbatim}
1860class MyClass:
1861 ...
1862 def __getitem__(self, index):
1863 ...
1864 def __setitem__(self, index, value):
1865 ...
1866 def __delitem__(self, index):
1867 ...
1868
1869 if sys.version_info < (2, 0):
1870 # They won't be defined if version is at least 2.0 final
1871
1872 def __getslice__(self, i, j):
1873 return self[max(0, i):max(0, j):]
1874 def __setslice__(self, i, j, seq):
1875 self[max(0, i):max(0, j):] = seq
1876 def __delslice__(self, i, j):
1877 del self[max(0, i):max(0, j):]
1878 ...
1879\end{verbatim}
1880
Raymond Hettingere701dcb2003-01-19 13:08:18 +00001881Note the calls to \function{max()}; these are necessary because of
1882the handling of negative indices before the
Fred Drakef89259782000-09-21 22:27:16 +00001883\method{__*slice__()} methods are called. When negative indexes are
1884used, the \method{__*item__()} methods receive them as provided, but
1885the \method{__*slice__()} methods get a ``cooked'' form of the index
1886values. For each negative index value, the length of the sequence is
1887added to the index before calling the method (which may still result
1888in a negative index); this is the customary handling of negative
1889indexes by the built-in sequence types, and the \method{__*item__()}
1890methods are expected to do this as well. However, since they should
1891already be doing that, negative indexes cannot be passed in; they must
Raymond Hettingere41d4c82003-08-25 04:39:55 +00001892be constrained to the bounds of the sequence before being passed to
Fred Drakef89259782000-09-21 22:27:16 +00001893the \method{__*item__()} methods.
1894Calling \code{max(0, i)} conveniently returns the proper value.
1895
Fred Drake15988fd1999-02-12 18:14:57 +00001896
Fred Drake61c77281998-07-28 19:34:22 +00001897\subsection{Emulating numeric types\label{numeric-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001898
1899The following methods can be defined to emulate numeric objects.
1900Methods corresponding to operations that are not supported by the
1901particular kind of number implemented (e.g., bitwise operations for
1902non-integral numbers) should be left undefined.
Fred Drakef6669171998-05-06 19:52:49 +00001903
Fred Drakeb8943701999-05-10 13:43:22 +00001904\begin{methoddesc}[numeric object]{__add__}{self, other}
1905\methodline[numeric object]{__sub__}{self, other}
1906\methodline[numeric object]{__mul__}{self, other}
Fred Drake3e2aca42001-08-14 20:28:08 +00001907\methodline[numeric object]{__floordiv__}{self, other}
Fred Drakeb8943701999-05-10 13:43:22 +00001908\methodline[numeric object]{__mod__}{self, other}
1909\methodline[numeric object]{__divmod__}{self, other}
1910\methodline[numeric object]{__pow__}{self, other\optional{, modulo}}
1911\methodline[numeric object]{__lshift__}{self, other}
1912\methodline[numeric object]{__rshift__}{self, other}
1913\methodline[numeric object]{__and__}{self, other}
1914\methodline[numeric object]{__xor__}{self, other}
1915\methodline[numeric object]{__or__}{self, other}
Fred Drake3e2aca42001-08-14 20:28:08 +00001916These methods are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001917called to implement the binary arithmetic operations (\code{+},
Fred Drake3e2aca42001-08-14 20:28:08 +00001918\code{-}, \code{*}, \code{//}, \code{\%},
Fred Draked82575d1998-08-28 20:03:12 +00001919\function{divmod()}\bifuncindex{divmod},
Thomas Wouters477c8d52006-05-27 19:21:47 +00001920\function{pow()}\bifuncindex{pow}, \code{**}, \code{<<},
1921\code{>>}, \code{\&}, \code{\^}, \code{|}). For instance, to
Fred Drakefb8ffe62001-04-13 15:54:41 +00001922evaluate the expression \var{x}\code{+}\var{y}, where \var{x} is an
1923instance of a class that has an \method{__add__()} method,
Fred Drake3e2aca42001-08-14 20:28:08 +00001924\code{\var{x}.__add__(\var{y})} is called. The \method{__divmod__()}
1925method should be the equivalent to using \method{__floordiv__()} and
1926\method{__mod__()}; it should not be related to \method{__truediv__()}
1927(described below). Note that
Fred Draked82575d1998-08-28 20:03:12 +00001928\method{__pow__()} should be defined to accept an optional third
1929argument if the ternary version of the built-in
1930\function{pow()}\bifuncindex{pow} function is to be supported.
Thomas Wouters0e3f5912006-08-11 14:57:12 +00001931
1932If one of those methods does not support the operation with the
1933supplied arguments, it should return \code{NotImplemented}.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001934\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001935
Fred Drake3e2aca42001-08-14 20:28:08 +00001936\begin{methoddesc}[numeric object]{__div__}{self, other}
1937\methodline[numeric object]{__truediv__}{self, other}
1938The division operator (\code{/}) is implemented by these methods. The
1939\method{__truediv__()} method is used when \code{__future__.division}
1940is in effect, otherwise \method{__div__()} is used. If only one of
1941these two methods is defined, the object will not support division in
1942the alternate context; \exception{TypeError} will be raised instead.
1943\end{methoddesc}
1944
Fred Drakeb8943701999-05-10 13:43:22 +00001945\begin{methoddesc}[numeric object]{__radd__}{self, other}
1946\methodline[numeric object]{__rsub__}{self, other}
1947\methodline[numeric object]{__rmul__}{self, other}
1948\methodline[numeric object]{__rdiv__}{self, other}
Raymond Hettinger10cbe8d2002-06-20 06:12:37 +00001949\methodline[numeric object]{__rtruediv__}{self, other}
Guido van Rossumd8faa362007-04-27 19:54:29 +00001950\methodline[numeric object]{__rfloordiv__}{self, other}
Fred Drakeb8943701999-05-10 13:43:22 +00001951\methodline[numeric object]{__rmod__}{self, other}
1952\methodline[numeric object]{__rdivmod__}{self, other}
1953\methodline[numeric object]{__rpow__}{self, other}
1954\methodline[numeric object]{__rlshift__}{self, other}
1955\methodline[numeric object]{__rrshift__}{self, other}
1956\methodline[numeric object]{__rand__}{self, other}
1957\methodline[numeric object]{__rxor__}{self, other}
1958\methodline[numeric object]{__ror__}{self, other}
Fred Drake3e2aca42001-08-14 20:28:08 +00001959These methods are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001960called to implement the binary arithmetic operations (\code{+},
Fred Draked82575d1998-08-28 20:03:12 +00001961\code{-}, \code{*}, \code{/}, \code{\%},
1962\function{divmod()}\bifuncindex{divmod},
Thomas Wouters477c8d52006-05-27 19:21:47 +00001963\function{pow()}\bifuncindex{pow}, \code{**}, \code{<<},
1964\code{>>}, \code{\&}, \code{\^}, \code{|}) with reflected
Fred Drakefb8ffe62001-04-13 15:54:41 +00001965(swapped) operands. These functions are only called if the left
Thomas Wouters0e3f5912006-08-11 14:57:12 +00001966operand does not support the corresponding operation and the
1967operands are of different types.\footnote{
1968 For operands of the same type, it is assumed that if the
1969 non-reflected method (such as \method{__add__()}) fails the
1970 operation is not supported, which is why the reflected method
Guido van Rossumd8faa362007-04-27 19:54:29 +00001971 is not called.}
Thomas Wouters0e3f5912006-08-11 14:57:12 +00001972For instance, to evaluate the expression \var{x}\code{-}\var{y},
1973where \var{y} is an instance of a class that has an
1974\method{__rsub__()} method, \code{\var{y}.__rsub__(\var{x})}
1975is called if \code{\var{x}.__sub__(\var{y})} returns
1976\var{NotImplemented}.
1977
1978Note that ternary
Fred Drakefb8ffe62001-04-13 15:54:41 +00001979\function{pow()}\bifuncindex{pow} will not try calling
1980\method{__rpow__()} (the coercion rules would become too
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001981complicated).
Thomas Wouters0e3f5912006-08-11 14:57:12 +00001982
1983\note{If the right operand's type is a subclass of the left operand's
1984 type and that subclass provides the reflected method for the
1985 operation, this method will be called before the left operand's
1986 non-reflected method. This behavior allows subclasses to
1987 override their ancestors' operations.}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001988\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001989
Thomas Woutersdc90cc22000-12-11 23:11:51 +00001990\begin{methoddesc}[numeric object]{__iadd__}{self, other}
1991\methodline[numeric object]{__isub__}{self, other}
1992\methodline[numeric object]{__imul__}{self, other}
1993\methodline[numeric object]{__idiv__}{self, other}
Raymond Hettinger10cbe8d2002-06-20 06:12:37 +00001994\methodline[numeric object]{__itruediv__}{self, other}
1995\methodline[numeric object]{__ifloordiv__}{self, other}
Guido van Rossumd8faa362007-04-27 19:54:29 +00001996\methodline[numeric object]{__imod__}{self, other}
Thomas Woutersdc90cc22000-12-11 23:11:51 +00001997\methodline[numeric object]{__ipow__}{self, other\optional{, modulo}}
1998\methodline[numeric object]{__ilshift__}{self, other}
1999\methodline[numeric object]{__irshift__}{self, other}
2000\methodline[numeric object]{__iand__}{self, other}
2001\methodline[numeric object]{__ixor__}{self, other}
2002\methodline[numeric object]{__ior__}{self, other}
Fred Drakefb8ffe62001-04-13 15:54:41 +00002003These methods are called to implement the augmented arithmetic
Thomas Woutersb2137042007-02-01 18:02:27 +00002004operations (\code{+=}, \code{-=}, \code{*=}, \code{/=}, \code{//=},
2005\code{\%=}, \code{**=}, \code{<<=}, \code{>>=}, \code{\&=},
Fred Drakea3788642003-07-23 15:18:03 +00002006\code{\textasciicircum=}, \code{|=}). These methods should attempt to do the
Fred Drakefb8ffe62001-04-13 15:54:41 +00002007operation in-place (modifying \var{self}) and return the result (which
2008could be, but does not have to be, \var{self}). If a specific method
2009is not defined, the augmented operation falls back to the normal
2010methods. For instance, to evaluate the expression
2011\var{x}\code{+=}\var{y}, where \var{x} is an instance of a class that
2012has an \method{__iadd__()} method, \code{\var{x}.__iadd__(\var{y})} is
2013called. If \var{x} is an instance of a class that does not define a
Fred Drakeb3dfc0a2005-09-07 04:57:56 +00002014\method{__iadd__()} method, \code{\var{x}.__add__(\var{y})} and
Fred Drakefb8ffe62001-04-13 15:54:41 +00002015\code{\var{y}.__radd__(\var{x})} are considered, as with the
2016evaluation of \var{x}\code{+}\var{y}.
Thomas Woutersdc90cc22000-12-11 23:11:51 +00002017\end{methoddesc}
2018
Fred Drakeb8943701999-05-10 13:43:22 +00002019\begin{methoddesc}[numeric object]{__neg__}{self}
2020\methodline[numeric object]{__pos__}{self}
2021\methodline[numeric object]{__abs__}{self}
2022\methodline[numeric object]{__invert__}{self}
Fred Drakefb8ffe62001-04-13 15:54:41 +00002023Called to implement the unary arithmetic operations (\code{-},
2024\code{+}, \function{abs()}\bifuncindex{abs} and \code{\~{}}).
Fred Drake1e42d8a1998-11-25 17:58:50 +00002025\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00002026
Fred Drakeb8943701999-05-10 13:43:22 +00002027\begin{methoddesc}[numeric object]{__complex__}{self}
2028\methodline[numeric object]{__int__}{self}
2029\methodline[numeric object]{__long__}{self}
2030\methodline[numeric object]{__float__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00002031Called to implement the built-in functions
Fred Drake15988fd1999-02-12 18:14:57 +00002032\function{complex()}\bifuncindex{complex},
2033\function{int()}\bifuncindex{int}, \function{long()}\bifuncindex{long},
Fred Draked82575d1998-08-28 20:03:12 +00002034and \function{float()}\bifuncindex{float}. Should return a value of
2035the appropriate type.
Fred Drake1e42d8a1998-11-25 17:58:50 +00002036\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00002037
Fred Drakeb8943701999-05-10 13:43:22 +00002038\begin{methoddesc}[numeric object]{__oct__}{self}
2039\methodline[numeric object]{__hex__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00002040Called to implement the built-in functions
2041\function{oct()}\bifuncindex{oct} and
2042\function{hex()}\bifuncindex{hex}. Should return a string value.
Fred Drake1e42d8a1998-11-25 17:58:50 +00002043\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00002044
Guido van Rossum38fff8c2006-03-07 18:50:55 +00002045\begin{methoddesc}[numeric object]{__index__}{self}
Thomas Wouters477c8d52006-05-27 19:21:47 +00002046Called to implement \function{operator.index()}. Also called whenever
2047Python needs an integer object (such as in slicing). Must return an
2048integer (int or long).
Guido van Rossum38fff8c2006-03-07 18:50:55 +00002049\versionadded{2.5}
2050\end{methoddesc}
2051
Thomas Wouters477c8d52006-05-27 19:21:47 +00002052\subsection{With Statement Context Managers\label{context-managers}}
Thomas Wouters49fd7fa2006-04-21 10:40:58 +00002053
2054\versionadded{2.5}
2055
Thomas Wouters477c8d52006-05-27 19:21:47 +00002056A \dfn{context manager} is an object that defines the runtime
2057context to be established when executing a \keyword{with}
2058statement. The context manager handles the entry into,
2059and the exit from, the desired runtime context for the execution
2060of the block of code. Context managers are normally invoked using
2061the \keyword{with} statement (described in section~\ref{with}), but
2062can also be used by directly invoking their methods.
2063
Thomas Wouters49fd7fa2006-04-21 10:40:58 +00002064\stindex{with}
2065\index{context manager}
Thomas Wouters49fd7fa2006-04-21 10:40:58 +00002066
Thomas Wouters477c8d52006-05-27 19:21:47 +00002067Typical uses of context managers include saving and
2068restoring various kinds of global state, locking and unlocking
2069resources, closing opened files, etc.
Thomas Wouters49fd7fa2006-04-21 10:40:58 +00002070
Thomas Wouters477c8d52006-05-27 19:21:47 +00002071For more information on context managers, see
2072``\ulink{Context Types}{../lib/typecontextmanager.html}'' in the
2073\citetitle[../lib/lib.html]{Python Library Reference}.
Thomas Wouters49fd7fa2006-04-21 10:40:58 +00002074
Thomas Wouters477c8d52006-05-27 19:21:47 +00002075\begin{methoddesc}[context manager]{__enter__}{self}
2076Enter the runtime context related to this object. The \keyword{with}
2077statement will bind this method's return value to the target(s)
2078specified in the \keyword{as} clause of the statement, if any.
Thomas Wouters49fd7fa2006-04-21 10:40:58 +00002079\end{methoddesc}
2080
Thomas Wouters477c8d52006-05-27 19:21:47 +00002081\begin{methoddesc}[context manager]{__exit__}
2082{self, exc_type, exc_value, traceback}
2083Exit the runtime context related to this object. The parameters
2084describe the exception that caused the context to be exited. If
2085the context was exited without an exception, all three arguments
2086will be \constant{None}.
Thomas Wouters49fd7fa2006-04-21 10:40:58 +00002087
2088If an exception is supplied, and the method wishes to suppress the
2089exception (i.e., prevent it from being propagated), it should return a
2090true value. Otherwise, the exception will be processed normally upon
2091exit from this method.
2092
2093Note that \method{__exit__} methods should not reraise the passed-in
2094exception; this is the caller's responsibility.
2095\end{methoddesc}
2096
2097\begin{seealso}
2098 \seepep{0343}{The "with" statement}
2099 {The specification, background, and examples for the
2100 Python \keyword{with} statement.}
2101\end{seealso}
2102