blob: eb1d658ef3d7953fe847c88618c512c758f9b84a [file] [log] [blame]
Fred Drake61c77281998-07-28 19:34:22 +00001\chapter{Data model\label{datamodel}}
Fred Drakef6669171998-05-06 19:52:49 +00002
Fred Drake2829f1c2001-06-23 05:27:20 +00003
Fred Drake61c77281998-07-28 19:34:22 +00004\section{Objects, values and types\label{objects}}
Fred Drakef6669171998-05-06 19:52:49 +00005
6\dfn{Objects} are Python's abstraction for data. All data in a Python
7program is represented by objects or by relations between objects.
8(In a sense, and in conformance to Von Neumann's model of a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00009``stored program computer,'' code is also represented by objects.)
Fred Drakef6669171998-05-06 19:52:49 +000010\index{object}
11\index{data}
12
13Every object has an identity, a type and a value. An object's
14\emph{identity} never changes once it has been created; you may think
Fred Drake293dd4b2002-06-04 16:25:57 +000015of it as the object's address in memory. The `\keyword{is}' operator
Fred Drake82385871998-10-01 20:40:43 +000016compares the identity of two objects; the
17\function{id()}\bifuncindex{id} function returns an integer
18representing its identity (currently implemented as its address).
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000019An object's \dfn{type} is
Fred Drakef6669171998-05-06 19:52:49 +000020also unchangeable. It determines the operations that an object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000021supports (e.g., ``does it have a length?'') and also defines the
Fred Drake82385871998-10-01 20:40:43 +000022possible values for objects of that type. The
23\function{type()}\bifuncindex{type} function returns an object's type
24(which is an object itself). The \emph{value} of some
Fred Drakef6669171998-05-06 19:52:49 +000025objects can change. Objects whose value can change are said to be
26\emph{mutable}; objects whose value is unchangeable once they are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000027created are called \emph{immutable}.
Guido van Rossum264bd591999-02-23 16:40:55 +000028(The value of an immutable container object that contains a reference
29to a mutable object can change when the latter's value is changed;
30however the container is still considered immutable, because the
31collection of objects it contains cannot be changed. So, immutability
32is not strictly the same as having an unchangeable value, it is more
33subtle.)
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000034An object's mutability is determined by its type; for instance,
35numbers, strings and tuples are immutable, while dictionaries and
36lists are mutable.
Fred Drakef6669171998-05-06 19:52:49 +000037\index{identity of an object}
38\index{value of an object}
39\index{type of an object}
40\index{mutable object}
41\index{immutable object}
42
43Objects are never explicitly destroyed; however, when they become
44unreachable they may be garbage-collected. An implementation is
Barry Warsaw92a6ed91998-08-07 16:33:51 +000045allowed to postpone garbage collection or omit it altogether --- it is
46a matter of implementation quality how garbage collection is
Fred Drakef6669171998-05-06 19:52:49 +000047implemented, as long as no objects are collected that are still
48reachable. (Implementation note: the current implementation uses a
Fred Drakec8e82812001-01-22 17:46:18 +000049reference-counting scheme with (optional) delayed detection of
50cyclicly linked garbage, which collects most objects as soon as they
51become unreachable, but is not guaranteed to collect garbage
52containing circular references. See the
53\citetitle[../lib/module-gc.html]{Python Library Reference} for
54information on controlling the collection of cyclic garbage.)
Fred Drakef6669171998-05-06 19:52:49 +000055\index{garbage collection}
56\index{reference counting}
57\index{unreachable object}
58
59Note that the use of the implementation's tracing or debugging
60facilities may keep objects alive that would normally be collectable.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000061Also note that catching an exception with a
Fred Drake4856d011999-01-12 04:15:20 +000062`\keyword{try}...\keyword{except}' statement may keep objects alive.
Fred Drakef6669171998-05-06 19:52:49 +000063
64Some objects contain references to ``external'' resources such as open
65files or windows. It is understood that these resources are freed
66when the object is garbage-collected, but since garbage collection is
67not guaranteed to happen, such objects also provide an explicit way to
68release the external resource, usually a \method{close()} method.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000069Programs are strongly recommended to explicitly close such
Fred Drake4856d011999-01-12 04:15:20 +000070objects. The `\keyword{try}...\keyword{finally}' statement provides
71a convenient way to do this.
Fred Drakef6669171998-05-06 19:52:49 +000072
73Some objects contain references to other objects; these are called
74\emph{containers}. Examples of containers are tuples, lists and
75dictionaries. The references are part of a container's value. In
76most cases, when we talk about the value of a container, we imply the
77values, not the identities of the contained objects; however, when we
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000078talk about the mutability of a container, only the identities of
79the immediately contained objects are implied. So, if an immutable
80container (like a tuple)
81contains a reference to a mutable object, its value changes
82if that mutable object is changed.
Fred Drakef6669171998-05-06 19:52:49 +000083\index{container}
84
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000085Types affect almost all aspects of object behavior. Even the importance
Fred Drakef6669171998-05-06 19:52:49 +000086of object identity is affected in some sense: for immutable types,
87operations that compute new values may actually return a reference to
88any existing object with the same type and value, while for mutable
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000089objects this is not allowed. E.g., after
Fred Drake82385871998-10-01 20:40:43 +000090\samp{a = 1; b = 1},
Fred Drakef6669171998-05-06 19:52:49 +000091\code{a} and \code{b} may or may not refer to the same object with the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000092value one, depending on the implementation, but after
Fred Drake82385871998-10-01 20:40:43 +000093\samp{c = []; d = []}, \code{c} and \code{d}
Fred Drakef6669171998-05-06 19:52:49 +000094are guaranteed to refer to two different, unique, newly created empty
95lists.
Fred Drake82385871998-10-01 20:40:43 +000096(Note that \samp{c = d = []} assigns the same object to both
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000097\code{c} and \code{d}.)
Fred Drakef6669171998-05-06 19:52:49 +000098
Fred Drake2829f1c2001-06-23 05:27:20 +000099
Fred Drake61c77281998-07-28 19:34:22 +0000100\section{The standard type hierarchy\label{types}}
Fred Drakef6669171998-05-06 19:52:49 +0000101
102Below is a list of the types that are built into Python. Extension
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000103modules written in \C{} can define additional types. Future versions of
104Python may add types to the type hierarchy (e.g., rational
Fred Drakef6669171998-05-06 19:52:49 +0000105numbers, efficiently stored arrays of integers, etc.).
106\index{type}
107\indexii{data}{type}
108\indexii{type}{hierarchy}
109\indexii{extension}{module}
110\indexii{C}{language}
111
112Some of the type descriptions below contain a paragraph listing
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000113`special attributes.' These are attributes that provide access to the
Fred Drakef6669171998-05-06 19:52:49 +0000114implementation and are not intended for general use. Their definition
Fred Drake35705512001-12-03 17:32:27 +0000115may change in the future.
Fred Drakef6669171998-05-06 19:52:49 +0000116\index{attribute}
117\indexii{special}{attribute}
118\indexiii{generic}{special}{attribute}
Fred Drakef6669171998-05-06 19:52:49 +0000119
120\begin{description}
121
122\item[None]
123This type has a single value. There is a single object with this value.
124This object is accessed through the built-in name \code{None}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000125It is used to signify the absence of a value in many situations, e.g.,
126it is returned from functions that don't explicitly return anything.
127Its truth value is false.
Fred Drakef6669171998-05-06 19:52:49 +0000128\ttindex{None}
Fred Drake78eebfd1998-11-25 19:09:24 +0000129\obindex{None@{\texttt{None}}}
Fred Drakef6669171998-05-06 19:52:49 +0000130
Neil Schemenauer48c2eb92001-01-04 01:25:50 +0000131\item[NotImplemented]
132This type has a single value. There is a single object with this value.
133This object is accessed through the built-in name \code{NotImplemented}.
Guido van Rossumab782dd2001-01-18 15:17:06 +0000134Numeric methods and rich comparison methods may return this value if
135they do not implement the operation for the operands provided. (The
136interpreter will then try the reflected operation, or some other
137fallback, depending on the operator.) Its truth value is true.
Neil Schemenauer48c2eb92001-01-04 01:25:50 +0000138\ttindex{NotImplemented}
139\obindex{NotImplemented@{\texttt{NotImplemented}}}
140
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000141\item[Ellipsis]
142This type has a single value. There is a single object with this value.
143This object is accessed through the built-in name \code{Ellipsis}.
Fred Drake82385871998-10-01 20:40:43 +0000144It is used to indicate the presence of the \samp{...} syntax in a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000145slice. Its truth value is true.
Fred Drakec0a02c02002-04-16 02:03:05 +0000146\obindex{Ellipsis}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000147
Fred Drakef6669171998-05-06 19:52:49 +0000148\item[Numbers]
149These are created by numeric literals and returned as results by
150arithmetic operators and arithmetic built-in functions. Numeric
151objects are immutable; once created their value never changes. Python
152numbers are of course strongly related to mathematical numbers, but
153subject to the limitations of numerical representation in computers.
Fred Drakef6669171998-05-06 19:52:49 +0000154\obindex{numeric}
155
Fred Drakeb3384d32001-05-14 16:04:22 +0000156Python distinguishes between integers, floating point numbers, and
157complex numbers:
Fred Drakef6669171998-05-06 19:52:49 +0000158
159\begin{description}
160\item[Integers]
161These represent elements from the mathematical set of whole numbers.
162\obindex{integer}
163
Guido van Rossum77f6a652002-04-03 22:41:51 +0000164There are three types of integers:
Fred Drakef6669171998-05-06 19:52:49 +0000165
166\begin{description}
167
168\item[Plain integers]
169These represent numbers in the range -2147483648 through 2147483647.
170(The range may be larger on machines with a larger natural word
171size, but not smaller.)
Fred Drakee15956b2000-04-03 04:51:13 +0000172When the result of an operation would fall outside this range, the
Fred Drakef6669171998-05-06 19:52:49 +0000173exception \exception{OverflowError} is raised.
174For the purpose of shift and mask operations, integers are assumed to
175have a binary, 2's complement notation using 32 or more bits, and
176hiding no bits from the user (i.e., all 4294967296 different bit
177patterns correspond to different values).
178\obindex{plain integer}
179\withsubitem{(built-in exception)}{\ttindex{OverflowError}}
180
181\item[Long integers]
182These represent numbers in an unlimited range, subject to available
183(virtual) memory only. For the purpose of shift and mask operations,
184a binary representation is assumed, and negative numbers are
185represented in a variant of 2's complement which gives the illusion of
186an infinite string of sign bits extending to the left.
187\obindex{long integer}
188
Guido van Rossum77f6a652002-04-03 22:41:51 +0000189\item[Booleans]
190These represent the truth values False and True. The two objects
191representing the values False and True are the only Boolean objects.
192The Boolean type is a subtype of plain integers, and Boolean values
193behave like the values 0 and 1, respectively, in almost all contexts,
194the exception being that when converted to a string, the strings
195\code{"False"} or \code{"True"} are returned, respectively.
196\obindex{Boolean}
197\ttindex{False}
198\ttindex{True}
199
Fred Drakef6669171998-05-06 19:52:49 +0000200\end{description} % Integers
201
202The rules for integer representation are intended to give the most
203meaningful interpretation of shift and mask operations involving
204negative integers and the least surprises when switching between the
205plain and long integer domains. For any operation except left shift,
206if it yields a result in the plain integer domain without causing
207overflow, it will yield the same result in the long integer domain or
208when using mixed operands.
209\indexii{integer}{representation}
210
211\item[Floating point numbers]
212These represent machine-level double precision floating point numbers.
213You are at the mercy of the underlying machine architecture and
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000214\C{} implementation for the accepted range and handling of overflow.
215Python does not support single-precision floating point numbers; the
Fred Drake6e5e1d92001-07-14 02:12:27 +0000216savings in processor and memory usage that are usually the reason for using
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000217these is dwarfed by the overhead of using objects in Python, so there
218is no reason to complicate the language with two kinds of floating
219point numbers.
Fred Drakef6669171998-05-06 19:52:49 +0000220\obindex{floating point}
221\indexii{floating point}{number}
222\indexii{C}{language}
223
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000224\item[Complex numbers]
225These represent complex numbers as a pair of machine-level double
226precision floating point numbers. The same caveats apply as for
227floating point numbers. The real and imaginary value of a complex
228number \code{z} can be retrieved through the attributes \code{z.real}
229and \code{z.imag}.
230\obindex{complex}
231\indexii{complex}{number}
232
Fred Drakef6669171998-05-06 19:52:49 +0000233\end{description} % Numbers
234
Guido van Rossum77f6a652002-04-03 22:41:51 +0000235
Fred Drakef6669171998-05-06 19:52:49 +0000236\item[Sequences]
Fred Drake230d17d2001-02-22 21:28:04 +0000237These represent finite ordered sets indexed by non-negative numbers.
Fred Drakef6669171998-05-06 19:52:49 +0000238The built-in function \function{len()}\bifuncindex{len} returns the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000239number of items of a sequence.
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000240When the length of a sequence is \var{n}, the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000241index set contains the numbers 0, 1, \ldots, \var{n}-1. Item
Fred Drakef6669171998-05-06 19:52:49 +0000242\var{i} of sequence \var{a} is selected by \code{\var{a}[\var{i}]}.
Fred Drakee15956b2000-04-03 04:51:13 +0000243\obindex{sequence}
Fred Drakef6669171998-05-06 19:52:49 +0000244\index{index operation}
245\index{item selection}
246\index{subscription}
247
248Sequences also support slicing: \code{\var{a}[\var{i}:\var{j}]}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000249selects all items with index \var{k} such that \var{i} \code{<=}
Fred Drakef6669171998-05-06 19:52:49 +0000250\var{k} \code{<} \var{j}. When used as an expression, a slice is a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000251sequence of the same type. This implies that the index set is
252renumbered so that it starts at 0.
Fred Drakef6669171998-05-06 19:52:49 +0000253\index{slicing}
254
Michael W. Hudson5efaf7e2002-06-11 10:55:12 +0000255Some sequences also support ``extended slicing'' with a third ``step''
256parameter: \code{\var{a}[\var{i}:\var{j}:\var{k}]} selects all items
257of \var{a} with index \var{x} where \code{\var{x} = \var{i} +
258\var{n}*\var{k}}, \var{n} \code{>=} \code{0} and \var{i} \code{<=}
259\var{x} \code{<} \var{j}.
260\index{extended slicing}
261
Fred Drakef6669171998-05-06 19:52:49 +0000262Sequences are distinguished according to their mutability:
263
264\begin{description}
Fred Drake4856d011999-01-12 04:15:20 +0000265
Fred Drakef6669171998-05-06 19:52:49 +0000266\item[Immutable sequences]
267An object of an immutable sequence type cannot change once it is
268created. (If the object contains references to other objects,
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000269these other objects may be mutable and may be changed; however,
Fred Drakef6669171998-05-06 19:52:49 +0000270the collection of objects directly referenced by an immutable object
271cannot change.)
272\obindex{immutable sequence}
273\obindex{immutable}
274
275The following types are immutable sequences:
276
277\begin{description}
278
279\item[Strings]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000280The items of a string are characters. There is no separate
281character type; a character is represented by a string of one item.
Fred Drakef6669171998-05-06 19:52:49 +0000282Characters represent (at least) 8-bit bytes. The built-in
283functions \function{chr()}\bifuncindex{chr} and
284\function{ord()}\bifuncindex{ord} convert between characters and
285nonnegative integers representing the byte values. Bytes with the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000286values 0-127 usually represent the corresponding \ASCII{} values, but
287the interpretation of values is up to the program. The string
288data type is also used to represent arrays of bytes, e.g., to hold data
Fred Drakef6669171998-05-06 19:52:49 +0000289read from a file.
290\obindex{string}
291\index{character}
292\index{byte}
Fred Drakec37b65e2001-11-28 07:26:15 +0000293\index{ASCII@\ASCII}
Fred Drakef6669171998-05-06 19:52:49 +0000294
Fred Drakec37b65e2001-11-28 07:26:15 +0000295(On systems whose native character set is not \ASCII, strings may use
Fred Drakef6669171998-05-06 19:52:49 +0000296EBCDIC in their internal representation, provided the functions
297\function{chr()} and \function{ord()} implement a mapping between \ASCII{} and
298EBCDIC, and string comparison preserves the \ASCII{} order.
299Or perhaps someone can propose a better rule?)
Fred Drakec37b65e2001-11-28 07:26:15 +0000300\index{ASCII@\ASCII}
Fred Drakef6669171998-05-06 19:52:49 +0000301\index{EBCDIC}
302\index{character set}
303\indexii{string}{comparison}
304\bifuncindex{chr}
305\bifuncindex{ord}
306
Fred Drakef0aff8e2000-04-06 13:57:21 +0000307\item[Unicode]
Fred Drake5ec22f22002-09-24 21:09:13 +0000308The items of a Unicode object are Unicode code units. A Unicode code
309unit is represented by a Unicode object of one item and can hold
310either a 16-bit or 32-bit value representing a Unicode ordinal (the
311maximum value for the ordinal is given in \code{sys.maxunicode}, and
312depends on how Python is configured at compile time). Surrogate pairs
313may be present in the Unicode object, and will be reported as two
314separate items. The built-in functions
Fred Drakef0aff8e2000-04-06 13:57:21 +0000315\function{unichr()}\bifuncindex{unichr} and
Fred Drake5ec22f22002-09-24 21:09:13 +0000316\function{ord()}\bifuncindex{ord} convert between code units and
Fred Drakef0aff8e2000-04-06 13:57:21 +0000317nonnegative integers representing the Unicode ordinals as defined in
318the Unicode Standard 3.0. Conversion from and to other encodings are
319possible through the Unicode method \method{encode} and the built-in
Fred Drake5ec22f22002-09-24 21:09:13 +0000320function \function{unicode()}.\bifuncindex{unicode}
Fred Drakef0aff8e2000-04-06 13:57:21 +0000321\obindex{unicode}
322\index{character}
323\index{integer}
Fred Drake8b3ce9e2000-04-06 14:00:14 +0000324\index{Unicode}
Fred Drakef0aff8e2000-04-06 13:57:21 +0000325
Fred Drakef6669171998-05-06 19:52:49 +0000326\item[Tuples]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000327The items of a tuple are arbitrary Python objects.
328Tuples of two or more items are formed by comma-separated lists
329of expressions. A tuple of one item (a `singleton') can be formed
Fred Drakef6669171998-05-06 19:52:49 +0000330by affixing a comma to an expression (an expression by itself does
331not create a tuple, since parentheses must be usable for grouping of
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000332expressions). An empty tuple can be formed by an empty pair of
Fred Drakef6669171998-05-06 19:52:49 +0000333parentheses.
334\obindex{tuple}
335\indexii{singleton}{tuple}
336\indexii{empty}{tuple}
337
338\end{description} % Immutable sequences
339
340\item[Mutable sequences]
341Mutable sequences can be changed after they are created. The
342subscription and slicing notations can be used as the target of
343assignment and \keyword{del} (delete) statements.
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000344\obindex{mutable sequence}
Fred Drakef6669171998-05-06 19:52:49 +0000345\obindex{mutable}
346\indexii{assignment}{statement}
347\index{delete}
348\stindex{del}
349\index{subscription}
350\index{slicing}
351
352There is currently a single mutable sequence type:
353
354\begin{description}
355
356\item[Lists]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000357The items of a list are arbitrary Python objects. Lists are formed
Fred Drakef6669171998-05-06 19:52:49 +0000358by placing a comma-separated list of expressions in square brackets.
359(Note that there are no special cases needed to form lists of length 0
360or 1.)
361\obindex{list}
362
363\end{description} % Mutable sequences
364
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000365The extension module \module{array}\refstmodindex{array} provides an
366additional example of a mutable sequence type.
367
368
Fred Drakef6669171998-05-06 19:52:49 +0000369\end{description} % Sequences
370
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000371\item[Mappings]
Fred Drakef6669171998-05-06 19:52:49 +0000372These represent finite sets of objects indexed by arbitrary index sets.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000373The subscript notation \code{a[k]} selects the item indexed
Fred Drakef6669171998-05-06 19:52:49 +0000374by \code{k} from the mapping \code{a}; this can be used in
375expressions and as the target of assignments or \keyword{del} statements.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000376The built-in function \function{len()} returns the number of items
Fred Drakef6669171998-05-06 19:52:49 +0000377in a mapping.
378\bifuncindex{len}
379\index{subscription}
380\obindex{mapping}
381
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000382There is currently a single intrinsic mapping type:
Fred Drakef6669171998-05-06 19:52:49 +0000383
384\begin{description}
385
386\item[Dictionaries]
Fred Drake8cdee961999-02-23 18:50:38 +0000387These\obindex{dictionary} represent finite sets of objects indexed by
388nearly arbitrary values. The only types of values not acceptable as
389keys are values containing lists or dictionaries or other mutable
390types that are compared by value rather than by object identity, the
391reason being that the efficient implementation of dictionaries
392requires a key's hash value to remain constant.
Fred Drakef6669171998-05-06 19:52:49 +0000393Numeric types used for keys obey the normal rules for numeric
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000394comparison: if two numbers compare equal (e.g., \code{1} and
Fred Drakef6669171998-05-06 19:52:49 +0000395\code{1.0}) then they can be used interchangeably to index the same
396dictionary entry.
397
Fred Drakeed5a7ca2001-09-10 15:16:08 +0000398Dictionaries are mutable; they are created by the
Fred Drake8cdee961999-02-23 18:50:38 +0000399\code{\{...\}} notation (see section \ref{dict}, ``Dictionary
400Displays'').
Fred Drakef6669171998-05-06 19:52:49 +0000401
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000402The extension modules \module{dbm}\refstmodindex{dbm},
403\module{gdbm}\refstmodindex{gdbm}, \module{bsddb}\refstmodindex{bsddb}
404provide additional examples of mapping types.
405
Fred Drakef6669171998-05-06 19:52:49 +0000406\end{description} % Mapping types
407
408\item[Callable types]
Fred Drake8cdee961999-02-23 18:50:38 +0000409These\obindex{callable} are the types to which the function call
410operation (see section \ref{calls}, ``Calls'') can be applied:
Fred Drakef6669171998-05-06 19:52:49 +0000411\indexii{function}{call}
412\index{invocation}
413\indexii{function}{argument}
Fred Drakef6669171998-05-06 19:52:49 +0000414
415\begin{description}
416
417\item[User-defined functions]
418A user-defined function object is created by a function definition
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000419(see section \ref{function}, ``Function definitions''). It should be
420called with an argument
Fred Drakef6669171998-05-06 19:52:49 +0000421list containing the same number of items as the function's formal
422parameter list.
423\indexii{user-defined}{function}
424\obindex{function}
425\obindex{user-defined function}
426
Guido van Rossum264bd591999-02-23 16:40:55 +0000427Special attributes: \member{func_doc} or \member{__doc__} is the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000428function's documentation string, or None if unavailable;
Fred Drake82385871998-10-01 20:40:43 +0000429\member{func_name} or \member{__name__} is the function's name;
430\member{func_defaults} is a tuple containing default argument values for
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000431those arguments that have defaults, or \code{None} if no arguments
Fred Drake82385871998-10-01 20:40:43 +0000432have a default value; \member{func_code} is the code object representing
433the compiled function body; \member{func_globals} is (a reference to)
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000434the dictionary that holds the function's global variables --- it
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000435defines the global namespace of the module in which the function was
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000436defined; \member{func_dict} or \member{__dict__} contains the
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000437namespace supporting arbitrary function attributes;
438\member{func_closure} is \code{None} or a tuple of cells that contain
Jeremy Hylton26c49b62002-04-01 17:58:39 +0000439bindings for the function's free variables.
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000440
Jeremy Hylton26c49b62002-04-01 17:58:39 +0000441Of these, \member{func_code}, \member{func_defaults},
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000442\member{func_doc}/\member{__doc__}, and
443\member{func_dict}/\member{__dict__} may be writable; the
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000444others can never be changed. Additional information about a
445function's definition can be retrieved from its code object; see the
446description of internal types below.
447
Fred Drake4856d011999-01-12 04:15:20 +0000448\withsubitem{(function attribute)}{
449 \ttindex{func_doc}
450 \ttindex{__doc__}
451 \ttindex{__name__}
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000452 \ttindex{__dict__}
Fred Drake4856d011999-01-12 04:15:20 +0000453 \ttindex{func_defaults}
Jeremy Hylton26c49b62002-04-01 17:58:39 +0000454 \ttindex{func_closure}
Fred Drake4856d011999-01-12 04:15:20 +0000455 \ttindex{func_code}
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000456 \ttindex{func_globals}
457 \ttindex{func_dict}}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000458\indexii{global}{namespace}
Fred Drakef6669171998-05-06 19:52:49 +0000459
460\item[User-defined methods]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000461A user-defined method object combines a class, a class instance (or
Fred Drake8dd6ffd2001-08-02 21:34:53 +0000462\code{None}) and any callable object (normally a user-defined
463function).
Fred Drakef6669171998-05-06 19:52:49 +0000464\obindex{method}
465\obindex{user-defined method}
466\indexii{user-defined}{method}
Fred Drakef6669171998-05-06 19:52:49 +0000467
468Special read-only attributes: \member{im_self} is the class instance
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000469object, \member{im_func} is the function object;
Guido van Rossumb62f0e12001-12-07 22:03:18 +0000470\member{im_class} is the class of \member{im_self} for bound methods,
471or the class that asked for the method for unbound methods);
Fred Drake82385871998-10-01 20:40:43 +0000472\member{__doc__} is the method's documentation (same as
473\code{im_func.__doc__}); \member{__name__} is the method name (same as
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000474\code{im_func.__name__}).
Fred Drakef9d58032001-12-07 23:13:53 +0000475\versionchanged[\member{im_self} used to refer to the class that
476 defined the method]{2.2}
Fred Drake4856d011999-01-12 04:15:20 +0000477\withsubitem{(method attribute)}{
478 \ttindex{im_func}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000479 \ttindex{im_self}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000480
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000481Methods also support accessing (but not setting) the arbitrary
482function attributes on the underlying function object.
483
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000484User-defined method objects are created in two ways: when getting an
485attribute of a class that is a user-defined function object, or when
Fred Drake35c09f22000-06-28 20:15:47 +0000486getting an attribute of a class instance that is a user-defined
487function object defined by the class of the instance. In the former
488case (class attribute), the \member{im_self} attribute is \code{None},
489and the method object is said to be unbound; in the latter case
490(instance attribute), \method{im_self} is the instance, and the method
491object is said to be bound. For
Guido van Rossumb62f0e12001-12-07 22:03:18 +0000492instance, when \class{C} is a class which has a method
493\method{f()}, \code{C.f} does not yield the function object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000494\code{f}; rather, it yields an unbound method object \code{m} where
Fred Drake82385871998-10-01 20:40:43 +0000495\code{m.im_class} is \class{C}, \code{m.im_func} is \method{f()}, and
496\code{m.im_self} is \code{None}. When \code{x} is a \class{C}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000497instance, \code{x.f} yields a bound method object \code{m} where
Fred Drake82385871998-10-01 20:40:43 +0000498\code{m.im_class} is \code{C}, \code{m.im_func} is \method{f()}, and
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000499\code{m.im_self} is \code{x}.
Fred Drake4856d011999-01-12 04:15:20 +0000500\withsubitem{(method attribute)}{
Fred Drake35c09f22000-06-28 20:15:47 +0000501 \ttindex{im_class}\ttindex{im_func}\ttindex{im_self}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000502
503When an unbound user-defined method object is called, the underlying
Fred Drake82385871998-10-01 20:40:43 +0000504function (\member{im_func}) is called, with the restriction that the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000505first argument must be an instance of the proper class
Fred Drake82385871998-10-01 20:40:43 +0000506(\member{im_class}) or of a derived class thereof.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000507
508When a bound user-defined method object is called, the underlying
Fred Drake82385871998-10-01 20:40:43 +0000509function (\member{im_func}) is called, inserting the class instance
510(\member{im_self}) in front of the argument list. For instance, when
511\class{C} is a class which contains a definition for a function
512\method{f()}, and \code{x} is an instance of \class{C}, calling
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000513\code{x.f(1)} is equivalent to calling \code{C.f(x, 1)}.
514
515Note that the transformation from function object to (unbound or
516bound) method object happens each time the attribute is retrieved from
517the class or instance. In some cases, a fruitful optimization is to
518assign the attribute to a local variable and call that local variable.
519Also notice that this transformation only happens for user-defined
520functions; other callable objects (and all non-callable objects) are
Fred Drake35c09f22000-06-28 20:15:47 +0000521retrieved without transformation. It is also important to note that
522user-defined functions which are attributes of a class instance are
523not converted to bound methods; this \emph{only} happens when the
524function is an attribute of the class.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000525
Fred Drakee31e9ce2001-12-11 21:10:08 +0000526\item[Generator functions\index{generator!function}\index{generator!iterator}]
527A function or method which uses the \keyword{yield} statement (see
528section~\ref{yield}, ``The \keyword{yield} statement'') is called a
529\dfn{generator function}. Such a function, when called, always
530returns an iterator object which can be used to execute the body of
531the function: calling the iterator's \method{next()} method will
532cause the function to execute until it provides a value using the
533\keyword{yield} statement. When the function executes a
534\keyword{return} statement or falls off the end, a
535\exception{StopIteration} exception is raised and the iterator will
536have reached the end of the set of values to be returned.
537
Fred Drakef6669171998-05-06 19:52:49 +0000538\item[Built-in functions]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000539A built-in function object is a wrapper around a \C{} function. Examples
540of built-in functions are \function{len()} and \function{math.sin()}
541(\module{math} is a standard built-in module).
542The number and type of the arguments are
Fred Drakef6669171998-05-06 19:52:49 +0000543determined by the C function.
Fred Drake82385871998-10-01 20:40:43 +0000544Special read-only attributes: \member{__doc__} is the function's
545documentation string, or \code{None} if unavailable; \member{__name__}
546is the function's name; \member{__self__} is set to \code{None} (but see
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000547the next item).
Fred Drakef6669171998-05-06 19:52:49 +0000548\obindex{built-in function}
549\obindex{function}
550\indexii{C}{language}
551
552\item[Built-in methods]
553This is really a different disguise of a built-in function, this time
554containing an object passed to the \C{} function as an implicit extra
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000555argument. An example of a built-in method is
556\code{\var{list}.append()}, assuming
Fred Drakef6669171998-05-06 19:52:49 +0000557\var{list} is a list object.
Fred Drake82385871998-10-01 20:40:43 +0000558In this case, the special read-only attribute \member{__self__} is set
Fred Drakee31e9ce2001-12-11 21:10:08 +0000559to the object denoted by \var{list}.
Fred Drakef6669171998-05-06 19:52:49 +0000560\obindex{built-in method}
561\obindex{method}
562\indexii{built-in}{method}
563
564\item[Classes]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000565Class objects are described below. When a class object is called,
566a new class instance (also described below) is created and
Fred Drakef6669171998-05-06 19:52:49 +0000567returned. This implies a call to the class's \method{__init__()} method
568if it has one. Any arguments are passed on to the \method{__init__()}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000569method. If there is no \method{__init__()} method, the class must be called
Fred Drakef6669171998-05-06 19:52:49 +0000570without arguments.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000571\withsubitem{(object method)}{\ttindex{__init__()}}
Fred Drakef6669171998-05-06 19:52:49 +0000572\obindex{class}
573\obindex{class instance}
574\obindex{instance}
575\indexii{class object}{call}
576
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000577\item[Class instances]
578Class instances are described below. Class instances are callable
Fred Drake82385871998-10-01 20:40:43 +0000579only when the class has a \method{__call__()} method; \code{x(arguments)}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000580is a shorthand for \code{x.__call__(arguments)}.
581
Fred Drakef6669171998-05-06 19:52:49 +0000582\end{description}
583
584\item[Modules]
585Modules are imported by the \keyword{import} statement (see section
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000586\ref{import}, ``The \keyword{import} statement'').
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000587A module object has a namespace implemented by a dictionary object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000588(this is the dictionary referenced by the func_globals attribute of
589functions defined in the module). Attribute references are translated
590to lookups in this dictionary, e.g., \code{m.x} is equivalent to
591\code{m.__dict__["x"]}.
592A module object does not contain the code object used to
Fred Drakef6669171998-05-06 19:52:49 +0000593initialize the module (since it isn't needed once the initialization
594is done).
595\stindex{import}
596\obindex{module}
597
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000598Attribute assignment updates the module's namespace dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000599e.g., \samp{m.x = 1} is equivalent to \samp{m.__dict__["x"] = 1}.
Fred Drakef6669171998-05-06 19:52:49 +0000600
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000601Special read-only attribute: \member{__dict__} is the module's
602namespace as a dictionary object.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000603\withsubitem{(module attribute)}{\ttindex{__dict__}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000604
605Predefined (writable) attributes: \member{__name__}
606is the module's name; \member{__doc__} is the
607module's documentation string, or
Fred Drake82385871998-10-01 20:40:43 +0000608\code{None} if unavailable; \member{__file__} is the pathname of the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000609file from which the module was loaded, if it was loaded from a file.
Fred Drake82385871998-10-01 20:40:43 +0000610The \member{__file__} attribute is not present for C{} modules that are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000611statically linked into the interpreter; for extension modules loaded
612dynamically from a shared library, it is the pathname of the shared
613library file.
Fred Drake4856d011999-01-12 04:15:20 +0000614\withsubitem{(module attribute)}{
615 \ttindex{__name__}
616 \ttindex{__doc__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000617 \ttindex{__file__}}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000618\indexii{module}{namespace}
Fred Drakef6669171998-05-06 19:52:49 +0000619
620\item[Classes]
621Class objects are created by class definitions (see section
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000622\ref{class}, ``Class definitions'').
623A class has a namespace implemented by a dictionary object.
624Class attribute references are translated to
625lookups in this dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000626e.g., \samp{C.x} is translated to \samp{C.__dict__["x"]}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000627When the attribute name is not found
Fred Drakef6669171998-05-06 19:52:49 +0000628there, the attribute search continues in the base classes. The search
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000629is depth-first, left-to-right in the order of occurrence in the
Fred Drakef6669171998-05-06 19:52:49 +0000630base class list.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000631When a class attribute reference would yield a user-defined function
632object, it is transformed into an unbound user-defined method object
Fred Drake82385871998-10-01 20:40:43 +0000633(see above). The \member{im_class} attribute of this method object is the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000634class for which the attribute reference was initiated.
Fred Drakef6669171998-05-06 19:52:49 +0000635\obindex{class}
636\obindex{class instance}
637\obindex{instance}
638\indexii{class object}{call}
639\index{container}
640\obindex{dictionary}
641\indexii{class}{attribute}
642
643Class attribute assignments update the class's dictionary, never the
644dictionary of a base class.
645\indexiii{class}{attribute}{assignment}
646
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000647A class object can be called (see above) to yield a class instance (see
648below).
Fred Drakef6669171998-05-06 19:52:49 +0000649\indexii{class object}{call}
650
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000651Special attributes: \member{__name__} is the class name;
652\member{__module__} is the module name in which the class was defined;
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000653\member{__dict__} is the dictionary containing the class's namespace;
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000654\member{__bases__} is a tuple (possibly empty or a singleton)
655containing the base classes, in the order of their occurrence in the
Fred Drake82385871998-10-01 20:40:43 +0000656base class list; \member{__doc__} is the class's documentation string,
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000657or None if undefined.
Fred Drake4856d011999-01-12 04:15:20 +0000658\withsubitem{(class attribute)}{
659 \ttindex{__name__}
660 \ttindex{__module__}
661 \ttindex{__dict__}
662 \ttindex{__bases__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000663 \ttindex{__doc__}}
Fred Drakef6669171998-05-06 19:52:49 +0000664
665\item[Class instances]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000666A class instance is created by calling a class object (see above).
667A class instance has a namespace implemented as a dictionary which
668is the first place in which
Fred Drakef6669171998-05-06 19:52:49 +0000669attribute references are searched. When an attribute is not found
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000670there, and the instance's class has an attribute by that name,
671the search continues with the class attributes. If a class attribute
672is found that is a user-defined function object (and in no other
673case), it is transformed into an unbound user-defined method object
Fred Drake82385871998-10-01 20:40:43 +0000674(see above). The \member{im_class} attribute of this method object is
Guido van Rossumb62f0e12001-12-07 22:03:18 +0000675the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000676class of the instance for which the attribute reference was initiated.
677If no class attribute is found, and the object's class has a
Fred Drake82385871998-10-01 20:40:43 +0000678\method{__getattr__()} method, that is called to satisfy the lookup.
Fred Drakef6669171998-05-06 19:52:49 +0000679\obindex{class instance}
680\obindex{instance}
681\indexii{class}{instance}
682\indexii{class instance}{attribute}
683
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000684Attribute assignments and deletions update the instance's dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000685never a class's dictionary. If the class has a \method{__setattr__()} or
686\method{__delattr__()} method, this is called instead of updating the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000687instance dictionary directly.
Fred Drakef6669171998-05-06 19:52:49 +0000688\indexiii{class instance}{attribute}{assignment}
689
690Class instances can pretend to be numbers, sequences, or mappings if
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000691they have methods with certain special names. See
692section \ref{specialnames}, ``Special method names.''
Fred Drakee15956b2000-04-03 04:51:13 +0000693\obindex{numeric}
Fred Drakef6669171998-05-06 19:52:49 +0000694\obindex{sequence}
695\obindex{mapping}
696
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000697Special attributes: \member{__dict__} is the attribute
698dictionary; \member{__class__} is the instance's class.
Fred Drake4856d011999-01-12 04:15:20 +0000699\withsubitem{(instance attribute)}{
700 \ttindex{__dict__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000701 \ttindex{__class__}}
Fred Drakef6669171998-05-06 19:52:49 +0000702
703\item[Files]
Fred Drakee15eb351999-11-10 16:13:25 +0000704A file\obindex{file} object represents an open file. File objects are
705created by the \function{open()}\bifuncindex{open} built-in function,
706and also by
707\withsubitem{(in module os)}{\ttindex{popen()}}\function{os.popen()},
708\function{os.fdopen()}, and the
709\method{makefile()}\withsubitem{(socket method)}{\ttindex{makefile()}}
710method of socket objects (and perhaps by other functions or methods
711provided by extension modules). The objects
712\ttindex{sys.stdin}\code{sys.stdin},
713\ttindex{sys.stdout}\code{sys.stdout} and
714\ttindex{sys.stderr}\code{sys.stderr} are initialized to file objects
715corresponding to the interpreter's standard\index{stdio} input, output
716and error streams. See the \citetitle[../lib/lib.html]{Python Library
717Reference} for complete documentation of file objects.
Fred Drake4856d011999-01-12 04:15:20 +0000718\withsubitem{(in module sys)}{
719 \ttindex{stdin}
720 \ttindex{stdout}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000721 \ttindex{stderr}}
Fred Drakee15eb351999-11-10 16:13:25 +0000722
Fred Drakef6669171998-05-06 19:52:49 +0000723
724\item[Internal types]
725A few types used internally by the interpreter are exposed to the user.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000726Their definitions may change with future versions of the interpreter,
Fred Drakef6669171998-05-06 19:52:49 +0000727but they are mentioned here for completeness.
728\index{internal type}
729\index{types, internal}
730
731\begin{description}
732
733\item[Code objects]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000734Code objects represent \emph{byte-compiled} executable Python code, or
735\emph{bytecode}.
Fred Drakef6669171998-05-06 19:52:49 +0000736The difference between a code
737object and a function object is that the function object contains an
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000738explicit reference to the function's globals (the module in which it
739was defined), while a code object contains no context;
740also the default argument values are stored in the function object,
741not in the code object (because they represent values calculated at
742run-time). Unlike function objects, code objects are immutable and
743contain no references (directly or indirectly) to mutable objects.
744\index{bytecode}
Fred Drakef6669171998-05-06 19:52:49 +0000745\obindex{code}
746
Fred Drake1e42d8a1998-11-25 17:58:50 +0000747Special read-only attributes: \member{co_name} gives the function
748name; \member{co_argcount} is the number of positional arguments
749(including arguments with default values); \member{co_nlocals} is the
750number of local variables used by the function (including arguments);
751\member{co_varnames} is a tuple containing the names of the local
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000752variables (starting with the argument names); \member{co_cellvars} is
753a tuple containing the names of local variables that are referenced by
754nested functions; \member{co_freevars} is a tuple containing the names
Jeremy Hylton8392f362002-04-01 18:53:36 +0000755of free variables; \member{co_code} is a string representing the
756sequence of bytecode instructions;
Fred Drake1e42d8a1998-11-25 17:58:50 +0000757\member{co_consts} is a tuple containing the literals used by the
758bytecode; \member{co_names} is a tuple containing the names used by
759the bytecode; \member{co_filename} is the filename from which the code
760was compiled; \member{co_firstlineno} is the first line number of the
761function; \member{co_lnotab} is a string encoding the mapping from
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000762byte code offsets to line numbers (for details see the source code of
Fred Drake1e42d8a1998-11-25 17:58:50 +0000763the interpreter); \member{co_stacksize} is the required stack size
764(including local variables); \member{co_flags} is an integer encoding
765a number of flags for the interpreter.
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000766
Fred Drake4856d011999-01-12 04:15:20 +0000767\withsubitem{(code object attribute)}{
768 \ttindex{co_argcount}
769 \ttindex{co_code}
770 \ttindex{co_consts}
771 \ttindex{co_filename}
772 \ttindex{co_firstlineno}
773 \ttindex{co_flags}
774 \ttindex{co_lnotab}
775 \ttindex{co_name}
776 \ttindex{co_names}
777 \ttindex{co_nlocals}
778 \ttindex{co_stacksize}
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000779 \ttindex{co_varnames}
780 \ttindex{co_cellvars}
781 \ttindex{co_freevars}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000782
Fred Drakee15956b2000-04-03 04:51:13 +0000783The following flag bits are defined for \member{co_flags}: bit
784\code{0x04} is set if the function uses the \samp{*arguments} syntax
785to accept an arbitrary number of positional arguments; bit
786\code{0x08} is set if the function uses the \samp{**keywords} syntax
Jeremy Hylton8392f362002-04-01 18:53:36 +0000787to accept arbitrary keyword arguments; bit \code{0x20} is set if the
788function is a \obindex{generator}.
789
790Future feature declarations (\samp{from __future__ import division})
791also use bits in \member{co_flags} to indicate whether a code object
792was compiled with a particular feature enabled: bit \code{0x2000} is
793set if the function was compiled with future division enabled; bits
794\code{0x10} and \code{0x1000} were used in earlier versions of Python.
795
796Other bits in \member{co_flags} are reserved for internal use.
797
798If\index{documentation string} a code object represents a function,
799the first item in
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000800\member{co_consts} is the documentation string of the function, or
801\code{None} if undefined.
Fred Drakef6669171998-05-06 19:52:49 +0000802
803\item[Frame objects]
804Frame objects represent execution frames. They may occur in traceback
805objects (see below).
806\obindex{frame}
807
808Special read-only attributes: \member{f_back} is to the previous
809stack frame (towards the caller), or \code{None} if this is the bottom
810stack frame; \member{f_code} is the code object being executed in this
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000811frame; \member{f_locals} is the dictionary used to look up local
812variables; \member{f_globals} is used for global variables;
Fred Drake82385871998-10-01 20:40:43 +0000813\member{f_builtins} is used for built-in (intrinsic) names;
814\member{f_restricted} is a flag indicating whether the function is
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000815executing in restricted execution mode;
Fred Drakef6669171998-05-06 19:52:49 +0000816\member{f_lineno} gives the line number and \member{f_lasti} gives the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000817precise instruction (this is an index into the bytecode string of
Fred Drakef6669171998-05-06 19:52:49 +0000818the code object).
Fred Drake4856d011999-01-12 04:15:20 +0000819\withsubitem{(frame attribute)}{
820 \ttindex{f_back}
821 \ttindex{f_code}
822 \ttindex{f_globals}
823 \ttindex{f_locals}
824 \ttindex{f_lineno}
825 \ttindex{f_lasti}
826 \ttindex{f_builtins}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000827 \ttindex{f_restricted}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000828
Fred Drake82385871998-10-01 20:40:43 +0000829Special writable attributes: \member{f_trace}, if not \code{None}, is a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000830function called at the start of each source code line (this is used by
Fred Drake82385871998-10-01 20:40:43 +0000831the debugger); \member{f_exc_type}, \member{f_exc_value},
832\member{f_exc_traceback} represent the most recent exception caught in
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000833this frame.
Fred Drake4856d011999-01-12 04:15:20 +0000834\withsubitem{(frame attribute)}{
835 \ttindex{f_trace}
836 \ttindex{f_exc_type}
837 \ttindex{f_exc_value}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000838 \ttindex{f_exc_traceback}}
Fred Drakef6669171998-05-06 19:52:49 +0000839
840\item[Traceback objects] \label{traceback}
841Traceback objects represent a stack trace of an exception. A
842traceback object is created when an exception occurs. When the search
843for an exception handler unwinds the execution stack, at each unwound
844level a traceback object is inserted in front of the current
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000845traceback. When an exception handler is entered, the stack trace is
846made available to the program.
847(See section \ref{try}, ``The \code{try} statement.'')
848It is accessible as \code{sys.exc_traceback}, and also as the third
849item of the tuple returned by \code{sys.exc_info()}. The latter is
850the preferred interface, since it works correctly when the program is
851using multiple threads.
852When the program contains no suitable handler, the stack trace is written
Fred Drakef6669171998-05-06 19:52:49 +0000853(nicely formatted) to the standard error stream; if the interpreter is
854interactive, it is also made available to the user as
855\code{sys.last_traceback}.
856\obindex{traceback}
857\indexii{stack}{trace}
858\indexii{exception}{handler}
859\indexii{execution}{stack}
Fred Drake4856d011999-01-12 04:15:20 +0000860\withsubitem{(in module sys)}{
861 \ttindex{exc_info}
862 \ttindex{exc_traceback}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000863 \ttindex{last_traceback}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000864\ttindex{sys.exc_info}
Fred Drakef6669171998-05-06 19:52:49 +0000865\ttindex{sys.exc_traceback}
866\ttindex{sys.last_traceback}
867
868Special read-only attributes: \member{tb_next} is the next level in the
869stack trace (towards the frame where the exception occurred), or
870\code{None} if there is no next level; \member{tb_frame} points to the
871execution frame of the current level; \member{tb_lineno} gives the line
872number where the exception occurred; \member{tb_lasti} indicates the
873precise instruction. The line number and last instruction in the
874traceback may differ from the line number of its frame object if the
875exception occurred in a \keyword{try} statement with no matching
876except clause or with a finally clause.
Fred Drake4856d011999-01-12 04:15:20 +0000877\withsubitem{(traceback attribute)}{
878 \ttindex{tb_next}
879 \ttindex{tb_frame}
880 \ttindex{tb_lineno}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000881 \ttindex{tb_lasti}}
Fred Drakef6669171998-05-06 19:52:49 +0000882\stindex{try}
883
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000884\item[Slice objects]
885Slice objects are used to represent slices when \emph{extended slice
886syntax} is used. This is a slice using two colons, or multiple slices
887or ellipses separated by commas, e.g., \code{a[i:j:step]}, \code{a[i:j,
888k:l]}, or \code{a[..., i:j])}. They are also created by the built-in
Fred Drake1e42d8a1998-11-25 17:58:50 +0000889\function{slice()}\bifuncindex{slice} function.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000890
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000891Special read-only attributes: \member{start} is the lower bound;
892\member{stop} is the upper bound; \member{step} is the step value; each is
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000893\code{None} if omitted. These attributes can have any type.
Fred Drake4856d011999-01-12 04:15:20 +0000894\withsubitem{(slice object attribute)}{
895 \ttindex{start}
896 \ttindex{stop}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000897 \ttindex{step}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000898
Fred Drake5ec22f22002-09-24 21:09:13 +0000899Slice objects support one method:
900
901\begin{methoddesc}[slice]{indices}{self, length}
902This method takes a single integer argument \var{length} and computes
903information about the extended slice that the slice object would
904describe if applied to a sequence of \var{length} items. It returns a
905tuple of three integers; respectively these are the \var{start} and
906\var{stop} indices and the \var{step} or stride length of the slice.
907Missing or out-of-bounds indices are handled in a manner consistent
908with regular slices.
Michael W. Hudsonf0d777c2002-07-19 15:47:06 +0000909\versionadded{2.3}
Fred Drake5ec22f22002-09-24 21:09:13 +0000910\end{methoddesc}
Michael W. Hudsonf0d777c2002-07-19 15:47:06 +0000911
Fred Drakef6669171998-05-06 19:52:49 +0000912\end{description} % Internal types
913
914\end{description} % Types
915
916
Fred Drake61c77281998-07-28 19:34:22 +0000917\section{Special method names\label{specialnames}}
Fred Drakef6669171998-05-06 19:52:49 +0000918
919A class can implement certain operations that are invoked by special
Fred Draked82575d1998-08-28 20:03:12 +0000920syntax (such as arithmetic operations or subscripting and slicing) by
921defining methods with special names. For instance, if a class defines
922a method named \method{__getitem__()}, and \code{x} is an instance of
923this class, then \code{x[i]} is equivalent to
Raymond Hettinger94153092002-05-12 03:09:25 +0000924\code{x.__getitem__(i)}. Except where mentioned, attempts to execute
925an operation raise an exception when no appropriate method is defined.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000926\withsubitem{(mapping object method)}{\ttindex{__getitem__()}}
Fred Drakef6669171998-05-06 19:52:49 +0000927
Fred Drake0c475592000-12-07 04:49:34 +0000928When implementing a class that emulates any built-in type, it is
929important that the emulation only be implemented to the degree that it
930makes sense for the object being modelled. For example, some
931sequences may work well with retrieval of individual elements, but
932extracting a slice may not make sense. (One example of this is the
933\class{NodeList} interface in the W3C's Document Object Model.)
934
Fred Drakef6669171998-05-06 19:52:49 +0000935
Fred Drake61c77281998-07-28 19:34:22 +0000936\subsection{Basic customization\label{customization}}
Fred Drakef6669171998-05-06 19:52:49 +0000937
Fred Drake044bb4d2001-08-02 15:53:05 +0000938\begin{methoddesc}[object]{__init__}{self\optional{, \moreargs}}
939Called\indexii{class}{constructor} when the instance is created. The
940arguments are those passed to the class constructor expression. If a
941base class has an \method{__init__()} method the derived class's
942\method{__init__()} method must explicitly call it to ensure proper
943initialization of the base class part of the instance; for example:
944\samp{BaseClass.__init__(\var{self}, [\var{args}...])}. As a special
945contraint on constructors, no value may be returned; doing so will
946cause a \exception{TypeError} to be raised at runtime.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000947\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000948
949
Fred Drake1e42d8a1998-11-25 17:58:50 +0000950\begin{methoddesc}[object]{__del__}{self}
Guido van Rossum7c0240f1998-07-24 15:36:43 +0000951Called when the instance is about to be destroyed. This is also
952called a destructor\index{destructor}. If a base class
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000953has a \method{__del__()} method, the derived class's \method{__del__()} method
Fred Drakef6669171998-05-06 19:52:49 +0000954must explicitly call it to ensure proper deletion of the base class
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000955part of the instance. Note that it is possible (though not recommended!)
956for the \method{__del__()}
Fred Drakef6669171998-05-06 19:52:49 +0000957method to postpone destruction of the instance by creating a new
958reference to it. It may then be called at a later time when this new
959reference is deleted. It is not guaranteed that
960\method{__del__()} methods are called for objects that still exist when
961the interpreter exits.
Fred Drakef6669171998-05-06 19:52:49 +0000962\stindex{del}
963
Fred Drake591dd8f2001-12-14 22:52:41 +0000964\begin{notice}
965\samp{del x} doesn't directly call
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000966\code{x.__del__()} --- the former decrements the reference count for
967\code{x} by one, and the latter is only called when its reference
968count reaches zero. Some common situations that may prevent the
969reference count of an object to go to zero include: circular
970references between objects (e.g., a doubly-linked list or a tree data
971structure with parent and child pointers); a reference to the object
972on the stack frame of a function that caught an exception (the
973traceback stored in \code{sys.exc_traceback} keeps the stack frame
974alive); or a reference to the object on the stack frame that raised an
975unhandled exception in interactive mode (the traceback stored in
976\code{sys.last_traceback} keeps the stack frame alive). The first
977situation can only be remedied by explicitly breaking the cycles; the
Fred Drake591dd8f2001-12-14 22:52:41 +0000978latter two situations can be resolved by storing \code{None} in
979\code{sys.exc_traceback} or \code{sys.last_traceback}. Circular
980references which are garbage are detected when the option cycle
981detector is enabled (it's on by default), but can only be cleaned up
982if there are no Python-level \method{__del__()} methods involved.
983Refer to the documentation for the \ulink{\module{gc}
984module}{../lib/module-gc.html} for more information about how
985\method{__del__()} methods are handled by the cycle detector,
986particularly the description of the \code{garbage} value.
987\end{notice}
Fred Drakef6669171998-05-06 19:52:49 +0000988
Fred Drake591dd8f2001-12-14 22:52:41 +0000989\begin{notice}[warning]
990Due to the precarious circumstances under which
Fred Draked82575d1998-08-28 20:03:12 +0000991\method{__del__()} methods are invoked, exceptions that occur during their
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000992execution are ignored, and a warning is printed to \code{sys.stderr}
Fred Drake591dd8f2001-12-14 22:52:41 +0000993instead. Also, when \method{__del__()} is invoked in response to a module
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000994being deleted (e.g., when execution of the program is done), other
Fred Draked82575d1998-08-28 20:03:12 +0000995globals referenced by the \method{__del__()} method may already have been
996deleted. For this reason, \method{__del__()} methods should do the
Raymond Hettingera0e4d6c2002-09-08 21:10:54 +0000997absolute minimum needed to maintain external invariants. Starting with
998version 1.5, Python guarantees that globals whose name begins with a single
999underscore are deleted from their module before other globals are deleted;
1000if no other references to such globals exist, this may help in assuring that
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001001imported modules are still available at the time when the
Fred Drake591dd8f2001-12-14 22:52:41 +00001002\method{__del__()} method is called.
1003\end{notice}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001004\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001005
Fred Drake1e42d8a1998-11-25 17:58:50 +00001006\begin{methoddesc}[object]{__repr__}{self}
Fred Drake82385871998-10-01 20:40:43 +00001007Called by the \function{repr()}\bifuncindex{repr} built-in function
1008and by string conversions (reverse quotes) to compute the ``official''
Andrew M. Kuchling68abe832000-12-19 14:09:21 +00001009string representation of an object. If at all possible, this should
Guido van Rossum035f7e82000-12-19 04:18:13 +00001010look like a valid Python expression that could be used to recreate an
1011object with the same value (given an appropriate environment). If
1012this is not possible, a string of the form \samp{<\var{...some useful
1013description...}>} should be returned. The return value must be a
1014string object.
1015
1016This is typically used for debugging, so it is important that the
1017representation is information-rich and unambiguous.
Fred Drakef6669171998-05-06 19:52:49 +00001018\indexii{string}{conversion}
1019\indexii{reverse}{quotes}
1020\indexii{backward}{quotes}
1021\index{back-quotes}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001022\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001023
Fred Drake1e42d8a1998-11-25 17:58:50 +00001024\begin{methoddesc}[object]{__str__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001025Called by the \function{str()}\bifuncindex{str} built-in function and
1026by the \keyword{print}\stindex{print} statement to compute the
Fred Drake82385871998-10-01 20:40:43 +00001027``informal'' string representation of an object. This differs from
1028\method{__repr__()} in that it does not have to be a valid Python
1029expression: a more convenient or concise representation may be used
Guido van Rossum035f7e82000-12-19 04:18:13 +00001030instead. The return value must be a string object.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001031\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001032
Guido van Rossumab782dd2001-01-18 15:17:06 +00001033\begin{methoddesc}[object]{__lt__}{self, other}
1034\methodline[object]{__le__}{self, other}
1035\methodline[object]{__eq__}{self, other}
1036\methodline[object]{__ne__}{self, other}
1037\methodline[object]{__gt__}{self, other}
1038\methodline[object]{__ge__}{self, other}
1039\versionadded{2.1}
1040These are the so-called ``rich comparison'' methods, and are called
1041for comparison operators in preference to \method{__cmp__()} below.
1042The correspondence between operator symbols and method names is as
1043follows:
1044\code{\var{x}<\var{y}} calls \code{\var{x}.__lt__(\var{y})},
1045\code{\var{x}<=\var{y}} calls \code{\var{x}.__le__(\var{y})},
1046\code{\var{x}==\var{y}} calls \code{\var{x}.__eq__(\var{y})},
1047\code{\var{x}!=\var{y}} and \code{\var{x}<>\var{y}} call
1048\code{\var{x}.__ne__(\var{y})},
1049\code{\var{x}>\var{y}} calls \code{\var{x}.__gt__(\var{y})}, and
1050\code{\var{x}>=\var{y}} calls \code{\var{x}.__ge__(\var{y})}.
1051These methods can return any value, but if the comparison operator is
1052used in a Boolean context, the return value should be interpretable as
1053a Boolean value, else a \exception{TypeError} will be raised.
1054By convention, \code{0} is used for false and \code{1} for true.
1055
1056There are no reflected (swapped-argument) versions of these methods
1057(to be used when the left argument does not support the operation but
1058the right argument does); rather, \method{__lt__()} and
1059\method{__gt__()} are each other's reflection, \method{__le__()} and
1060\method{__ge__()} are each other's reflection, and \method{__eq__()}
1061and \method{__ne__()} are their own reflection.
1062
1063Arguments to rich comparison methods are never coerced. A rich
1064comparison method may return \code{NotImplemented} if it does not
1065implement the operation for a given pair of arguments.
1066\end{methoddesc}
1067
Fred Drake1e42d8a1998-11-25 17:58:50 +00001068\begin{methoddesc}[object]{__cmp__}{self, other}
Guido van Rossumab782dd2001-01-18 15:17:06 +00001069Called by comparison operations if rich comparison (see above) is not
Fred Drake597bc1d2001-05-29 16:02:35 +00001070defined. Should return a negative integer if \code{self < other},
1071zero if \code{self == other}, a positive integer if \code{self >
1072other}. If no \method{__cmp__()}, \method{__eq__()} or
1073\method{__ne__()} operation is defined, class instances are compared
1074by object identity (``address''). See also the description of
1075\method{__hash__()} for some important notes on creating objects which
1076support custom comparison operations and are usable as dictionary
1077keys.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001078(Note: the restriction that exceptions are not propagated by
Fred Drake82385871998-10-01 20:40:43 +00001079\method{__cmp__()} has been removed in Python 1.5.)
Fred Drakef6669171998-05-06 19:52:49 +00001080\bifuncindex{cmp}
1081\index{comparisons}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001082\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001083
Fred Drakee57a1142000-06-15 20:07:25 +00001084\begin{methoddesc}[object]{__rcmp__}{self, other}
Fred Drake445f8322001-01-04 15:11:48 +00001085 \versionchanged[No longer supported]{2.1}
Fred Drakee57a1142000-06-15 20:07:25 +00001086\end{methoddesc}
1087
Fred Drake1e42d8a1998-11-25 17:58:50 +00001088\begin{methoddesc}[object]{__hash__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001089Called for the key object for dictionary\obindex{dictionary}
1090operations, and by the built-in function
Fred Drakef6669171998-05-06 19:52:49 +00001091\function{hash()}\bifuncindex{hash}. Should return a 32-bit integer
1092usable as a hash value
1093for dictionary operations. The only required property is that objects
1094which compare equal have the same hash value; it is advised to somehow
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001095mix together (e.g., using exclusive or) the hash values for the
Fred Drakef6669171998-05-06 19:52:49 +00001096components of the object that also play a part in comparison of
1097objects. If a class does not define a \method{__cmp__()} method it should
1098not define a \method{__hash__()} operation either; if it defines
Fred Drake597bc1d2001-05-29 16:02:35 +00001099\method{__cmp__()} or \method{__eq__()} but not \method{__hash__()},
1100its instances will not be usable as dictionary keys. If a class
1101defines mutable objects and implements a \method{__cmp__()} or
1102\method{__eq__()} method, it should not implement \method{__hash__()},
1103since the dictionary implementation requires that a key's hash value
1104is immutable (if the object's hash value changes, it will be in the
1105wrong hash bucket).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001106\withsubitem{(object method)}{\ttindex{__cmp__()}}
1107\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001108
Fred Drake1e42d8a1998-11-25 17:58:50 +00001109\begin{methoddesc}[object]{__nonzero__}{self}
Guido van Rossum77f6a652002-04-03 22:41:51 +00001110Called to implement truth value testing, and the built-in operation
1111\code{bool()}; should return \code{False} or \code{True}, or their
1112integer equivalents \code{0} or \code{1}.
1113When this method is not defined, \method{__len__()} is
Fred Draked82575d1998-08-28 20:03:12 +00001114called, if it is defined (see below). If a class defines neither
1115\method{__len__()} nor \method{__nonzero__()}, all its instances are
1116considered true.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001117\withsubitem{(mapping object method)}{\ttindex{__len__()}}
1118\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001119
Martin v. Löwis2a519f82002-04-11 12:39:35 +00001120\begin{methoddesc}[object]{__unicode__}{self}
1121Called to implement \function{unicode()}\bifuncindex{unicode} builtin;
1122should return a Unicode object. When this method is not defined, string
1123conversion is attempted, and the result of string conversion is converted
1124to Unicode using the system default encoding.
1125\end{methoddesc}
1126
Fred Drakef6669171998-05-06 19:52:49 +00001127
Fred Drake61c77281998-07-28 19:34:22 +00001128\subsection{Customizing attribute access\label{attribute-access}}
Fred Drakef6669171998-05-06 19:52:49 +00001129
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001130The following methods can be defined to customize the meaning of
1131attribute access (use of, assignment to, or deletion of \code{x.name})
1132for class instances.
1133For performance reasons, these methods are cached in the class object
1134at class definition time; therefore, they cannot be changed after the
1135class definition is executed.
Fred Drakef6669171998-05-06 19:52:49 +00001136
Fred Drake1e42d8a1998-11-25 17:58:50 +00001137\begin{methoddesc}[object]{__getattr__}{self, name}
Fred Drakef6669171998-05-06 19:52:49 +00001138Called when an attribute lookup has not found the attribute in the
1139usual places (i.e. it is not an instance attribute nor is it found in
1140the class tree for \code{self}). \code{name} is the attribute name.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001141This method should return the (computed) attribute value or raise an
Fred Draked82575d1998-08-28 20:03:12 +00001142\exception{AttributeError} exception.
Fred Drakef6669171998-05-06 19:52:49 +00001143
1144Note that if the attribute is found through the normal mechanism,
Fred Draked82575d1998-08-28 20:03:12 +00001145\method{__getattr__()} is not called. (This is an intentional
1146asymmetry between \method{__getattr__()} and \method{__setattr__()}.)
Fred Drakef6669171998-05-06 19:52:49 +00001147This is done both for efficiency reasons and because otherwise
Fred Draked82575d1998-08-28 20:03:12 +00001148\method{__setattr__()} would have no way to access other attributes of
1149the instance.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001150Note that at least for instance variables, you can fake
1151total control by not inserting any values in the instance
1152attribute dictionary (but instead inserting them in another object).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001153\withsubitem{(object method)}{\ttindex{__setattr__()}}
1154\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001155
Fred Drake1e42d8a1998-11-25 17:58:50 +00001156\begin{methoddesc}[object]{__setattr__}{self, name, value}
Fred Drakef6669171998-05-06 19:52:49 +00001157Called when an attribute assignment is attempted. This is called
Fred Draked82575d1998-08-28 20:03:12 +00001158instead of the normal mechanism (i.e.\ store the value in the instance
1159dictionary). \var{name} is the attribute name, \var{value} is the
Fred Drakef6669171998-05-06 19:52:49 +00001160value to be assigned to it.
Fred Drakef6669171998-05-06 19:52:49 +00001161
Fred Draked82575d1998-08-28 20:03:12 +00001162If \method{__setattr__()} wants to assign to an instance attribute, it
1163should not simply execute \samp{self.\var{name} = value} --- this
1164would cause a recursive call to itself. Instead, it should insert the
1165value in the dictionary of instance attributes, e.g.,
1166\samp{self.__dict__[\var{name}] = value}.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001167\withsubitem{(instance attribute)}{\ttindex{__dict__}}
1168\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001169
Fred Drake1e42d8a1998-11-25 17:58:50 +00001170\begin{methoddesc}[object]{__delattr__}{self, name}
Fred Draked82575d1998-08-28 20:03:12 +00001171Like \method{__setattr__()} but for attribute deletion instead of
Fred Drake1e42d8a1998-11-25 17:58:50 +00001172assignment. This should only be implemented if \samp{del
1173obj.\var{name}} is meaningful for the object.
1174\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001175
1176
Fred Drake61c77281998-07-28 19:34:22 +00001177\subsection{Emulating callable objects\label{callable-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001178
Fred Drake1e42d8a1998-11-25 17:58:50 +00001179\begin{methoddesc}[object]{__call__}{self\optional{, args...}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001180Called when the instance is ``called'' as a function; if this method
Fred Draked82575d1998-08-28 20:03:12 +00001181is defined, \code{\var{x}(arg1, arg2, ...)} is a shorthand for
1182\code{\var{x}.__call__(arg1, arg2, ...)}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001183\indexii{call}{instance}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001184\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001185
1186
Fred Drake73921b02001-10-01 16:32:13 +00001187\subsection{Emulating container types\label{sequence-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001188
Fred Drake73921b02001-10-01 16:32:13 +00001189The following methods can be defined to implement container
1190objects. Containers usually are sequences (such as lists or tuples)
1191or mappings (like dictionaries), but can represent other containers as
1192well. The first set of methods is used either to emulate a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001193sequence or to emulate a mapping; the difference is that for a
1194sequence, the allowable keys should be the integers \var{k} for which
1195\code{0 <= \var{k} < \var{N}} where \var{N} is the length of the
Thomas Wouters1d75a792000-08-17 22:37:32 +00001196sequence, or slice objects, which define a range of items. (For backwards
1197compatibility, the method \method{__getslice__()} (see below) can also be
1198defined to handle simple, but not extended slices.) It is also recommended
Fred Drakea0073822000-08-18 02:42:14 +00001199that mappings provide the methods \method{keys()}, \method{values()},
Thomas Wouters1d75a792000-08-17 22:37:32 +00001200\method{items()}, \method{has_key()}, \method{get()}, \method{clear()},
1201\method{copy()}, and \method{update()} behaving similar to those for
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001202Python's standard dictionary objects; mutable sequences should provide
1203methods \method{append()}, \method{count()}, \method{index()},
1204\method{insert()}, \method{pop()}, \method{remove()}, \method{reverse()}
1205and \method{sort()}, like Python standard list objects. Finally,
1206sequence types should implement addition (meaning concatenation) and
1207multiplication (meaning repetition) by defining the methods
Thomas Wouters12bba852000-08-24 20:06:04 +00001208\method{__add__()}, \method{__radd__()}, \method{__iadd__()},
1209\method{__mul__()}, \method{__rmul__()} and \method{__imul__()} described
1210below; they should not define \method{__coerce__()} or other numerical
Guido van Rossum0dbb4fb2001-04-20 16:50:40 +00001211operators. It is recommended that both mappings and sequences
Fred Drake18d8d5a2001-09-18 17:58:20 +00001212implement the \method{__contains__()} method to allow efficient use of
1213the \code{in} operator; for mappings, \code{in} should be equivalent
1214of \method{has_key()}; for sequences, it should search through the
1215values.
Fred Drake4856d011999-01-12 04:15:20 +00001216\withsubitem{(mapping object method)}{
1217 \ttindex{keys()}
1218 \ttindex{values()}
1219 \ttindex{items()}
1220 \ttindex{has_key()}
1221 \ttindex{get()}
1222 \ttindex{clear()}
1223 \ttindex{copy()}
Guido van Rossum0dbb4fb2001-04-20 16:50:40 +00001224 \ttindex{update()}
1225 \ttindex{__contains__()}}
Fred Drake4856d011999-01-12 04:15:20 +00001226\withsubitem{(sequence object method)}{
1227 \ttindex{append()}
1228 \ttindex{count()}
1229 \ttindex{index()}
1230 \ttindex{insert()}
1231 \ttindex{pop()}
1232 \ttindex{remove()}
1233 \ttindex{reverse()}
1234 \ttindex{sort()}
1235 \ttindex{__add__()}
1236 \ttindex{__radd__()}
Thomas Wouters12bba852000-08-24 20:06:04 +00001237 \ttindex{__iadd__()}
Fred Drake4856d011999-01-12 04:15:20 +00001238 \ttindex{__mul__()}
Thomas Wouters12bba852000-08-24 20:06:04 +00001239 \ttindex{__rmul__()}
Guido van Rossum0dbb4fb2001-04-20 16:50:40 +00001240 \ttindex{__imul__()}
1241 \ttindex{__contains__()}}
Fred Drakeae3e5741999-01-28 23:21:49 +00001242\withsubitem{(numeric object method)}{\ttindex{__coerce__()}}
Fred Drakef6669171998-05-06 19:52:49 +00001243
Fred Drake73921b02001-10-01 16:32:13 +00001244\begin{methoddesc}[container object]{__len__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001245Called to implement the built-in function
1246\function{len()}\bifuncindex{len}. Should return the length of the
1247object, an integer \code{>=} 0. Also, an object that doesn't define a
1248\method{__nonzero__()} method and whose \method{__len__()} method
1249returns zero is considered to be false in a Boolean context.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001250\withsubitem{(object method)}{\ttindex{__nonzero__()}}
1251\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001252
Fred Drake73921b02001-10-01 16:32:13 +00001253\begin{methoddesc}[container object]{__getitem__}{self, key}
Fred Draked82575d1998-08-28 20:03:12 +00001254Called to implement evaluation of \code{\var{self}[\var{key}]}.
Fred Drake31575ce2000-09-21 05:28:26 +00001255For sequence types, the accepted keys should be integers and slice
1256objects.\obindex{slice} Note that
1257the special interpretation of negative indexes (if the class wishes to
Fred Drakef6669171998-05-06 19:52:49 +00001258emulate a sequence type) is up to the \method{__getitem__()} method.
Fred Drake91826ed2000-07-13 04:57:58 +00001259If \var{key} is of an inappropriate type, \exception{TypeError} may be
1260raised; if of a value outside the set of indexes for the sequence
1261(after any special interpretation of negative values),
1262\exception{IndexError} should be raised.
Fred Drake0aa811c2001-10-20 04:24:09 +00001263\note{\keyword{for} loops expect that an
Fred Drake91826ed2000-07-13 04:57:58 +00001264\exception{IndexError} will be raised for illegal indexes to allow
Fred Drake0aa811c2001-10-20 04:24:09 +00001265proper detection of the end of the sequence.}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001266\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001267
Fred Drake73921b02001-10-01 16:32:13 +00001268\begin{methoddesc}[container object]{__setitem__}{self, key, value}
Fred Draked82575d1998-08-28 20:03:12 +00001269Called to implement assignment to \code{\var{self}[\var{key}]}. Same
Fred Drake1e42d8a1998-11-25 17:58:50 +00001270note as for \method{__getitem__()}. This should only be implemented
1271for mappings if the objects support changes to the values for keys, or
1272if new keys can be added, or for sequences if elements can be
Fred Drake91826ed2000-07-13 04:57:58 +00001273replaced. The same exceptions should be raised for improper
1274\var{key} values as for the \method{__getitem__()} method.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001275\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001276
Fred Drake73921b02001-10-01 16:32:13 +00001277\begin{methoddesc}[container object]{__delitem__}{self, key}
Fred Draked82575d1998-08-28 20:03:12 +00001278Called to implement deletion of \code{\var{self}[\var{key}]}. Same
Fred Drake1e42d8a1998-11-25 17:58:50 +00001279note as for \method{__getitem__()}. This should only be implemented
1280for mappings if the objects support removal of keys, or for sequences
Fred Drake91826ed2000-07-13 04:57:58 +00001281if elements can be removed from the sequence. The same exceptions
1282should be raised for improper \var{key} values as for the
1283\method{__getitem__()} method.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001284\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001285
Fred Drake73921b02001-10-01 16:32:13 +00001286\begin{methoddesc}[container object]{__iter__}{self}
1287This method is called when an iterator is required for a container.
1288This method should return a new iterator object that can iterate over
1289all the objects in the container. For mappings, it should iterate
1290over the keys of the container, and should also be made available as
1291the method \method{iterkeys()}.
1292
1293Iterator objects also need to implement this method; they are required
1294to return themselves. For more information on iterator objects, see
1295``\ulink{Iterator Types}{../lib/typeiter.html}'' in the
1296\citetitle[../lib/lib.html]{Python Library Reference}.
1297\end{methoddesc}
1298
1299The membership test operators (\keyword{in} and \keyword{not in}) are
1300normally implemented as an iteration through a sequence. However,
1301container objects can supply the following special method with a more
1302efficient implementation, which also does not require the object be a
1303sequence.
1304
1305\begin{methoddesc}[container object]{__contains__}{self, item}
1306Called to implement membership test operators. Should return true if
1307\var{item} is in \var{self}, false otherwise. For mapping objects,
1308this should consider the keys of the mapping rather than the values or
1309the key-item pairs.
1310\end{methoddesc}
1311
Fred Drakef6669171998-05-06 19:52:49 +00001312
Fred Drake3041b071998-10-21 00:25:32 +00001313\subsection{Additional methods for emulation of sequence types
Fred Drake61c77281998-07-28 19:34:22 +00001314 \label{sequence-methods}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001315
1316The following methods can be defined to further emulate sequence
1317objects. Immutable sequences methods should only define
1318\method{__getslice__()}; mutable sequences, should define all three
1319three methods.
Fred Drakef6669171998-05-06 19:52:49 +00001320
Fred Drake1e42d8a1998-11-25 17:58:50 +00001321\begin{methoddesc}[sequence object]{__getslice__}{self, i, j}
Fred Drakea0073822000-08-18 02:42:14 +00001322\deprecated{2.0}{Support slice objects as parameters to the
1323\method{__getitem__()} method.}
Fred Draked82575d1998-08-28 20:03:12 +00001324Called to implement evaluation of \code{\var{self}[\var{i}:\var{j}]}.
1325The returned object should be of the same type as \var{self}. Note
1326that missing \var{i} or \var{j} in the slice expression are replaced
Fred Drakee15956b2000-04-03 04:51:13 +00001327by zero or \code{sys.maxint}, respectively. If negative indexes are
1328used in the slice, the length of the sequence is added to that index.
1329If the instance does not implement the \method{__len__()} method, an
1330\exception{AttributeError} is raised.
1331No guarantee is made that indexes adjusted this way are not still
1332negative. Indexes which are greater than the length of the sequence
1333are not modified.
Fred Drakea0073822000-08-18 02:42:14 +00001334If no \method{__getslice__()} is found, a slice
Thomas Wouters1d75a792000-08-17 22:37:32 +00001335object is created instead, and passed to \method{__getitem__()} instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001336\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001337
Fred Drake1e42d8a1998-11-25 17:58:50 +00001338\begin{methoddesc}[sequence object]{__setslice__}{self, i, j, sequence}
Fred Draked82575d1998-08-28 20:03:12 +00001339Called to implement assignment to \code{\var{self}[\var{i}:\var{j}]}.
1340Same notes for \var{i} and \var{j} as for \method{__getslice__()}.
Thomas Wouters1d75a792000-08-17 22:37:32 +00001341
Fred Drakefb8ffe62001-04-13 15:54:41 +00001342This method is deprecated. If no \method{__setslice__()} is found, a
1343slice object is created instead, and passed to \method{__setitem__()}
1344instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001345\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001346
Fred Drake1e42d8a1998-11-25 17:58:50 +00001347\begin{methoddesc}[sequence object]{__delslice__}{self, i, j}
Fred Draked82575d1998-08-28 20:03:12 +00001348Called to implement deletion of \code{\var{self}[\var{i}:\var{j}]}.
1349Same notes for \var{i} and \var{j} as for \method{__getslice__()}.
Fred Drakefb8ffe62001-04-13 15:54:41 +00001350This method is deprecated. If no \method{__delslice__()} is found, a
1351slice object is created instead, and passed to \method{__delitem__()}
1352instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001353\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001354
Fred Drakefb8ffe62001-04-13 15:54:41 +00001355Notice that these methods are only invoked when a single slice with a
1356single colon is used, and the slice method is available. For slice
1357operations involving extended slice notation, or in absence of the
1358slice methods, \method{__getitem__()}, \method{__setitem__()} or
1359\method{__delitem__()} is called with a slice object as argument.
Fred Drakef6669171998-05-06 19:52:49 +00001360
Fred Drakef89259782000-09-21 22:27:16 +00001361The following example demonstrate how to make your program or module
1362compatible with earlier versions of Python (assuming that methods
1363\method{__getitem__()}, \method{__setitem__()} and \method{__delitem__()}
1364support slice objects as arguments):
1365
1366\begin{verbatim}
1367class MyClass:
1368 ...
1369 def __getitem__(self, index):
1370 ...
1371 def __setitem__(self, index, value):
1372 ...
1373 def __delitem__(self, index):
1374 ...
1375
1376 if sys.version_info < (2, 0):
1377 # They won't be defined if version is at least 2.0 final
1378
1379 def __getslice__(self, i, j):
1380 return self[max(0, i):max(0, j):]
1381 def __setslice__(self, i, j, seq):
1382 self[max(0, i):max(0, j):] = seq
1383 def __delslice__(self, i, j):
1384 del self[max(0, i):max(0, j):]
1385 ...
1386\end{verbatim}
1387
1388Note the calls to \function{max()}; these are actually necessary due
1389to the handling of negative indices before the
1390\method{__*slice__()} methods are called. When negative indexes are
1391used, the \method{__*item__()} methods receive them as provided, but
1392the \method{__*slice__()} methods get a ``cooked'' form of the index
1393values. For each negative index value, the length of the sequence is
1394added to the index before calling the method (which may still result
1395in a negative index); this is the customary handling of negative
1396indexes by the built-in sequence types, and the \method{__*item__()}
1397methods are expected to do this as well. However, since they should
1398already be doing that, negative indexes cannot be passed in; they must
1399be be constrained to the bounds of the sequence before being passed to
1400the \method{__*item__()} methods.
1401Calling \code{max(0, i)} conveniently returns the proper value.
1402
Fred Drake15988fd1999-02-12 18:14:57 +00001403
Fred Drake61c77281998-07-28 19:34:22 +00001404\subsection{Emulating numeric types\label{numeric-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001405
1406The following methods can be defined to emulate numeric objects.
1407Methods corresponding to operations that are not supported by the
1408particular kind of number implemented (e.g., bitwise operations for
1409non-integral numbers) should be left undefined.
Fred Drakef6669171998-05-06 19:52:49 +00001410
Fred Drakeb8943701999-05-10 13:43:22 +00001411\begin{methoddesc}[numeric object]{__add__}{self, other}
1412\methodline[numeric object]{__sub__}{self, other}
1413\methodline[numeric object]{__mul__}{self, other}
Fred Drake3e2aca42001-08-14 20:28:08 +00001414\methodline[numeric object]{__floordiv__}{self, other}
Fred Drakeb8943701999-05-10 13:43:22 +00001415\methodline[numeric object]{__mod__}{self, other}
1416\methodline[numeric object]{__divmod__}{self, other}
1417\methodline[numeric object]{__pow__}{self, other\optional{, modulo}}
1418\methodline[numeric object]{__lshift__}{self, other}
1419\methodline[numeric object]{__rshift__}{self, other}
1420\methodline[numeric object]{__and__}{self, other}
1421\methodline[numeric object]{__xor__}{self, other}
1422\methodline[numeric object]{__or__}{self, other}
Fred Drake3e2aca42001-08-14 20:28:08 +00001423These methods are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001424called to implement the binary arithmetic operations (\code{+},
Fred Drake3e2aca42001-08-14 20:28:08 +00001425\code{-}, \code{*}, \code{//}, \code{\%},
Fred Draked82575d1998-08-28 20:03:12 +00001426\function{divmod()}\bifuncindex{divmod},
Fred Drakefb8ffe62001-04-13 15:54:41 +00001427\function{pow()}\bifuncindex{pow}, \code{**}, \code{<}\code{<},
1428\code{>}\code{>}, \code{\&}, \code{\^}, \code{|}). For instance, to
1429evaluate the expression \var{x}\code{+}\var{y}, where \var{x} is an
1430instance of a class that has an \method{__add__()} method,
Fred Drake3e2aca42001-08-14 20:28:08 +00001431\code{\var{x}.__add__(\var{y})} is called. The \method{__divmod__()}
1432method should be the equivalent to using \method{__floordiv__()} and
1433\method{__mod__()}; it should not be related to \method{__truediv__()}
1434(described below). Note that
Fred Draked82575d1998-08-28 20:03:12 +00001435\method{__pow__()} should be defined to accept an optional third
1436argument if the ternary version of the built-in
1437\function{pow()}\bifuncindex{pow} function is to be supported.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001438\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001439
Fred Drake3e2aca42001-08-14 20:28:08 +00001440\begin{methoddesc}[numeric object]{__div__}{self, other}
1441\methodline[numeric object]{__truediv__}{self, other}
1442The division operator (\code{/}) is implemented by these methods. The
1443\method{__truediv__()} method is used when \code{__future__.division}
1444is in effect, otherwise \method{__div__()} is used. If only one of
1445these two methods is defined, the object will not support division in
1446the alternate context; \exception{TypeError} will be raised instead.
1447\end{methoddesc}
1448
Fred Drakeb8943701999-05-10 13:43:22 +00001449\begin{methoddesc}[numeric object]{__radd__}{self, other}
1450\methodline[numeric object]{__rsub__}{self, other}
1451\methodline[numeric object]{__rmul__}{self, other}
1452\methodline[numeric object]{__rdiv__}{self, other}
Raymond Hettinger10cbe8d2002-06-20 06:12:37 +00001453\methodline[numeric object]{__rtruediv__}{self, other}
1454\methodline[numeric object]{__rfloordiv__}{self, other}
Fred Drakeb8943701999-05-10 13:43:22 +00001455\methodline[numeric object]{__rmod__}{self, other}
1456\methodline[numeric object]{__rdivmod__}{self, other}
1457\methodline[numeric object]{__rpow__}{self, other}
1458\methodline[numeric object]{__rlshift__}{self, other}
1459\methodline[numeric object]{__rrshift__}{self, other}
1460\methodline[numeric object]{__rand__}{self, other}
1461\methodline[numeric object]{__rxor__}{self, other}
1462\methodline[numeric object]{__ror__}{self, other}
Fred Drake3e2aca42001-08-14 20:28:08 +00001463These methods are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001464called to implement the binary arithmetic operations (\code{+},
Fred Draked82575d1998-08-28 20:03:12 +00001465\code{-}, \code{*}, \code{/}, \code{\%},
1466\function{divmod()}\bifuncindex{divmod},
Fred Drakefb8ffe62001-04-13 15:54:41 +00001467\function{pow()}\bifuncindex{pow}, \code{**}, \code{<}\code{<},
1468\code{>}\code{>}, \code{\&}, \code{\^}, \code{|}) with reflected
1469(swapped) operands. These functions are only called if the left
1470operand does not support the corresponding operation. For instance,
1471to evaluate the expression \var{x}\code{-}\var{y}, where \var{y} is an
1472instance of a class that has an \method{__rsub__()} method,
1473\code{\var{y}.__rsub__(\var{x})} is called. Note that ternary
1474\function{pow()}\bifuncindex{pow} will not try calling
1475\method{__rpow__()} (the coercion rules would become too
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001476complicated).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001477\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001478
Thomas Woutersdc90cc22000-12-11 23:11:51 +00001479\begin{methoddesc}[numeric object]{__iadd__}{self, other}
1480\methodline[numeric object]{__isub__}{self, other}
1481\methodline[numeric object]{__imul__}{self, other}
1482\methodline[numeric object]{__idiv__}{self, other}
Raymond Hettinger10cbe8d2002-06-20 06:12:37 +00001483\methodline[numeric object]{__itruediv__}{self, other}
1484\methodline[numeric object]{__ifloordiv__}{self, other}
1485\methodline[numeric object]{__imod__}{self, other}
Thomas Woutersdc90cc22000-12-11 23:11:51 +00001486\methodline[numeric object]{__ipow__}{self, other\optional{, modulo}}
1487\methodline[numeric object]{__ilshift__}{self, other}
1488\methodline[numeric object]{__irshift__}{self, other}
1489\methodline[numeric object]{__iand__}{self, other}
1490\methodline[numeric object]{__ixor__}{self, other}
1491\methodline[numeric object]{__ior__}{self, other}
Fred Drakefb8ffe62001-04-13 15:54:41 +00001492These methods are called to implement the augmented arithmetic
1493operations (\code{+=}, \code{-=}, \code{*=}, \code{/=}, \code{\%=},
1494\code{**=}, \code{<}\code{<=}, \code{>}\code{>=}, \code{\&=},
1495\code{\^=}, \code{|=}). These methods should attempt to do the
1496operation in-place (modifying \var{self}) and return the result (which
1497could be, but does not have to be, \var{self}). If a specific method
1498is not defined, the augmented operation falls back to the normal
1499methods. For instance, to evaluate the expression
1500\var{x}\code{+=}\var{y}, where \var{x} is an instance of a class that
1501has an \method{__iadd__()} method, \code{\var{x}.__iadd__(\var{y})} is
1502called. If \var{x} is an instance of a class that does not define a
1503\method{__iadd()} method, \code{\var{x}.__add__(\var{y})} and
1504\code{\var{y}.__radd__(\var{x})} are considered, as with the
1505evaluation of \var{x}\code{+}\var{y}.
Thomas Woutersdc90cc22000-12-11 23:11:51 +00001506\end{methoddesc}
1507
Fred Drakeb8943701999-05-10 13:43:22 +00001508\begin{methoddesc}[numeric object]{__neg__}{self}
1509\methodline[numeric object]{__pos__}{self}
1510\methodline[numeric object]{__abs__}{self}
1511\methodline[numeric object]{__invert__}{self}
Fred Drakefb8ffe62001-04-13 15:54:41 +00001512Called to implement the unary arithmetic operations (\code{-},
1513\code{+}, \function{abs()}\bifuncindex{abs} and \code{\~{}}).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001514\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001515
Fred Drakeb8943701999-05-10 13:43:22 +00001516\begin{methoddesc}[numeric object]{__complex__}{self}
1517\methodline[numeric object]{__int__}{self}
1518\methodline[numeric object]{__long__}{self}
1519\methodline[numeric object]{__float__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001520Called to implement the built-in functions
Fred Drake15988fd1999-02-12 18:14:57 +00001521\function{complex()}\bifuncindex{complex},
1522\function{int()}\bifuncindex{int}, \function{long()}\bifuncindex{long},
Fred Draked82575d1998-08-28 20:03:12 +00001523and \function{float()}\bifuncindex{float}. Should return a value of
1524the appropriate type.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001525\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001526
Fred Drakeb8943701999-05-10 13:43:22 +00001527\begin{methoddesc}[numeric object]{__oct__}{self}
1528\methodline[numeric object]{__hex__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001529Called to implement the built-in functions
1530\function{oct()}\bifuncindex{oct} and
1531\function{hex()}\bifuncindex{hex}. Should return a string value.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001532\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001533
Fred Drakeb8943701999-05-10 13:43:22 +00001534\begin{methoddesc}[numeric object]{__coerce__}{self, other}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001535Called to implement ``mixed-mode'' numeric arithmetic. Should either
Fred Draked82575d1998-08-28 20:03:12 +00001536return a 2-tuple containing \var{self} and \var{other} converted to
Fred Drakeb8943701999-05-10 13:43:22 +00001537a common numeric type, or \code{None} if conversion is impossible. When
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001538the common type would be the type of \code{other}, it is sufficient to
1539return \code{None}, since the interpreter will also ask the other
1540object to attempt a coercion (but sometimes, if the implementation of
1541the other type cannot be changed, it is useful to do the conversion to
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001542the other type here). A return value of \code{NotImplemented} is
1543equivalent to returning \code{None}.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001544\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001545
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001546\subsection{Coercion rules\label{coercion-rules}}
1547
1548This section used to document the rules for coercion. As the language
1549has evolved, the coercion rules have become hard to document
1550precisely; documenting what one version of one particular
1551implementation does is undesirable. Instead, here are some informal
1552guidelines regarding coercion. In Python 3.0, coercion will not be
1553supported.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001554
1555\begin{itemize}
1556
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001557\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001558
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001559If the left operand of a \% operator is a string or Unicode object, no
1560coercion takes place and the string formatting operation is invoked
1561instead.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001562
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001563\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001564
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001565It is no longer recommended to define a coercion operation.
1566Mixed-mode operations on types that don't define coercion pass the
1567original arguments to the operation.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001568
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001569\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001570
Fred Drake293dd4b2002-06-04 16:25:57 +00001571New-style classes (those derived from \class{object}) never invoke the
1572\method{__coerce__()} method in response to a binary operator; the only
1573time \method{__coerce__()} is invoked is when the built-in function
1574\function{coerce()} is called.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001575
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001576\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001577
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001578For most intents and purposes, an operator that returns
1579\code{NotImplemented} is treated the same as one that is not
1580implemented at all.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001581
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001582\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001583
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001584Below, \method{__op__()} and \method{__rop__()} are used to signify
1585the generic method names corresponding to an operator;
1586\method{__iop__} is used for the corresponding in-place operator. For
1587example, for the operator `\code{+}', \method{__add__()} and
1588\method{__radd__()} are used for the left and right variant of the
1589binary operator, and \method{__iadd__} for the in-place variant.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001590
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001591\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001592
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001593For objects \var{x} and \var{y}, first \code{\var{x}.__op__(\var{y})}
1594is tried. If this is not implemented or returns \code{NotImplemented},
1595\code{\var{y}.__rop__(\var{x})} is tried. If this is also not
Fred Drake293dd4b2002-06-04 16:25:57 +00001596implemented or returns \code{NotImplemented}, a \exception{TypeError}
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001597exception is raised. But see the following exception:
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001598
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001599\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001600
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001601Exception to the previous item: if the left operand is an instance of
1602a built-in type or a new-style class, and the right operand is an
1603instance of a proper subclass of that type or class, the right
Fred Drake293dd4b2002-06-04 16:25:57 +00001604operand's \method{__rop__()} method is tried \emph{before} the left
1605operand's \method{__op__()} method. This is done so that a subclass can
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001606completely override binary operators. Otherwise, the left operand's
1607__op__ method would always accept the right operand: when an instance
1608of a given class is expected, an instance of a subclass of that class
1609is always acceptable.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001610
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001611\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001612
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001613When either operand type defines a coercion, this coercion is called
Fred Drake293dd4b2002-06-04 16:25:57 +00001614before that type's \method{__op__()} or \method{__rop__()} method is
1615called, but no sooner. If the coercion returns an object of a
1616different type for the operand whose coercion is invoked, part of the
1617process is redone using the new object.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001618
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001619\item
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001620
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001621When an in-place operator (like `\code{+=}') is used, if the left
Fred Drake293dd4b2002-06-04 16:25:57 +00001622operand implements \method{__iop__()}, it is invoked without any
1623coercion. When the operation falls back to \method{__op__()} and/or
1624\method{__rop__()}, the normal coercion rules apply.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001625
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001626\item
1627
1628In \var{x}\code{+}\var{y}, if \var{x} is a sequence that implements
1629sequence concatenation, sequence concatenation is invoked.
1630
1631\item
1632
1633In \var{x}\code{*}\var{y}, if one operator is a sequence that
1634implements sequence repetition, and the other is an integer
Fred Drake293dd4b2002-06-04 16:25:57 +00001635(\class{int} or \class{long}), sequence repetition is invoked.
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001636
1637\item
1638
Fred Drake293dd4b2002-06-04 16:25:57 +00001639Rich comparisons (implemented by methods \method{__eq__()} and so on)
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001640never use coercion. Three-way comparison (implemented by
Fred Drake293dd4b2002-06-04 16:25:57 +00001641\method{__cmp__()}) does use coercion under the same conditions as
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001642other binary operations use it.
1643
1644\item
1645
Fred Drake293dd4b2002-06-04 16:25:57 +00001646In the current implementation, the built-in numeric types \class{int},
1647\class{long} and \class{float} do not use coercion; the type
1648\class{complex} however does use it. The difference can become
Guido van Rossum92cf95f2002-06-03 19:06:41 +00001649apparent when subclassing these types. Over time, the type
Fred Drake293dd4b2002-06-04 16:25:57 +00001650\class{complex} may be fixed to avoid coercion. All these types
1651implement a \method{__coerce__()} method, for use by the built-in
1652\function{coerce()} function.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001653
1654\end{itemize}