blob: c453b85674140c04ee2aeae0213c22407ffa72c4 [file] [log] [blame]
Fred Drake61c77281998-07-28 19:34:22 +00001\chapter{Data model\label{datamodel}}
Fred Drakef6669171998-05-06 19:52:49 +00002
Fred Drake61c77281998-07-28 19:34:22 +00003\section{Objects, values and types\label{objects}}
Fred Drakef6669171998-05-06 19:52:49 +00004
5\dfn{Objects} are Python's abstraction for data. All data in a Python
6program is represented by objects or by relations between objects.
7(In a sense, and in conformance to Von Neumann's model of a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00008``stored program computer,'' code is also represented by objects.)
Fred Drakef6669171998-05-06 19:52:49 +00009\index{object}
10\index{data}
11
12Every object has an identity, a type and a value. An object's
13\emph{identity} never changes once it has been created; you may think
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000014of it as the object's address in memory. The `\code{is}' operator
Fred Drake82385871998-10-01 20:40:43 +000015compares the identity of two objects; the
16\function{id()}\bifuncindex{id} function returns an integer
17representing its identity (currently implemented as its address).
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000018An object's \dfn{type} is
Fred Drakef6669171998-05-06 19:52:49 +000019also unchangeable. It determines the operations that an object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000020supports (e.g., ``does it have a length?'') and also defines the
Fred Drake82385871998-10-01 20:40:43 +000021possible values for objects of that type. The
22\function{type()}\bifuncindex{type} function returns an object's type
23(which is an object itself). The \emph{value} of some
Fred Drakef6669171998-05-06 19:52:49 +000024objects can change. Objects whose value can change are said to be
25\emph{mutable}; objects whose value is unchangeable once they are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000026created are called \emph{immutable}.
Guido van Rossum264bd591999-02-23 16:40:55 +000027(The value of an immutable container object that contains a reference
28to a mutable object can change when the latter's value is changed;
29however the container is still considered immutable, because the
30collection of objects it contains cannot be changed. So, immutability
31is not strictly the same as having an unchangeable value, it is more
32subtle.)
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000033An object's mutability is determined by its type; for instance,
34numbers, strings and tuples are immutable, while dictionaries and
35lists are mutable.
Fred Drakef6669171998-05-06 19:52:49 +000036\index{identity of an object}
37\index{value of an object}
38\index{type of an object}
39\index{mutable object}
40\index{immutable object}
41
42Objects are never explicitly destroyed; however, when they become
43unreachable they may be garbage-collected. An implementation is
Barry Warsaw92a6ed91998-08-07 16:33:51 +000044allowed to postpone garbage collection or omit it altogether --- it is
45a matter of implementation quality how garbage collection is
Fred Drakef6669171998-05-06 19:52:49 +000046implemented, as long as no objects are collected that are still
47reachable. (Implementation note: the current implementation uses a
Fred Drakec8e82812001-01-22 17:46:18 +000048reference-counting scheme with (optional) delayed detection of
49cyclicly linked garbage, which collects most objects as soon as they
50become unreachable, but is not guaranteed to collect garbage
51containing circular references. See the
52\citetitle[../lib/module-gc.html]{Python Library Reference} for
53information on controlling the collection of cyclic garbage.)
Fred Drakef6669171998-05-06 19:52:49 +000054\index{garbage collection}
55\index{reference counting}
56\index{unreachable object}
57
58Note that the use of the implementation's tracing or debugging
59facilities may keep objects alive that would normally be collectable.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000060Also note that catching an exception with a
Fred Drake4856d011999-01-12 04:15:20 +000061`\keyword{try}...\keyword{except}' statement may keep objects alive.
Fred Drakef6669171998-05-06 19:52:49 +000062
63Some objects contain references to ``external'' resources such as open
64files or windows. It is understood that these resources are freed
65when the object is garbage-collected, but since garbage collection is
66not guaranteed to happen, such objects also provide an explicit way to
67release the external resource, usually a \method{close()} method.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000068Programs are strongly recommended to explicitly close such
Fred Drake4856d011999-01-12 04:15:20 +000069objects. The `\keyword{try}...\keyword{finally}' statement provides
70a convenient way to do this.
Fred Drakef6669171998-05-06 19:52:49 +000071
72Some objects contain references to other objects; these are called
73\emph{containers}. Examples of containers are tuples, lists and
74dictionaries. The references are part of a container's value. In
75most cases, when we talk about the value of a container, we imply the
76values, not the identities of the contained objects; however, when we
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000077talk about the mutability of a container, only the identities of
78the immediately contained objects are implied. So, if an immutable
79container (like a tuple)
80contains a reference to a mutable object, its value changes
81if that mutable object is changed.
Fred Drakef6669171998-05-06 19:52:49 +000082\index{container}
83
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000084Types affect almost all aspects of object behavior. Even the importance
Fred Drakef6669171998-05-06 19:52:49 +000085of object identity is affected in some sense: for immutable types,
86operations that compute new values may actually return a reference to
87any existing object with the same type and value, while for mutable
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000088objects this is not allowed. E.g., after
Fred Drake82385871998-10-01 20:40:43 +000089\samp{a = 1; b = 1},
Fred Drakef6669171998-05-06 19:52:49 +000090\code{a} and \code{b} may or may not refer to the same object with the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000091value one, depending on the implementation, but after
Fred Drake82385871998-10-01 20:40:43 +000092\samp{c = []; d = []}, \code{c} and \code{d}
Fred Drakef6669171998-05-06 19:52:49 +000093are guaranteed to refer to two different, unique, newly created empty
94lists.
Fred Drake82385871998-10-01 20:40:43 +000095(Note that \samp{c = d = []} assigns the same object to both
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000096\code{c} and \code{d}.)
Fred Drakef6669171998-05-06 19:52:49 +000097
Fred Drake61c77281998-07-28 19:34:22 +000098\section{The standard type hierarchy\label{types}}
Fred Drakef6669171998-05-06 19:52:49 +000099
100Below is a list of the types that are built into Python. Extension
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000101modules written in \C{} can define additional types. Future versions of
102Python may add types to the type hierarchy (e.g., rational
Fred Drakef6669171998-05-06 19:52:49 +0000103numbers, efficiently stored arrays of integers, etc.).
104\index{type}
105\indexii{data}{type}
106\indexii{type}{hierarchy}
107\indexii{extension}{module}
108\indexii{C}{language}
109
110Some of the type descriptions below contain a paragraph listing
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000111`special attributes.' These are attributes that provide access to the
Fred Drakef6669171998-05-06 19:52:49 +0000112implementation and are not intended for general use. Their definition
113may change in the future. There are also some `generic' special
114attributes, not listed with the individual objects: \member{__methods__}
115is a list of the method names of a built-in object, if it has any;
116\member{__members__} is a list of the data attribute names of a built-in
117object, if it has any.
118\index{attribute}
119\indexii{special}{attribute}
120\indexiii{generic}{special}{attribute}
Fred Drake4856d011999-01-12 04:15:20 +0000121\withsubitem{(built-in object attribute)}{
Fred Drake1e42d8a1998-11-25 17:58:50 +0000122 \ttindex{__methods__}
123 \ttindex{__members__}}
Fred Drakef6669171998-05-06 19:52:49 +0000124
125\begin{description}
126
127\item[None]
128This type has a single value. There is a single object with this value.
129This object is accessed through the built-in name \code{None}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000130It is used to signify the absence of a value in many situations, e.g.,
131it is returned from functions that don't explicitly return anything.
132Its truth value is false.
Fred Drakef6669171998-05-06 19:52:49 +0000133\ttindex{None}
Fred Drake78eebfd1998-11-25 19:09:24 +0000134\obindex{None@{\texttt{None}}}
Fred Drakef6669171998-05-06 19:52:49 +0000135
Neil Schemenauer48c2eb92001-01-04 01:25:50 +0000136\item[NotImplemented]
137This type has a single value. There is a single object with this value.
138This object is accessed through the built-in name \code{NotImplemented}.
Guido van Rossumab782dd2001-01-18 15:17:06 +0000139Numeric methods and rich comparison methods may return this value if
140they do not implement the operation for the operands provided. (The
141interpreter will then try the reflected operation, or some other
142fallback, depending on the operator.) Its truth value is true.
Neil Schemenauer48c2eb92001-01-04 01:25:50 +0000143\ttindex{NotImplemented}
144\obindex{NotImplemented@{\texttt{NotImplemented}}}
145
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000146\item[Ellipsis]
147This type has a single value. There is a single object with this value.
148This object is accessed through the built-in name \code{Ellipsis}.
Fred Drake82385871998-10-01 20:40:43 +0000149It is used to indicate the presence of the \samp{...} syntax in a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000150slice. Its truth value is true.
151\ttindex{Ellipsis}
Fred Drake78eebfd1998-11-25 19:09:24 +0000152\obindex{Ellipsis@{\texttt{Ellipsis}}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000153
Fred Drakef6669171998-05-06 19:52:49 +0000154\item[Numbers]
155These are created by numeric literals and returned as results by
156arithmetic operators and arithmetic built-in functions. Numeric
157objects are immutable; once created their value never changes. Python
158numbers are of course strongly related to mathematical numbers, but
159subject to the limitations of numerical representation in computers.
Fred Drakef6669171998-05-06 19:52:49 +0000160\obindex{numeric}
161
162Python distinguishes between integers and floating point numbers:
163
164\begin{description}
165\item[Integers]
166These represent elements from the mathematical set of whole numbers.
167\obindex{integer}
168
169There are two types of integers:
170
171\begin{description}
172
173\item[Plain integers]
174These represent numbers in the range -2147483648 through 2147483647.
175(The range may be larger on machines with a larger natural word
176size, but not smaller.)
Fred Drakee15956b2000-04-03 04:51:13 +0000177When the result of an operation would fall outside this range, the
Fred Drakef6669171998-05-06 19:52:49 +0000178exception \exception{OverflowError} is raised.
179For the purpose of shift and mask operations, integers are assumed to
180have a binary, 2's complement notation using 32 or more bits, and
181hiding no bits from the user (i.e., all 4294967296 different bit
182patterns correspond to different values).
183\obindex{plain integer}
184\withsubitem{(built-in exception)}{\ttindex{OverflowError}}
185
186\item[Long integers]
187These represent numbers in an unlimited range, subject to available
188(virtual) memory only. For the purpose of shift and mask operations,
189a binary representation is assumed, and negative numbers are
190represented in a variant of 2's complement which gives the illusion of
191an infinite string of sign bits extending to the left.
192\obindex{long integer}
193
194\end{description} % Integers
195
196The rules for integer representation are intended to give the most
197meaningful interpretation of shift and mask operations involving
198negative integers and the least surprises when switching between the
199plain and long integer domains. For any operation except left shift,
200if it yields a result in the plain integer domain without causing
201overflow, it will yield the same result in the long integer domain or
202when using mixed operands.
203\indexii{integer}{representation}
204
205\item[Floating point numbers]
206These represent machine-level double precision floating point numbers.
207You are at the mercy of the underlying machine architecture and
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000208\C{} implementation for the accepted range and handling of overflow.
209Python does not support single-precision floating point numbers; the
210savings in CPU and memory usage that are usually the reason for using
211these is dwarfed by the overhead of using objects in Python, so there
212is no reason to complicate the language with two kinds of floating
213point numbers.
Fred Drakef6669171998-05-06 19:52:49 +0000214\obindex{floating point}
215\indexii{floating point}{number}
216\indexii{C}{language}
217
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000218\item[Complex numbers]
219These represent complex numbers as a pair of machine-level double
220precision floating point numbers. The same caveats apply as for
221floating point numbers. The real and imaginary value of a complex
222number \code{z} can be retrieved through the attributes \code{z.real}
223and \code{z.imag}.
224\obindex{complex}
225\indexii{complex}{number}
226
Fred Drakef6669171998-05-06 19:52:49 +0000227\end{description} % Numbers
228
229\item[Sequences]
Fred Drake230d17d2001-02-22 21:28:04 +0000230These represent finite ordered sets indexed by non-negative numbers.
Fred Drakef6669171998-05-06 19:52:49 +0000231The built-in function \function{len()}\bifuncindex{len} returns the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000232number of items of a sequence.
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000233When the length of a sequence is \var{n}, the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000234index set contains the numbers 0, 1, \ldots, \var{n}-1. Item
Fred Drakef6669171998-05-06 19:52:49 +0000235\var{i} of sequence \var{a} is selected by \code{\var{a}[\var{i}]}.
Fred Drakee15956b2000-04-03 04:51:13 +0000236\obindex{sequence}
Fred Drakef6669171998-05-06 19:52:49 +0000237\index{index operation}
238\index{item selection}
239\index{subscription}
240
241Sequences also support slicing: \code{\var{a}[\var{i}:\var{j}]}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000242selects all items with index \var{k} such that \var{i} \code{<=}
Fred Drakef6669171998-05-06 19:52:49 +0000243\var{k} \code{<} \var{j}. When used as an expression, a slice is a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000244sequence of the same type. This implies that the index set is
245renumbered so that it starts at 0.
Fred Drakef6669171998-05-06 19:52:49 +0000246\index{slicing}
247
248Sequences are distinguished according to their mutability:
249
250\begin{description}
Fred Drake4856d011999-01-12 04:15:20 +0000251
Fred Drakef6669171998-05-06 19:52:49 +0000252\item[Immutable sequences]
253An object of an immutable sequence type cannot change once it is
254created. (If the object contains references to other objects,
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000255these other objects may be mutable and may be changed; however,
Fred Drakef6669171998-05-06 19:52:49 +0000256the collection of objects directly referenced by an immutable object
257cannot change.)
258\obindex{immutable sequence}
259\obindex{immutable}
260
261The following types are immutable sequences:
262
263\begin{description}
264
265\item[Strings]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000266The items of a string are characters. There is no separate
267character type; a character is represented by a string of one item.
Fred Drakef6669171998-05-06 19:52:49 +0000268Characters represent (at least) 8-bit bytes. The built-in
269functions \function{chr()}\bifuncindex{chr} and
270\function{ord()}\bifuncindex{ord} convert between characters and
271nonnegative integers representing the byte values. Bytes with the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000272values 0-127 usually represent the corresponding \ASCII{} values, but
273the interpretation of values is up to the program. The string
274data type is also used to represent arrays of bytes, e.g., to hold data
Fred Drakef6669171998-05-06 19:52:49 +0000275read from a file.
276\obindex{string}
277\index{character}
278\index{byte}
Fred Drake5c07d9b1998-05-14 19:37:06 +0000279\index{ASCII@\ASCII{}}
Fred Drakef6669171998-05-06 19:52:49 +0000280
281(On systems whose native character set is not \ASCII{}, strings may use
282EBCDIC in their internal representation, provided the functions
283\function{chr()} and \function{ord()} implement a mapping between \ASCII{} and
284EBCDIC, and string comparison preserves the \ASCII{} order.
285Or perhaps someone can propose a better rule?)
Fred Drake5c07d9b1998-05-14 19:37:06 +0000286\index{ASCII@\ASCII{}}
Fred Drakef6669171998-05-06 19:52:49 +0000287\index{EBCDIC}
288\index{character set}
289\indexii{string}{comparison}
290\bifuncindex{chr}
291\bifuncindex{ord}
292
Fred Drakef0aff8e2000-04-06 13:57:21 +0000293\item[Unicode]
294The items of a Unicode object are Unicode characters. A Unicode
295character is represented by a Unicode object of one item and can hold
296a 16-bit value representing a Unicode ordinal. The built-in functions
297\function{unichr()}\bifuncindex{unichr} and
298\function{ord()}\bifuncindex{ord} convert between characters and
299nonnegative integers representing the Unicode ordinals as defined in
300the Unicode Standard 3.0. Conversion from and to other encodings are
301possible through the Unicode method \method{encode} and the built-in
302function \function{unicode()}\bifuncindex{unicode}.
303\obindex{unicode}
304\index{character}
305\index{integer}
Fred Drake8b3ce9e2000-04-06 14:00:14 +0000306\index{Unicode}
Fred Drakef0aff8e2000-04-06 13:57:21 +0000307
Fred Drakef6669171998-05-06 19:52:49 +0000308\item[Tuples]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000309The items of a tuple are arbitrary Python objects.
310Tuples of two or more items are formed by comma-separated lists
311of expressions. A tuple of one item (a `singleton') can be formed
Fred Drakef6669171998-05-06 19:52:49 +0000312by affixing a comma to an expression (an expression by itself does
313not create a tuple, since parentheses must be usable for grouping of
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000314expressions). An empty tuple can be formed by an empty pair of
Fred Drakef6669171998-05-06 19:52:49 +0000315parentheses.
316\obindex{tuple}
317\indexii{singleton}{tuple}
318\indexii{empty}{tuple}
319
320\end{description} % Immutable sequences
321
322\item[Mutable sequences]
323Mutable sequences can be changed after they are created. The
324subscription and slicing notations can be used as the target of
325assignment and \keyword{del} (delete) statements.
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000326\obindex{mutable sequence}
Fred Drakef6669171998-05-06 19:52:49 +0000327\obindex{mutable}
328\indexii{assignment}{statement}
329\index{delete}
330\stindex{del}
331\index{subscription}
332\index{slicing}
333
334There is currently a single mutable sequence type:
335
336\begin{description}
337
338\item[Lists]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000339The items of a list are arbitrary Python objects. Lists are formed
Fred Drakef6669171998-05-06 19:52:49 +0000340by placing a comma-separated list of expressions in square brackets.
341(Note that there are no special cases needed to form lists of length 0
342or 1.)
343\obindex{list}
344
345\end{description} % Mutable sequences
346
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000347The extension module \module{array}\refstmodindex{array} provides an
348additional example of a mutable sequence type.
349
350
Fred Drakef6669171998-05-06 19:52:49 +0000351\end{description} % Sequences
352
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000353\item[Mappings]
Fred Drakef6669171998-05-06 19:52:49 +0000354These represent finite sets of objects indexed by arbitrary index sets.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000355The subscript notation \code{a[k]} selects the item indexed
Fred Drakef6669171998-05-06 19:52:49 +0000356by \code{k} from the mapping \code{a}; this can be used in
357expressions and as the target of assignments or \keyword{del} statements.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000358The built-in function \function{len()} returns the number of items
Fred Drakef6669171998-05-06 19:52:49 +0000359in a mapping.
360\bifuncindex{len}
361\index{subscription}
362\obindex{mapping}
363
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000364There is currently a single intrinsic mapping type:
Fred Drakef6669171998-05-06 19:52:49 +0000365
366\begin{description}
367
368\item[Dictionaries]
Fred Drake8cdee961999-02-23 18:50:38 +0000369These\obindex{dictionary} represent finite sets of objects indexed by
370nearly arbitrary values. The only types of values not acceptable as
371keys are values containing lists or dictionaries or other mutable
372types that are compared by value rather than by object identity, the
373reason being that the efficient implementation of dictionaries
374requires a key's hash value to remain constant.
Fred Drakef6669171998-05-06 19:52:49 +0000375Numeric types used for keys obey the normal rules for numeric
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000376comparison: if two numbers compare equal (e.g., \code{1} and
Fred Drakef6669171998-05-06 19:52:49 +0000377\code{1.0}) then they can be used interchangeably to index the same
378dictionary entry.
379
Fred Drake8cdee961999-02-23 18:50:38 +0000380Dictionaries are \obindex{mutable}mutable; they are created by the
381\code{\{...\}} notation (see section \ref{dict}, ``Dictionary
382Displays'').
Fred Drakef6669171998-05-06 19:52:49 +0000383
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000384The extension modules \module{dbm}\refstmodindex{dbm},
385\module{gdbm}\refstmodindex{gdbm}, \module{bsddb}\refstmodindex{bsddb}
386provide additional examples of mapping types.
387
Fred Drakef6669171998-05-06 19:52:49 +0000388\end{description} % Mapping types
389
390\item[Callable types]
Fred Drake8cdee961999-02-23 18:50:38 +0000391These\obindex{callable} are the types to which the function call
392operation (see section \ref{calls}, ``Calls'') can be applied:
Fred Drakef6669171998-05-06 19:52:49 +0000393\indexii{function}{call}
394\index{invocation}
395\indexii{function}{argument}
Fred Drakef6669171998-05-06 19:52:49 +0000396
397\begin{description}
398
399\item[User-defined functions]
400A user-defined function object is created by a function definition
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000401(see section \ref{function}, ``Function definitions''). It should be
402called with an argument
Fred Drakef6669171998-05-06 19:52:49 +0000403list containing the same number of items as the function's formal
404parameter list.
405\indexii{user-defined}{function}
406\obindex{function}
407\obindex{user-defined function}
408
Guido van Rossum264bd591999-02-23 16:40:55 +0000409Special attributes: \member{func_doc} or \member{__doc__} is the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000410function's documentation string, or None if unavailable;
Fred Drake82385871998-10-01 20:40:43 +0000411\member{func_name} or \member{__name__} is the function's name;
412\member{func_defaults} is a tuple containing default argument values for
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000413those arguments that have defaults, or \code{None} if no arguments
Fred Drake82385871998-10-01 20:40:43 +0000414have a default value; \member{func_code} is the code object representing
415the compiled function body; \member{func_globals} is (a reference to)
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000416the dictionary that holds the function's global variables --- it
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000417defines the global namespace of the module in which the function was
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000418defined; \member{func_dict} or \member{__dict__} contains the
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000419namespace supporting arbitrary function attributes;
420\member{func_closure} is \code{None} or a tuple of cells that contain
421binding for the function's free variables.
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000422
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000423Of these, \member{func_code}, \member{func_defaults}, \member{func_closure},
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000424\member{func_doc}/\member{__doc__}, and
425\member{func_dict}/\member{__dict__} may be writable; the
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000426others can never be changed. Additional information about a
427function's definition can be retrieved from its code object; see the
428description of internal types below.
429
430In Python 2.1, the \member{func_closure} slot is always \code{None}
431unless nested scopes are enabled. (See the appendix.)
432
Fred Drake4856d011999-01-12 04:15:20 +0000433\withsubitem{(function attribute)}{
434 \ttindex{func_doc}
435 \ttindex{__doc__}
436 \ttindex{__name__}
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000437 \ttindex{__dict__}
Fred Drake4856d011999-01-12 04:15:20 +0000438 \ttindex{func_defaults}
439 \ttindex{func_code}
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000440 \ttindex{func_globals}
441 \ttindex{func_dict}}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000442\indexii{global}{namespace}
Fred Drakef6669171998-05-06 19:52:49 +0000443
444\item[User-defined methods]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000445A user-defined method object combines a class, a class instance (or
446\code{None}) and a user-defined function.
Fred Drakef6669171998-05-06 19:52:49 +0000447\obindex{method}
448\obindex{user-defined method}
449\indexii{user-defined}{method}
Fred Drakef6669171998-05-06 19:52:49 +0000450
451Special read-only attributes: \member{im_self} is the class instance
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000452object, \member{im_func} is the function object;
Fred Drake82385871998-10-01 20:40:43 +0000453\member{im_class} is the class that defined the method (which may be a
454base class of the class of which \member{im_self} is an instance);
455\member{__doc__} is the method's documentation (same as
456\code{im_func.__doc__}); \member{__name__} is the method name (same as
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000457\code{im_func.__name__}).
Fred Drake4856d011999-01-12 04:15:20 +0000458\withsubitem{(method attribute)}{
459 \ttindex{im_func}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000460 \ttindex{im_self}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000461
Barry Warsaw7a5e80e2001-02-27 03:36:30 +0000462Methods also support accessing (but not setting) the arbitrary
463function attributes on the underlying function object.
464
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000465User-defined method objects are created in two ways: when getting an
466attribute of a class that is a user-defined function object, or when
Fred Drake35c09f22000-06-28 20:15:47 +0000467getting an attribute of a class instance that is a user-defined
468function object defined by the class of the instance. In the former
469case (class attribute), the \member{im_self} attribute is \code{None},
470and the method object is said to be unbound; in the latter case
471(instance attribute), \method{im_self} is the instance, and the method
472object is said to be bound. For
Fred Drake82385871998-10-01 20:40:43 +0000473instance, when \class{C} is a class which contains a definition for a
474function \method{f()}, \code{C.f} does not yield the function object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000475\code{f}; rather, it yields an unbound method object \code{m} where
Fred Drake82385871998-10-01 20:40:43 +0000476\code{m.im_class} is \class{C}, \code{m.im_func} is \method{f()}, and
477\code{m.im_self} is \code{None}. When \code{x} is a \class{C}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000478instance, \code{x.f} yields a bound method object \code{m} where
Fred Drake82385871998-10-01 20:40:43 +0000479\code{m.im_class} is \code{C}, \code{m.im_func} is \method{f()}, and
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000480\code{m.im_self} is \code{x}.
Fred Drake4856d011999-01-12 04:15:20 +0000481\withsubitem{(method attribute)}{
Fred Drake35c09f22000-06-28 20:15:47 +0000482 \ttindex{im_class}\ttindex{im_func}\ttindex{im_self}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000483
484When an unbound user-defined method object is called, the underlying
Fred Drake82385871998-10-01 20:40:43 +0000485function (\member{im_func}) is called, with the restriction that the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000486first argument must be an instance of the proper class
Fred Drake82385871998-10-01 20:40:43 +0000487(\member{im_class}) or of a derived class thereof.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000488
489When a bound user-defined method object is called, the underlying
Fred Drake82385871998-10-01 20:40:43 +0000490function (\member{im_func}) is called, inserting the class instance
491(\member{im_self}) in front of the argument list. For instance, when
492\class{C} is a class which contains a definition for a function
493\method{f()}, and \code{x} is an instance of \class{C}, calling
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000494\code{x.f(1)} is equivalent to calling \code{C.f(x, 1)}.
495
496Note that the transformation from function object to (unbound or
497bound) method object happens each time the attribute is retrieved from
498the class or instance. In some cases, a fruitful optimization is to
499assign the attribute to a local variable and call that local variable.
500Also notice that this transformation only happens for user-defined
501functions; other callable objects (and all non-callable objects) are
Fred Drake35c09f22000-06-28 20:15:47 +0000502retrieved without transformation. It is also important to note that
503user-defined functions which are attributes of a class instance are
504not converted to bound methods; this \emph{only} happens when the
505function is an attribute of the class.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000506
Fred Drakef6669171998-05-06 19:52:49 +0000507\item[Built-in functions]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000508A built-in function object is a wrapper around a \C{} function. Examples
509of built-in functions are \function{len()} and \function{math.sin()}
510(\module{math} is a standard built-in module).
511The number and type of the arguments are
Fred Drakef6669171998-05-06 19:52:49 +0000512determined by the C function.
Fred Drake82385871998-10-01 20:40:43 +0000513Special read-only attributes: \member{__doc__} is the function's
514documentation string, or \code{None} if unavailable; \member{__name__}
515is the function's name; \member{__self__} is set to \code{None} (but see
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000516the next item).
Fred Drakef6669171998-05-06 19:52:49 +0000517\obindex{built-in function}
518\obindex{function}
519\indexii{C}{language}
520
521\item[Built-in methods]
522This is really a different disguise of a built-in function, this time
523containing an object passed to the \C{} function as an implicit extra
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000524argument. An example of a built-in method is
525\code{\var{list}.append()}, assuming
Fred Drakef6669171998-05-06 19:52:49 +0000526\var{list} is a list object.
Fred Drake82385871998-10-01 20:40:43 +0000527In this case, the special read-only attribute \member{__self__} is set
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000528to the object denoted by \code{list}.
Fred Drakef6669171998-05-06 19:52:49 +0000529\obindex{built-in method}
530\obindex{method}
531\indexii{built-in}{method}
532
533\item[Classes]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000534Class objects are described below. When a class object is called,
535a new class instance (also described below) is created and
Fred Drakef6669171998-05-06 19:52:49 +0000536returned. This implies a call to the class's \method{__init__()} method
537if it has one. Any arguments are passed on to the \method{__init__()}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000538method. If there is no \method{__init__()} method, the class must be called
Fred Drakef6669171998-05-06 19:52:49 +0000539without arguments.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000540\withsubitem{(object method)}{\ttindex{__init__()}}
Fred Drakef6669171998-05-06 19:52:49 +0000541\obindex{class}
542\obindex{class instance}
543\obindex{instance}
544\indexii{class object}{call}
545
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000546\item[Class instances]
547Class instances are described below. Class instances are callable
Fred Drake82385871998-10-01 20:40:43 +0000548only when the class has a \method{__call__()} method; \code{x(arguments)}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000549is a shorthand for \code{x.__call__(arguments)}.
550
Fred Drakef6669171998-05-06 19:52:49 +0000551\end{description}
552
553\item[Modules]
554Modules are imported by the \keyword{import} statement (see section
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000555\ref{import}, ``The \keyword{import} statement'').
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000556A module object has a namespace implemented by a dictionary object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000557(this is the dictionary referenced by the func_globals attribute of
558functions defined in the module). Attribute references are translated
559to lookups in this dictionary, e.g., \code{m.x} is equivalent to
560\code{m.__dict__["x"]}.
561A module object does not contain the code object used to
Fred Drakef6669171998-05-06 19:52:49 +0000562initialize the module (since it isn't needed once the initialization
563is done).
564\stindex{import}
565\obindex{module}
566
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000567Attribute assignment updates the module's namespace dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000568e.g., \samp{m.x = 1} is equivalent to \samp{m.__dict__["x"] = 1}.
Fred Drakef6669171998-05-06 19:52:49 +0000569
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000570Special read-only attribute: \member{__dict__} is the module's
571namespace as a dictionary object.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000572\withsubitem{(module attribute)}{\ttindex{__dict__}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000573
574Predefined (writable) attributes: \member{__name__}
575is the module's name; \member{__doc__} is the
576module's documentation string, or
Fred Drake82385871998-10-01 20:40:43 +0000577\code{None} if unavailable; \member{__file__} is the pathname of the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000578file from which the module was loaded, if it was loaded from a file.
Fred Drake82385871998-10-01 20:40:43 +0000579The \member{__file__} attribute is not present for C{} modules that are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000580statically linked into the interpreter; for extension modules loaded
581dynamically from a shared library, it is the pathname of the shared
582library file.
Fred Drake4856d011999-01-12 04:15:20 +0000583\withsubitem{(module attribute)}{
584 \ttindex{__name__}
585 \ttindex{__doc__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000586 \ttindex{__file__}}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000587\indexii{module}{namespace}
Fred Drakef6669171998-05-06 19:52:49 +0000588
589\item[Classes]
590Class objects are created by class definitions (see section
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000591\ref{class}, ``Class definitions'').
592A class has a namespace implemented by a dictionary object.
593Class attribute references are translated to
594lookups in this dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000595e.g., \samp{C.x} is translated to \samp{C.__dict__["x"]}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000596When the attribute name is not found
Fred Drakef6669171998-05-06 19:52:49 +0000597there, the attribute search continues in the base classes. The search
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000598is depth-first, left-to-right in the order of occurrence in the
Fred Drakef6669171998-05-06 19:52:49 +0000599base class list.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000600When a class attribute reference would yield a user-defined function
601object, it is transformed into an unbound user-defined method object
Fred Drake82385871998-10-01 20:40:43 +0000602(see above). The \member{im_class} attribute of this method object is the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000603class in which the function object was found, not necessarily the
604class for which the attribute reference was initiated.
Fred Drakef6669171998-05-06 19:52:49 +0000605\obindex{class}
606\obindex{class instance}
607\obindex{instance}
608\indexii{class object}{call}
609\index{container}
610\obindex{dictionary}
611\indexii{class}{attribute}
612
613Class attribute assignments update the class's dictionary, never the
614dictionary of a base class.
615\indexiii{class}{attribute}{assignment}
616
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000617A class object can be called (see above) to yield a class instance (see
618below).
Fred Drakef6669171998-05-06 19:52:49 +0000619\indexii{class object}{call}
620
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000621Special attributes: \member{__name__} is the class name;
622\member{__module__} is the module name in which the class was defined;
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000623\member{__dict__} is the dictionary containing the class's namespace;
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000624\member{__bases__} is a tuple (possibly empty or a singleton)
625containing the base classes, in the order of their occurrence in the
Fred Drake82385871998-10-01 20:40:43 +0000626base class list; \member{__doc__} is the class's documentation string,
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000627or None if undefined.
Fred Drake4856d011999-01-12 04:15:20 +0000628\withsubitem{(class attribute)}{
629 \ttindex{__name__}
630 \ttindex{__module__}
631 \ttindex{__dict__}
632 \ttindex{__bases__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000633 \ttindex{__doc__}}
Fred Drakef6669171998-05-06 19:52:49 +0000634
635\item[Class instances]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000636A class instance is created by calling a class object (see above).
637A class instance has a namespace implemented as a dictionary which
638is the first place in which
Fred Drakef6669171998-05-06 19:52:49 +0000639attribute references are searched. When an attribute is not found
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000640there, and the instance's class has an attribute by that name,
641the search continues with the class attributes. If a class attribute
642is found that is a user-defined function object (and in no other
643case), it is transformed into an unbound user-defined method object
Fred Drake82385871998-10-01 20:40:43 +0000644(see above). The \member{im_class} attribute of this method object is
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000645the class in which the function object was found, not necessarily the
646class of the instance for which the attribute reference was initiated.
647If no class attribute is found, and the object's class has a
Fred Drake82385871998-10-01 20:40:43 +0000648\method{__getattr__()} method, that is called to satisfy the lookup.
Fred Drakef6669171998-05-06 19:52:49 +0000649\obindex{class instance}
650\obindex{instance}
651\indexii{class}{instance}
652\indexii{class instance}{attribute}
653
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000654Attribute assignments and deletions update the instance's dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000655never a class's dictionary. If the class has a \method{__setattr__()} or
656\method{__delattr__()} method, this is called instead of updating the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000657instance dictionary directly.
Fred Drakef6669171998-05-06 19:52:49 +0000658\indexiii{class instance}{attribute}{assignment}
659
660Class instances can pretend to be numbers, sequences, or mappings if
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000661they have methods with certain special names. See
662section \ref{specialnames}, ``Special method names.''
Fred Drakee15956b2000-04-03 04:51:13 +0000663\obindex{numeric}
Fred Drakef6669171998-05-06 19:52:49 +0000664\obindex{sequence}
665\obindex{mapping}
666
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000667Special attributes: \member{__dict__} is the attribute
668dictionary; \member{__class__} is the instance's class.
Fred Drake4856d011999-01-12 04:15:20 +0000669\withsubitem{(instance attribute)}{
670 \ttindex{__dict__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000671 \ttindex{__class__}}
Fred Drakef6669171998-05-06 19:52:49 +0000672
673\item[Files]
Fred Drakee15eb351999-11-10 16:13:25 +0000674A file\obindex{file} object represents an open file. File objects are
675created by the \function{open()}\bifuncindex{open} built-in function,
676and also by
677\withsubitem{(in module os)}{\ttindex{popen()}}\function{os.popen()},
678\function{os.fdopen()}, and the
679\method{makefile()}\withsubitem{(socket method)}{\ttindex{makefile()}}
680method of socket objects (and perhaps by other functions or methods
681provided by extension modules). The objects
682\ttindex{sys.stdin}\code{sys.stdin},
683\ttindex{sys.stdout}\code{sys.stdout} and
684\ttindex{sys.stderr}\code{sys.stderr} are initialized to file objects
685corresponding to the interpreter's standard\index{stdio} input, output
686and error streams. See the \citetitle[../lib/lib.html]{Python Library
687Reference} for complete documentation of file objects.
Fred Drake4856d011999-01-12 04:15:20 +0000688\withsubitem{(in module sys)}{
689 \ttindex{stdin}
690 \ttindex{stdout}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000691 \ttindex{stderr}}
Fred Drakee15eb351999-11-10 16:13:25 +0000692
Fred Drakef6669171998-05-06 19:52:49 +0000693
694\item[Internal types]
695A few types used internally by the interpreter are exposed to the user.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000696Their definitions may change with future versions of the interpreter,
Fred Drakef6669171998-05-06 19:52:49 +0000697but they are mentioned here for completeness.
698\index{internal type}
699\index{types, internal}
700
701\begin{description}
702
703\item[Code objects]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000704Code objects represent \emph{byte-compiled} executable Python code, or
705\emph{bytecode}.
Fred Drakef6669171998-05-06 19:52:49 +0000706The difference between a code
707object and a function object is that the function object contains an
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000708explicit reference to the function's globals (the module in which it
709was defined), while a code object contains no context;
710also the default argument values are stored in the function object,
711not in the code object (because they represent values calculated at
712run-time). Unlike function objects, code objects are immutable and
713contain no references (directly or indirectly) to mutable objects.
714\index{bytecode}
Fred Drakef6669171998-05-06 19:52:49 +0000715\obindex{code}
716
Fred Drake1e42d8a1998-11-25 17:58:50 +0000717Special read-only attributes: \member{co_name} gives the function
718name; \member{co_argcount} is the number of positional arguments
719(including arguments with default values); \member{co_nlocals} is the
720number of local variables used by the function (including arguments);
721\member{co_varnames} is a tuple containing the names of the local
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000722variables (starting with the argument names); \member{co_cellvars} is
723a tuple containing the names of local variables that are referenced by
724nested functions; \member{co_freevars} is a tuple containing the names
725of local variables that are neither local nor global; \member{co_code}
726is a string representing the sequence of bytecode instructions;
Fred Drake1e42d8a1998-11-25 17:58:50 +0000727\member{co_consts} is a tuple containing the literals used by the
728bytecode; \member{co_names} is a tuple containing the names used by
729the bytecode; \member{co_filename} is the filename from which the code
730was compiled; \member{co_firstlineno} is the first line number of the
731function; \member{co_lnotab} is a string encoding the mapping from
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000732byte code offsets to line numbers (for details see the source code of
Fred Drake1e42d8a1998-11-25 17:58:50 +0000733the interpreter); \member{co_stacksize} is the required stack size
734(including local variables); \member{co_flags} is an integer encoding
735a number of flags for the interpreter.
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000736
737The \member{co_cellvars} and \member{co_freevars} are present in
738Python 2.1 when nested scopes are not enabled, but the code itself
739does not use or create cells.
740
Fred Drake4856d011999-01-12 04:15:20 +0000741\withsubitem{(code object attribute)}{
742 \ttindex{co_argcount}
743 \ttindex{co_code}
744 \ttindex{co_consts}
745 \ttindex{co_filename}
746 \ttindex{co_firstlineno}
747 \ttindex{co_flags}
748 \ttindex{co_lnotab}
749 \ttindex{co_name}
750 \ttindex{co_names}
751 \ttindex{co_nlocals}
752 \ttindex{co_stacksize}
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000753 \ttindex{co_varnames}
754 \ttindex{co_cellvars}
755 \ttindex{co_freevars}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000756
Fred Drakee15956b2000-04-03 04:51:13 +0000757The following flag bits are defined for \member{co_flags}: bit
758\code{0x04} is set if the function uses the \samp{*arguments} syntax
759to accept an arbitrary number of positional arguments; bit
760\code{0x08} is set if the function uses the \samp{**keywords} syntax
761to accept arbitrary keyword arguments; other bits are used internally
Jeremy Hyltonaa90adc2001-03-23 17:23:50 +0000762or reserved for future use; bit \code{0x10} is set if the function was
763compiled with nested scopes enabled. If\index{documentation string} a
764code object represents a function, the first item in
765\member{co_consts} is the documentation string of the function, or
766\code{None} if undefined.
Fred Drakef6669171998-05-06 19:52:49 +0000767
768\item[Frame objects]
769Frame objects represent execution frames. They may occur in traceback
770objects (see below).
771\obindex{frame}
772
773Special read-only attributes: \member{f_back} is to the previous
774stack frame (towards the caller), or \code{None} if this is the bottom
775stack frame; \member{f_code} is the code object being executed in this
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000776frame; \member{f_locals} is the dictionary used to look up local
777variables; \member{f_globals} is used for global variables;
Fred Drake82385871998-10-01 20:40:43 +0000778\member{f_builtins} is used for built-in (intrinsic) names;
779\member{f_restricted} is a flag indicating whether the function is
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000780executing in restricted execution mode;
Fred Drakef6669171998-05-06 19:52:49 +0000781\member{f_lineno} gives the line number and \member{f_lasti} gives the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000782precise instruction (this is an index into the bytecode string of
Fred Drakef6669171998-05-06 19:52:49 +0000783the code object).
Fred Drake4856d011999-01-12 04:15:20 +0000784\withsubitem{(frame attribute)}{
785 \ttindex{f_back}
786 \ttindex{f_code}
787 \ttindex{f_globals}
788 \ttindex{f_locals}
789 \ttindex{f_lineno}
790 \ttindex{f_lasti}
791 \ttindex{f_builtins}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000792 \ttindex{f_restricted}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000793
Fred Drake82385871998-10-01 20:40:43 +0000794Special writable attributes: \member{f_trace}, if not \code{None}, is a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000795function called at the start of each source code line (this is used by
Fred Drake82385871998-10-01 20:40:43 +0000796the debugger); \member{f_exc_type}, \member{f_exc_value},
797\member{f_exc_traceback} represent the most recent exception caught in
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000798this frame.
Fred Drake4856d011999-01-12 04:15:20 +0000799\withsubitem{(frame attribute)}{
800 \ttindex{f_trace}
801 \ttindex{f_exc_type}
802 \ttindex{f_exc_value}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000803 \ttindex{f_exc_traceback}}
Fred Drakef6669171998-05-06 19:52:49 +0000804
805\item[Traceback objects] \label{traceback}
806Traceback objects represent a stack trace of an exception. A
807traceback object is created when an exception occurs. When the search
808for an exception handler unwinds the execution stack, at each unwound
809level a traceback object is inserted in front of the current
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000810traceback. When an exception handler is entered, the stack trace is
811made available to the program.
812(See section \ref{try}, ``The \code{try} statement.'')
813It is accessible as \code{sys.exc_traceback}, and also as the third
814item of the tuple returned by \code{sys.exc_info()}. The latter is
815the preferred interface, since it works correctly when the program is
816using multiple threads.
817When the program contains no suitable handler, the stack trace is written
Fred Drakef6669171998-05-06 19:52:49 +0000818(nicely formatted) to the standard error stream; if the interpreter is
819interactive, it is also made available to the user as
820\code{sys.last_traceback}.
821\obindex{traceback}
822\indexii{stack}{trace}
823\indexii{exception}{handler}
824\indexii{execution}{stack}
Fred Drake4856d011999-01-12 04:15:20 +0000825\withsubitem{(in module sys)}{
826 \ttindex{exc_info}
827 \ttindex{exc_traceback}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000828 \ttindex{last_traceback}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000829\ttindex{sys.exc_info}
Fred Drakef6669171998-05-06 19:52:49 +0000830\ttindex{sys.exc_traceback}
831\ttindex{sys.last_traceback}
832
833Special read-only attributes: \member{tb_next} is the next level in the
834stack trace (towards the frame where the exception occurred), or
835\code{None} if there is no next level; \member{tb_frame} points to the
836execution frame of the current level; \member{tb_lineno} gives the line
837number where the exception occurred; \member{tb_lasti} indicates the
838precise instruction. The line number and last instruction in the
839traceback may differ from the line number of its frame object if the
840exception occurred in a \keyword{try} statement with no matching
841except clause or with a finally clause.
Fred Drake4856d011999-01-12 04:15:20 +0000842\withsubitem{(traceback attribute)}{
843 \ttindex{tb_next}
844 \ttindex{tb_frame}
845 \ttindex{tb_lineno}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000846 \ttindex{tb_lasti}}
Fred Drakef6669171998-05-06 19:52:49 +0000847\stindex{try}
848
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000849\item[Slice objects]
850Slice objects are used to represent slices when \emph{extended slice
851syntax} is used. This is a slice using two colons, or multiple slices
852or ellipses separated by commas, e.g., \code{a[i:j:step]}, \code{a[i:j,
853k:l]}, or \code{a[..., i:j])}. They are also created by the built-in
Fred Drake1e42d8a1998-11-25 17:58:50 +0000854\function{slice()}\bifuncindex{slice} function.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000855
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000856Special read-only attributes: \member{start} is the lower bound;
857\member{stop} is the upper bound; \member{step} is the step value; each is
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000858\code{None} if omitted. These attributes can have any type.
Fred Drake4856d011999-01-12 04:15:20 +0000859\withsubitem{(slice object attribute)}{
860 \ttindex{start}
861 \ttindex{stop}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000862 \ttindex{step}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000863
Fred Drakef6669171998-05-06 19:52:49 +0000864\end{description} % Internal types
865
866\end{description} % Types
867
868
Fred Drake61c77281998-07-28 19:34:22 +0000869\section{Special method names\label{specialnames}}
Fred Drakef6669171998-05-06 19:52:49 +0000870
871A class can implement certain operations that are invoked by special
Fred Draked82575d1998-08-28 20:03:12 +0000872syntax (such as arithmetic operations or subscripting and slicing) by
873defining methods with special names. For instance, if a class defines
874a method named \method{__getitem__()}, and \code{x} is an instance of
875this class, then \code{x[i]} is equivalent to
876\code{x.__getitem__(i)}. (The reverse is not true --- if \code{x} is
877a list object, \code{x.__getitem__(i)} is not equivalent to
878\code{x[i]}.) Except where mentioned, attempts to execute an
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000879operation raise an exception when no appropriate method is defined.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000880\withsubitem{(mapping object method)}{\ttindex{__getitem__()}}
Fred Drakef6669171998-05-06 19:52:49 +0000881
Fred Drake0c475592000-12-07 04:49:34 +0000882When implementing a class that emulates any built-in type, it is
883important that the emulation only be implemented to the degree that it
884makes sense for the object being modelled. For example, some
885sequences may work well with retrieval of individual elements, but
886extracting a slice may not make sense. (One example of this is the
887\class{NodeList} interface in the W3C's Document Object Model.)
888
Fred Drakef6669171998-05-06 19:52:49 +0000889
Fred Drake61c77281998-07-28 19:34:22 +0000890\subsection{Basic customization\label{customization}}
Fred Drakef6669171998-05-06 19:52:49 +0000891
Fred Drake1e42d8a1998-11-25 17:58:50 +0000892\begin{methoddesc}[object]{__init__}{self\optional{, args...}}
Fred Drakef6669171998-05-06 19:52:49 +0000893Called when the instance is created. The arguments are those passed
894to the class constructor expression. If a base class has an
Fred Drake82385871998-10-01 20:40:43 +0000895\method{__init__()} method the derived class's \method{__init__()} method must
Fred Drakef6669171998-05-06 19:52:49 +0000896explicitly call it to ensure proper initialization of the base class
Fred Draked82575d1998-08-28 20:03:12 +0000897part of the instance, e.g., \samp{BaseClass.__init__(\var{self},
898[\var{args}...])}.
Fred Drakef6669171998-05-06 19:52:49 +0000899\indexii{class}{constructor}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000900\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000901
902
Fred Drake1e42d8a1998-11-25 17:58:50 +0000903\begin{methoddesc}[object]{__del__}{self}
Guido van Rossum7c0240f1998-07-24 15:36:43 +0000904Called when the instance is about to be destroyed. This is also
905called a destructor\index{destructor}. If a base class
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000906has a \method{__del__()} method, the derived class's \method{__del__()} method
Fred Drakef6669171998-05-06 19:52:49 +0000907must explicitly call it to ensure proper deletion of the base class
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000908part of the instance. Note that it is possible (though not recommended!)
909for the \method{__del__()}
Fred Drakef6669171998-05-06 19:52:49 +0000910method to postpone destruction of the instance by creating a new
911reference to it. It may then be called at a later time when this new
912reference is deleted. It is not guaranteed that
913\method{__del__()} methods are called for objects that still exist when
914the interpreter exits.
Fred Drakef6669171998-05-06 19:52:49 +0000915\stindex{del}
916
Fred Drake82385871998-10-01 20:40:43 +0000917\strong{Programmer's note:} \samp{del x} doesn't directly call
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000918\code{x.__del__()} --- the former decrements the reference count for
919\code{x} by one, and the latter is only called when its reference
920count reaches zero. Some common situations that may prevent the
921reference count of an object to go to zero include: circular
922references between objects (e.g., a doubly-linked list or a tree data
923structure with parent and child pointers); a reference to the object
924on the stack frame of a function that caught an exception (the
925traceback stored in \code{sys.exc_traceback} keeps the stack frame
926alive); or a reference to the object on the stack frame that raised an
927unhandled exception in interactive mode (the traceback stored in
928\code{sys.last_traceback} keeps the stack frame alive). The first
929situation can only be remedied by explicitly breaking the cycles; the
930latter two situations can be resolved by storing None in
931\code{sys.exc_traceback} or \code{sys.last_traceback}.
Fred Drakef6669171998-05-06 19:52:49 +0000932
933\strong{Warning:} due to the precarious circumstances under which
Fred Draked82575d1998-08-28 20:03:12 +0000934\method{__del__()} methods are invoked, exceptions that occur during their
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000935execution are ignored, and a warning is printed to \code{sys.stderr}
Fred Draked82575d1998-08-28 20:03:12 +0000936instead. Also, when \method{__del__()} is invoked is response to a module
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000937being deleted (e.g., when execution of the program is done), other
Fred Draked82575d1998-08-28 20:03:12 +0000938globals referenced by the \method{__del__()} method may already have been
939deleted. For this reason, \method{__del__()} methods should do the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000940absolute minimum needed to maintain external invariants. Python 1.5
941guarantees that globals whose name begins with a single underscore are
942deleted from their module before other globals are deleted; if no
943other references to such globals exist, this may help in assuring that
944imported modules are still available at the time when the
Fred Draked82575d1998-08-28 20:03:12 +0000945\method{__del__()} method is called.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000946\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000947
Fred Drake1e42d8a1998-11-25 17:58:50 +0000948\begin{methoddesc}[object]{__repr__}{self}
Fred Drake82385871998-10-01 20:40:43 +0000949Called by the \function{repr()}\bifuncindex{repr} built-in function
950and by string conversions (reverse quotes) to compute the ``official''
Andrew M. Kuchling68abe832000-12-19 14:09:21 +0000951string representation of an object. If at all possible, this should
Guido van Rossum035f7e82000-12-19 04:18:13 +0000952look like a valid Python expression that could be used to recreate an
953object with the same value (given an appropriate environment). If
954this is not possible, a string of the form \samp{<\var{...some useful
955description...}>} should be returned. The return value must be a
956string object.
957
958This is typically used for debugging, so it is important that the
959representation is information-rich and unambiguous.
Fred Drakef6669171998-05-06 19:52:49 +0000960\indexii{string}{conversion}
961\indexii{reverse}{quotes}
962\indexii{backward}{quotes}
963\index{back-quotes}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000964\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000965
Fred Drake1e42d8a1998-11-25 17:58:50 +0000966\begin{methoddesc}[object]{__str__}{self}
Fred Draked82575d1998-08-28 20:03:12 +0000967Called by the \function{str()}\bifuncindex{str} built-in function and
968by the \keyword{print}\stindex{print} statement to compute the
Fred Drake82385871998-10-01 20:40:43 +0000969``informal'' string representation of an object. This differs from
970\method{__repr__()} in that it does not have to be a valid Python
971expression: a more convenient or concise representation may be used
Guido van Rossum035f7e82000-12-19 04:18:13 +0000972instead. The return value must be a string object.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000973\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000974
Guido van Rossumab782dd2001-01-18 15:17:06 +0000975\begin{methoddesc}[object]{__lt__}{self, other}
976\methodline[object]{__le__}{self, other}
977\methodline[object]{__eq__}{self, other}
978\methodline[object]{__ne__}{self, other}
979\methodline[object]{__gt__}{self, other}
980\methodline[object]{__ge__}{self, other}
981\versionadded{2.1}
982These are the so-called ``rich comparison'' methods, and are called
983for comparison operators in preference to \method{__cmp__()} below.
984The correspondence between operator symbols and method names is as
985follows:
986\code{\var{x}<\var{y}} calls \code{\var{x}.__lt__(\var{y})},
987\code{\var{x}<=\var{y}} calls \code{\var{x}.__le__(\var{y})},
988\code{\var{x}==\var{y}} calls \code{\var{x}.__eq__(\var{y})},
989\code{\var{x}!=\var{y}} and \code{\var{x}<>\var{y}} call
990\code{\var{x}.__ne__(\var{y})},
991\code{\var{x}>\var{y}} calls \code{\var{x}.__gt__(\var{y})}, and
992\code{\var{x}>=\var{y}} calls \code{\var{x}.__ge__(\var{y})}.
993These methods can return any value, but if the comparison operator is
994used in a Boolean context, the return value should be interpretable as
995a Boolean value, else a \exception{TypeError} will be raised.
996By convention, \code{0} is used for false and \code{1} for true.
997
998There are no reflected (swapped-argument) versions of these methods
999(to be used when the left argument does not support the operation but
1000the right argument does); rather, \method{__lt__()} and
1001\method{__gt__()} are each other's reflection, \method{__le__()} and
1002\method{__ge__()} are each other's reflection, and \method{__eq__()}
1003and \method{__ne__()} are their own reflection.
1004
1005Arguments to rich comparison methods are never coerced. A rich
1006comparison method may return \code{NotImplemented} if it does not
1007implement the operation for a given pair of arguments.
1008\end{methoddesc}
1009
Fred Drake1e42d8a1998-11-25 17:58:50 +00001010\begin{methoddesc}[object]{__cmp__}{self, other}
Guido van Rossumab782dd2001-01-18 15:17:06 +00001011Called by comparison operations if rich comparison (see above) is not
1012defined. Should return a negative integer if
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001013\code{self < other}, zero if \code{self == other}, a positive integer if
Fred Drakef6669171998-05-06 19:52:49 +00001014\code{self > other}. If no \method{__cmp__()} operation is defined, class
1015instances are compared by object identity (``address'').
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001016(Note: the restriction that exceptions are not propagated by
Fred Drake82385871998-10-01 20:40:43 +00001017\method{__cmp__()} has been removed in Python 1.5.)
Fred Drakef6669171998-05-06 19:52:49 +00001018\bifuncindex{cmp}
1019\index{comparisons}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001020\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001021
Fred Drakee57a1142000-06-15 20:07:25 +00001022\begin{methoddesc}[object]{__rcmp__}{self, other}
Fred Drake445f8322001-01-04 15:11:48 +00001023 \versionchanged[No longer supported]{2.1}
Fred Drakee57a1142000-06-15 20:07:25 +00001024\end{methoddesc}
1025
Fred Drake1e42d8a1998-11-25 17:58:50 +00001026\begin{methoddesc}[object]{__hash__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001027Called for the key object for dictionary\obindex{dictionary}
1028operations, and by the built-in function
Fred Drakef6669171998-05-06 19:52:49 +00001029\function{hash()}\bifuncindex{hash}. Should return a 32-bit integer
1030usable as a hash value
1031for dictionary operations. The only required property is that objects
1032which compare equal have the same hash value; it is advised to somehow
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001033mix together (e.g., using exclusive or) the hash values for the
Fred Drakef6669171998-05-06 19:52:49 +00001034components of the object that also play a part in comparison of
1035objects. If a class does not define a \method{__cmp__()} method it should
1036not define a \method{__hash__()} operation either; if it defines
1037\method{__cmp__()} but not \method{__hash__()} its instances will not be
1038usable as dictionary keys. If a class defines mutable objects and
1039implements a \method{__cmp__()} method it should not implement
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001040\method{__hash__()}, since the dictionary implementation requires that
1041a key's hash value is immutable (if the object's hash value changes, it
1042will be in the wrong hash bucket).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001043\withsubitem{(object method)}{\ttindex{__cmp__()}}
1044\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001045
Fred Drake1e42d8a1998-11-25 17:58:50 +00001046\begin{methoddesc}[object]{__nonzero__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001047Called to implement truth value testing; should return \code{0} or
1048\code{1}. When this method is not defined, \method{__len__()} is
1049called, if it is defined (see below). If a class defines neither
1050\method{__len__()} nor \method{__nonzero__()}, all its instances are
1051considered true.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001052\withsubitem{(mapping object method)}{\ttindex{__len__()}}
1053\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001054
1055
Fred Drake61c77281998-07-28 19:34:22 +00001056\subsection{Customizing attribute access\label{attribute-access}}
Fred Drakef6669171998-05-06 19:52:49 +00001057
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001058The following methods can be defined to customize the meaning of
1059attribute access (use of, assignment to, or deletion of \code{x.name})
1060for class instances.
1061For performance reasons, these methods are cached in the class object
1062at class definition time; therefore, they cannot be changed after the
1063class definition is executed.
Fred Drakef6669171998-05-06 19:52:49 +00001064
Fred Drake1e42d8a1998-11-25 17:58:50 +00001065\begin{methoddesc}[object]{__getattr__}{self, name}
Fred Drakef6669171998-05-06 19:52:49 +00001066Called when an attribute lookup has not found the attribute in the
1067usual places (i.e. it is not an instance attribute nor is it found in
1068the class tree for \code{self}). \code{name} is the attribute name.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001069This method should return the (computed) attribute value or raise an
Fred Draked82575d1998-08-28 20:03:12 +00001070\exception{AttributeError} exception.
Fred Drakef6669171998-05-06 19:52:49 +00001071
1072Note that if the attribute is found through the normal mechanism,
Fred Draked82575d1998-08-28 20:03:12 +00001073\method{__getattr__()} is not called. (This is an intentional
1074asymmetry between \method{__getattr__()} and \method{__setattr__()}.)
Fred Drakef6669171998-05-06 19:52:49 +00001075This is done both for efficiency reasons and because otherwise
Fred Draked82575d1998-08-28 20:03:12 +00001076\method{__setattr__()} would have no way to access other attributes of
1077the instance.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001078Note that at least for instance variables, you can fake
1079total control by not inserting any values in the instance
1080attribute dictionary (but instead inserting them in another object).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001081\withsubitem{(object method)}{\ttindex{__setattr__()}}
1082\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001083
Fred Drake1e42d8a1998-11-25 17:58:50 +00001084\begin{methoddesc}[object]{__setattr__}{self, name, value}
Fred Drakef6669171998-05-06 19:52:49 +00001085Called when an attribute assignment is attempted. This is called
Fred Draked82575d1998-08-28 20:03:12 +00001086instead of the normal mechanism (i.e.\ store the value in the instance
1087dictionary). \var{name} is the attribute name, \var{value} is the
Fred Drakef6669171998-05-06 19:52:49 +00001088value to be assigned to it.
Fred Drakef6669171998-05-06 19:52:49 +00001089
Fred Draked82575d1998-08-28 20:03:12 +00001090If \method{__setattr__()} wants to assign to an instance attribute, it
1091should not simply execute \samp{self.\var{name} = value} --- this
1092would cause a recursive call to itself. Instead, it should insert the
1093value in the dictionary of instance attributes, e.g.,
1094\samp{self.__dict__[\var{name}] = value}.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001095\withsubitem{(instance attribute)}{\ttindex{__dict__}}
1096\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001097
Fred Drake1e42d8a1998-11-25 17:58:50 +00001098\begin{methoddesc}[object]{__delattr__}{self, name}
Fred Draked82575d1998-08-28 20:03:12 +00001099Like \method{__setattr__()} but for attribute deletion instead of
Fred Drake1e42d8a1998-11-25 17:58:50 +00001100assignment. This should only be implemented if \samp{del
1101obj.\var{name}} is meaningful for the object.
1102\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001103
1104
Fred Drake61c77281998-07-28 19:34:22 +00001105\subsection{Emulating callable objects\label{callable-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001106
Fred Drake1e42d8a1998-11-25 17:58:50 +00001107\begin{methoddesc}[object]{__call__}{self\optional{, args...}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001108Called when the instance is ``called'' as a function; if this method
Fred Draked82575d1998-08-28 20:03:12 +00001109is defined, \code{\var{x}(arg1, arg2, ...)} is a shorthand for
1110\code{\var{x}.__call__(arg1, arg2, ...)}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001111\indexii{call}{instance}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001112\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001113
1114
Fred Drake61c77281998-07-28 19:34:22 +00001115\subsection{Emulating sequence and mapping types\label{sequence-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001116
1117The following methods can be defined to emulate sequence or mapping
1118objects. The first set of methods is used either to emulate a
1119sequence or to emulate a mapping; the difference is that for a
1120sequence, the allowable keys should be the integers \var{k} for which
1121\code{0 <= \var{k} < \var{N}} where \var{N} is the length of the
Thomas Wouters1d75a792000-08-17 22:37:32 +00001122sequence, or slice objects, which define a range of items. (For backwards
1123compatibility, the method \method{__getslice__()} (see below) can also be
1124defined to handle simple, but not extended slices.) It is also recommended
Fred Drakea0073822000-08-18 02:42:14 +00001125that mappings provide the methods \method{keys()}, \method{values()},
Thomas Wouters1d75a792000-08-17 22:37:32 +00001126\method{items()}, \method{has_key()}, \method{get()}, \method{clear()},
1127\method{copy()}, and \method{update()} behaving similar to those for
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001128Python's standard dictionary objects; mutable sequences should provide
1129methods \method{append()}, \method{count()}, \method{index()},
1130\method{insert()}, \method{pop()}, \method{remove()}, \method{reverse()}
1131and \method{sort()}, like Python standard list objects. Finally,
1132sequence types should implement addition (meaning concatenation) and
1133multiplication (meaning repetition) by defining the methods
Thomas Wouters12bba852000-08-24 20:06:04 +00001134\method{__add__()}, \method{__radd__()}, \method{__iadd__()},
1135\method{__mul__()}, \method{__rmul__()} and \method{__imul__()} described
1136below; they should not define \method{__coerce__()} or other numerical
1137operators.
Fred Drake4856d011999-01-12 04:15:20 +00001138\withsubitem{(mapping object method)}{
1139 \ttindex{keys()}
1140 \ttindex{values()}
1141 \ttindex{items()}
1142 \ttindex{has_key()}
1143 \ttindex{get()}
1144 \ttindex{clear()}
1145 \ttindex{copy()}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001146 \ttindex{update()}}
Fred Drake4856d011999-01-12 04:15:20 +00001147\withsubitem{(sequence object method)}{
1148 \ttindex{append()}
1149 \ttindex{count()}
1150 \ttindex{index()}
1151 \ttindex{insert()}
1152 \ttindex{pop()}
1153 \ttindex{remove()}
1154 \ttindex{reverse()}
1155 \ttindex{sort()}
1156 \ttindex{__add__()}
1157 \ttindex{__radd__()}
Thomas Wouters12bba852000-08-24 20:06:04 +00001158 \ttindex{__iadd__()}
Fred Drake4856d011999-01-12 04:15:20 +00001159 \ttindex{__mul__()}
Thomas Wouters12bba852000-08-24 20:06:04 +00001160 \ttindex{__rmul__()}
1161 \ttindex{__imul__()}}
Fred Drakeae3e5741999-01-28 23:21:49 +00001162\withsubitem{(numeric object method)}{\ttindex{__coerce__()}}
Fred Drakef6669171998-05-06 19:52:49 +00001163
Fred Drake1e42d8a1998-11-25 17:58:50 +00001164\begin{methoddesc}[mapping object]{__len__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001165Called to implement the built-in function
1166\function{len()}\bifuncindex{len}. Should return the length of the
1167object, an integer \code{>=} 0. Also, an object that doesn't define a
1168\method{__nonzero__()} method and whose \method{__len__()} method
1169returns zero is considered to be false in a Boolean context.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001170\withsubitem{(object method)}{\ttindex{__nonzero__()}}
1171\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001172
Fred Drake1e42d8a1998-11-25 17:58:50 +00001173\begin{methoddesc}[mapping object]{__getitem__}{self, key}
Fred Draked82575d1998-08-28 20:03:12 +00001174Called to implement evaluation of \code{\var{self}[\var{key}]}.
Fred Drake31575ce2000-09-21 05:28:26 +00001175For sequence types, the accepted keys should be integers and slice
1176objects.\obindex{slice} Note that
1177the special interpretation of negative indexes (if the class wishes to
Fred Drakef6669171998-05-06 19:52:49 +00001178emulate a sequence type) is up to the \method{__getitem__()} method.
Fred Drake91826ed2000-07-13 04:57:58 +00001179If \var{key} is of an inappropriate type, \exception{TypeError} may be
1180raised; if of a value outside the set of indexes for the sequence
1181(after any special interpretation of negative values),
1182\exception{IndexError} should be raised.
1183\strong{Note:} \keyword{for} loops expect that an
1184\exception{IndexError} will be raised for illegal indexes to allow
1185proper detection of the end of the sequence.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001186\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001187
Fred Drake1e42d8a1998-11-25 17:58:50 +00001188\begin{methoddesc}[mapping object]{__setitem__}{self, key, value}
Fred Draked82575d1998-08-28 20:03:12 +00001189Called to implement assignment to \code{\var{self}[\var{key}]}. Same
Fred Drake1e42d8a1998-11-25 17:58:50 +00001190note as for \method{__getitem__()}. This should only be implemented
1191for mappings if the objects support changes to the values for keys, or
1192if new keys can be added, or for sequences if elements can be
Fred Drake91826ed2000-07-13 04:57:58 +00001193replaced. The same exceptions should be raised for improper
1194\var{key} values as for the \method{__getitem__()} method.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001195\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001196
Fred Drake1e42d8a1998-11-25 17:58:50 +00001197\begin{methoddesc}[mapping object]{__delitem__}{self, key}
Fred Draked82575d1998-08-28 20:03:12 +00001198Called to implement deletion of \code{\var{self}[\var{key}]}. Same
Fred Drake1e42d8a1998-11-25 17:58:50 +00001199note as for \method{__getitem__()}. This should only be implemented
1200for mappings if the objects support removal of keys, or for sequences
Fred Drake91826ed2000-07-13 04:57:58 +00001201if elements can be removed from the sequence. The same exceptions
1202should be raised for improper \var{key} values as for the
1203\method{__getitem__()} method.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001204\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001205
1206
Fred Drake3041b071998-10-21 00:25:32 +00001207\subsection{Additional methods for emulation of sequence types
Fred Drake61c77281998-07-28 19:34:22 +00001208 \label{sequence-methods}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001209
1210The following methods can be defined to further emulate sequence
1211objects. Immutable sequences methods should only define
1212\method{__getslice__()}; mutable sequences, should define all three
1213three methods.
Fred Drakef6669171998-05-06 19:52:49 +00001214
Fred Drake1e42d8a1998-11-25 17:58:50 +00001215\begin{methoddesc}[sequence object]{__getslice__}{self, i, j}
Fred Drakea0073822000-08-18 02:42:14 +00001216\deprecated{2.0}{Support slice objects as parameters to the
1217\method{__getitem__()} method.}
Fred Draked82575d1998-08-28 20:03:12 +00001218Called to implement evaluation of \code{\var{self}[\var{i}:\var{j}]}.
1219The returned object should be of the same type as \var{self}. Note
1220that missing \var{i} or \var{j} in the slice expression are replaced
Fred Drakee15956b2000-04-03 04:51:13 +00001221by zero or \code{sys.maxint}, respectively. If negative indexes are
1222used in the slice, the length of the sequence is added to that index.
1223If the instance does not implement the \method{__len__()} method, an
1224\exception{AttributeError} is raised.
1225No guarantee is made that indexes adjusted this way are not still
1226negative. Indexes which are greater than the length of the sequence
1227are not modified.
Fred Drakea0073822000-08-18 02:42:14 +00001228If no \method{__getslice__()} is found, a slice
Thomas Wouters1d75a792000-08-17 22:37:32 +00001229object is created instead, and passed to \method{__getitem__()} instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001230\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001231
Fred Drake1e42d8a1998-11-25 17:58:50 +00001232\begin{methoddesc}[sequence object]{__setslice__}{self, i, j, sequence}
Fred Draked82575d1998-08-28 20:03:12 +00001233Called to implement assignment to \code{\var{self}[\var{i}:\var{j}]}.
1234Same notes for \var{i} and \var{j} as for \method{__getslice__()}.
Thomas Wouters1d75a792000-08-17 22:37:32 +00001235
1236This method is deprecated. If no \method{__setslice__()} is found, a slice
1237object is created instead, and passed to \method{__setitem__()} instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001238\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001239
Fred Drake1e42d8a1998-11-25 17:58:50 +00001240\begin{methoddesc}[sequence object]{__delslice__}{self, i, j}
Fred Draked82575d1998-08-28 20:03:12 +00001241Called to implement deletion of \code{\var{self}[\var{i}:\var{j}]}.
1242Same notes for \var{i} and \var{j} as for \method{__getslice__()}.
Thomas Wouters1d75a792000-08-17 22:37:32 +00001243This method is deprecated. If no \method{__delslice__()} is found, a slice
1244object is created instead, and passed to \method{__delitem__()} instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001245\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001246
Thomas Wouters1d75a792000-08-17 22:37:32 +00001247Notice that these methods are only invoked when a single slice with a single
1248colon is used, and the slice method is available. For slice operations
1249involving extended slice notation, or in absence of the slice methods,
1250\method{__getitem__()}, \method{__setitem__()} or \method{__delitem__()} is
1251called with a slice object as argument.
Fred Drakef6669171998-05-06 19:52:49 +00001252
Fred Drakef89259782000-09-21 22:27:16 +00001253The following example demonstrate how to make your program or module
1254compatible with earlier versions of Python (assuming that methods
1255\method{__getitem__()}, \method{__setitem__()} and \method{__delitem__()}
1256support slice objects as arguments):
1257
1258\begin{verbatim}
1259class MyClass:
1260 ...
1261 def __getitem__(self, index):
1262 ...
1263 def __setitem__(self, index, value):
1264 ...
1265 def __delitem__(self, index):
1266 ...
1267
1268 if sys.version_info < (2, 0):
1269 # They won't be defined if version is at least 2.0 final
1270
1271 def __getslice__(self, i, j):
1272 return self[max(0, i):max(0, j):]
1273 def __setslice__(self, i, j, seq):
1274 self[max(0, i):max(0, j):] = seq
1275 def __delslice__(self, i, j):
1276 del self[max(0, i):max(0, j):]
1277 ...
1278\end{verbatim}
1279
1280Note the calls to \function{max()}; these are actually necessary due
1281to the handling of negative indices before the
1282\method{__*slice__()} methods are called. When negative indexes are
1283used, the \method{__*item__()} methods receive them as provided, but
1284the \method{__*slice__()} methods get a ``cooked'' form of the index
1285values. For each negative index value, the length of the sequence is
1286added to the index before calling the method (which may still result
1287in a negative index); this is the customary handling of negative
1288indexes by the built-in sequence types, and the \method{__*item__()}
1289methods are expected to do this as well. However, since they should
1290already be doing that, negative indexes cannot be passed in; they must
1291be be constrained to the bounds of the sequence before being passed to
1292the \method{__*item__()} methods.
1293Calling \code{max(0, i)} conveniently returns the proper value.
1294
Fred Drake8d27f892000-09-19 18:21:25 +00001295The membership test operators (\keyword{in} and \keyword{not in}) are
1296normally implemented as iteration loop through the sequence. However,
1297sequence objects can supply the following special method with a more
1298efficient implementation:
1299
1300\begin{methoddesc}[sequence object]{__contains__}{self, item}
1301Called to implement membership test operators. Should return true if
1302\var{item} is in \var{self}, false otherwise.
1303\end{methoddesc}
1304
Fred Drake15988fd1999-02-12 18:14:57 +00001305
Fred Drake61c77281998-07-28 19:34:22 +00001306\subsection{Emulating numeric types\label{numeric-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001307
1308The following methods can be defined to emulate numeric objects.
1309Methods corresponding to operations that are not supported by the
1310particular kind of number implemented (e.g., bitwise operations for
1311non-integral numbers) should be left undefined.
Fred Drakef6669171998-05-06 19:52:49 +00001312
Fred Drakeb8943701999-05-10 13:43:22 +00001313\begin{methoddesc}[numeric object]{__add__}{self, other}
1314\methodline[numeric object]{__sub__}{self, other}
1315\methodline[numeric object]{__mul__}{self, other}
1316\methodline[numeric object]{__div__}{self, other}
1317\methodline[numeric object]{__mod__}{self, other}
1318\methodline[numeric object]{__divmod__}{self, other}
1319\methodline[numeric object]{__pow__}{self, other\optional{, modulo}}
1320\methodline[numeric object]{__lshift__}{self, other}
1321\methodline[numeric object]{__rshift__}{self, other}
1322\methodline[numeric object]{__and__}{self, other}
1323\methodline[numeric object]{__xor__}{self, other}
1324\methodline[numeric object]{__or__}{self, other}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001325These functions are
1326called to implement the binary arithmetic operations (\code{+},
Fred Draked82575d1998-08-28 20:03:12 +00001327\code{-}, \code{*}, \code{/}, \code{\%},
1328\function{divmod()}\bifuncindex{divmod},
1329\function{pow()}\bifuncindex{pow}, \code{**}, \code{<<}, \code{>>},
1330\code{\&}, \code{\^}, \code{|}). For instance, to evaluate the
1331expression \var{x}\code{+}\var{y}, where \var{x} is an instance of a
1332class that has an \method{__add__()} method,
1333\code{\var{x}.__add__(\var{y})} is called. Note that
1334\method{__pow__()} should be defined to accept an optional third
1335argument if the ternary version of the built-in
1336\function{pow()}\bifuncindex{pow} function is to be supported.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001337\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001338
Fred Drakeb8943701999-05-10 13:43:22 +00001339\begin{methoddesc}[numeric object]{__radd__}{self, other}
1340\methodline[numeric object]{__rsub__}{self, other}
1341\methodline[numeric object]{__rmul__}{self, other}
1342\methodline[numeric object]{__rdiv__}{self, other}
1343\methodline[numeric object]{__rmod__}{self, other}
1344\methodline[numeric object]{__rdivmod__}{self, other}
1345\methodline[numeric object]{__rpow__}{self, other}
1346\methodline[numeric object]{__rlshift__}{self, other}
1347\methodline[numeric object]{__rrshift__}{self, other}
1348\methodline[numeric object]{__rand__}{self, other}
1349\methodline[numeric object]{__rxor__}{self, other}
1350\methodline[numeric object]{__ror__}{self, other}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001351These functions are
1352called to implement the binary arithmetic operations (\code{+},
Fred Draked82575d1998-08-28 20:03:12 +00001353\code{-}, \code{*}, \code{/}, \code{\%},
1354\function{divmod()}\bifuncindex{divmod},
1355\function{pow()}\bifuncindex{pow}, \code{**}, \code{<<}, \code{>>},
Guido van Rossumab782dd2001-01-18 15:17:06 +00001356\code{\&}, \code{\^}, \code{|}) with reflected (swapped) operands. These
Fred Draked82575d1998-08-28 20:03:12 +00001357functions are only called if the left operand does not support the
1358corresponding operation. For instance, to evaluate the expression
1359\var{x}\code{-}\var{y}, where \var{y} is an instance of a class that
1360has an \method{__rsub__()} method, \code{\var{y}.__rsub__(\var{x})} is
1361called. Note that ternary \function{pow()}\bifuncindex{pow} will not
1362try calling \method{__rpow__()} (the coercion rules would become too
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001363complicated).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001364\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001365
Thomas Woutersdc90cc22000-12-11 23:11:51 +00001366\begin{methoddesc}[numeric object]{__iadd__}{self, other}
1367\methodline[numeric object]{__isub__}{self, other}
1368\methodline[numeric object]{__imul__}{self, other}
1369\methodline[numeric object]{__idiv__}{self, other}
1370\methodline[numeric object]{__imod__}{self, other}
1371\methodline[numeric object]{__ipow__}{self, other\optional{, modulo}}
1372\methodline[numeric object]{__ilshift__}{self, other}
1373\methodline[numeric object]{__irshift__}{self, other}
1374\methodline[numeric object]{__iand__}{self, other}
1375\methodline[numeric object]{__ixor__}{self, other}
1376\methodline[numeric object]{__ior__}{self, other}
1377These methods are called to implement the augmented arithmetic operations
1378(\code{+=}, \code{-=}, \code{*=}, \code{/=}, \code{\%=}, \code{**=},
1379\code{<<=}, \code{>>=}, \code{\&=}, \code{\^=}, \code{|=}). These methods
1380should attempt to do the operation in-place (modifying \var{self}) and
1381return the result (which could be, but does not have to be, \var{self}). If
1382a specific method is not defined, the augmented operation falls back to the
1383normal methods. For instance, to evaluate the expression
1384\var{x}\code{+=}\var{y}, where \var{x} is an instance of a class that has an
1385\method{__iadd__()} method, \code{\var{x}.__iadd__(\var{y})} is called. If
1386\var{x} is an instance of a class that does not define a \method{__iadd()}
1387method, \code{\var{x}.__add__(\var{y})} and \code{\var{y}.__radd__(\var{x})}
1388are considered, as with the evaluation of \var{x}\code{+}\var{y}.
1389
1390\end{methoddesc}
1391
Fred Drakeb8943701999-05-10 13:43:22 +00001392\begin{methoddesc}[numeric object]{__neg__}{self}
1393\methodline[numeric object]{__pos__}{self}
1394\methodline[numeric object]{__abs__}{self}
1395\methodline[numeric object]{__invert__}{self}
Fred Drakef6669171998-05-06 19:52:49 +00001396Called to implement the unary arithmetic operations (\code{-}, \code{+},
Fred Drakee57a1142000-06-15 20:07:25 +00001397\function{abs()}\bifuncindex{abs} and \code{\~{}}).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001398\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001399
Fred Drakeb8943701999-05-10 13:43:22 +00001400\begin{methoddesc}[numeric object]{__complex__}{self}
1401\methodline[numeric object]{__int__}{self}
1402\methodline[numeric object]{__long__}{self}
1403\methodline[numeric object]{__float__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001404Called to implement the built-in functions
Fred Drake15988fd1999-02-12 18:14:57 +00001405\function{complex()}\bifuncindex{complex},
1406\function{int()}\bifuncindex{int}, \function{long()}\bifuncindex{long},
Fred Draked82575d1998-08-28 20:03:12 +00001407and \function{float()}\bifuncindex{float}. Should return a value of
1408the appropriate type.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001409\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001410
Fred Drakeb8943701999-05-10 13:43:22 +00001411\begin{methoddesc}[numeric object]{__oct__}{self}
1412\methodline[numeric object]{__hex__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001413Called to implement the built-in functions
1414\function{oct()}\bifuncindex{oct} and
1415\function{hex()}\bifuncindex{hex}. Should return a string value.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001416\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001417
Fred Drakeb8943701999-05-10 13:43:22 +00001418\begin{methoddesc}[numeric object]{__coerce__}{self, other}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001419Called to implement ``mixed-mode'' numeric arithmetic. Should either
Fred Draked82575d1998-08-28 20:03:12 +00001420return a 2-tuple containing \var{self} and \var{other} converted to
Fred Drakeb8943701999-05-10 13:43:22 +00001421a common numeric type, or \code{None} if conversion is impossible. When
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001422the common type would be the type of \code{other}, it is sufficient to
1423return \code{None}, since the interpreter will also ask the other
1424object to attempt a coercion (but sometimes, if the implementation of
1425the other type cannot be changed, it is useful to do the conversion to
1426the other type here).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001427\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001428
1429\strong{Coercion rules}: to evaluate \var{x} \var{op} \var{y}, the
1430following steps are taken (where \method{__op__()} and
1431\method{__rop__()} are the method names corresponding to \var{op},
Guido van Rossum7c0240f1998-07-24 15:36:43 +00001432e.g., if var{op} is `\code{+}', \method{__add__()} and
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001433\method{__radd__()} are used). If an exception occurs at any point,
1434the evaluation is abandoned and exception handling takes over.
1435
1436\begin{itemize}
1437
1438\item[0.] If \var{x} is a string object and op is the modulo operator (\%),
1439the string formatting operation is invoked and the remaining steps are
1440skipped.
1441
1442\item[1.] If \var{x} is a class instance:
1443
Fred Drake230d17d2001-02-22 21:28:04 +00001444 \begin{itemize}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001445
Fred Drake230d17d2001-02-22 21:28:04 +00001446 \item[1a.] If \var{x} has a \method{__coerce__()} method:
1447 replace \var{x} and \var{y} with the 2-tuple returned by
1448 \code{\var{x}.__coerce__(\var{y})}; skip to step 2 if the
1449 coercion returns \code{None}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001450
Fred Drake230d17d2001-02-22 21:28:04 +00001451 \item[1b.] If neither \var{x} nor \var{y} is a class instance
1452 after coercion, go to step 3.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001453
Fred Drake230d17d2001-02-22 21:28:04 +00001454 \item[1c.] If \var{x} has a method \method{__op__()}, return
1455 \code{\var{x}.__op__(\var{y})}; otherwise, restore \var{x} and
1456 \var{y} to their value before step 1a.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001457
Fred Drake230d17d2001-02-22 21:28:04 +00001458 \end{itemize}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001459
1460\item[2.] If \var{y} is a class instance:
1461
Fred Drake230d17d2001-02-22 21:28:04 +00001462 \begin{itemize}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001463
Fred Drake230d17d2001-02-22 21:28:04 +00001464 \item[2a.] If \var{y} has a \method{__coerce__()} method:
1465 replace \var{y} and \var{x} with the 2-tuple returned by
1466 \code{\var{y}.__coerce__(\var{x})}; skip to step 3 if the
1467 coercion returns \code{None}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001468
Fred Drake230d17d2001-02-22 21:28:04 +00001469 \item[2b.] If neither \var{x} nor \var{y} is a class instance
1470 after coercion, go to step 3.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001471
Fred Drake230d17d2001-02-22 21:28:04 +00001472 \item[2b.] If \var{y} has a method \method{__rop__()}, return
1473 \code{\var{y}.__rop__(\var{x})}; otherwise, restore \var{x}
1474 and \var{y} to their value before step 2a.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001475
Fred Drake230d17d2001-02-22 21:28:04 +00001476 \end{itemize}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001477
1478\item[3.] We only get here if neither \var{x} nor \var{y} is a class
1479instance.
1480
Fred Drake230d17d2001-02-22 21:28:04 +00001481 \begin{itemize}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001482
Fred Drake230d17d2001-02-22 21:28:04 +00001483 \item[3a.] If op is `\code{+}' and \var{x} is a sequence,
1484 sequence concatenation is invoked.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001485
Fred Drake230d17d2001-02-22 21:28:04 +00001486 \item[3b.] If op is `\code{*}' and one operand is a sequence
1487 and the other an integer, sequence repetition is invoked.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001488
Fred Drake230d17d2001-02-22 21:28:04 +00001489 \item[3c.] Otherwise, both operands must be numbers; they are
1490 coerced to a common type if possible, and the numeric
1491 operation is invoked for that type.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001492
Fred Drake230d17d2001-02-22 21:28:04 +00001493 \end{itemize}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001494
1495\end{itemize}