blob: a012188894a368024aaec22e96e87fef52592bfc [file] [log] [blame]
Fred Drake61c77281998-07-28 19:34:22 +00001\chapter{Data model\label{datamodel}}
Fred Drakef6669171998-05-06 19:52:49 +00002
Fred Drake61c77281998-07-28 19:34:22 +00003\section{Objects, values and types\label{objects}}
Fred Drakef6669171998-05-06 19:52:49 +00004
5\dfn{Objects} are Python's abstraction for data. All data in a Python
6program is represented by objects or by relations between objects.
7(In a sense, and in conformance to Von Neumann's model of a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00008``stored program computer,'' code is also represented by objects.)
Fred Drakef6669171998-05-06 19:52:49 +00009\index{object}
10\index{data}
11
12Every object has an identity, a type and a value. An object's
13\emph{identity} never changes once it has been created; you may think
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000014of it as the object's address in memory. The `\code{is}' operator
Fred Drake82385871998-10-01 20:40:43 +000015compares the identity of two objects; the
16\function{id()}\bifuncindex{id} function returns an integer
17representing its identity (currently implemented as its address).
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000018An object's \dfn{type} is
Fred Drakef6669171998-05-06 19:52:49 +000019also unchangeable. It determines the operations that an object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000020supports (e.g., ``does it have a length?'') and also defines the
Fred Drake82385871998-10-01 20:40:43 +000021possible values for objects of that type. The
22\function{type()}\bifuncindex{type} function returns an object's type
23(which is an object itself). The \emph{value} of some
Fred Drakef6669171998-05-06 19:52:49 +000024objects can change. Objects whose value can change are said to be
25\emph{mutable}; objects whose value is unchangeable once they are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000026created are called \emph{immutable}.
Guido van Rossum264bd591999-02-23 16:40:55 +000027(The value of an immutable container object that contains a reference
28to a mutable object can change when the latter's value is changed;
29however the container is still considered immutable, because the
30collection of objects it contains cannot be changed. So, immutability
31is not strictly the same as having an unchangeable value, it is more
32subtle.)
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000033An object's mutability is determined by its type; for instance,
34numbers, strings and tuples are immutable, while dictionaries and
35lists are mutable.
Fred Drakef6669171998-05-06 19:52:49 +000036\index{identity of an object}
37\index{value of an object}
38\index{type of an object}
39\index{mutable object}
40\index{immutable object}
41
42Objects are never explicitly destroyed; however, when they become
43unreachable they may be garbage-collected. An implementation is
Barry Warsaw92a6ed91998-08-07 16:33:51 +000044allowed to postpone garbage collection or omit it altogether --- it is
45a matter of implementation quality how garbage collection is
Fred Drakef6669171998-05-06 19:52:49 +000046implemented, as long as no objects are collected that are still
47reachable. (Implementation note: the current implementation uses a
48reference-counting scheme which collects most objects as soon as they
49become unreachable, but never collects garbage containing circular
50references.)
51\index{garbage collection}
52\index{reference counting}
53\index{unreachable object}
54
55Note that the use of the implementation's tracing or debugging
56facilities may keep objects alive that would normally be collectable.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000057Also note that catching an exception with a
Fred Drake4856d011999-01-12 04:15:20 +000058`\keyword{try}...\keyword{except}' statement may keep objects alive.
Fred Drakef6669171998-05-06 19:52:49 +000059
60Some objects contain references to ``external'' resources such as open
61files or windows. It is understood that these resources are freed
62when the object is garbage-collected, but since garbage collection is
63not guaranteed to happen, such objects also provide an explicit way to
64release the external resource, usually a \method{close()} method.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000065Programs are strongly recommended to explicitly close such
Fred Drake4856d011999-01-12 04:15:20 +000066objects. The `\keyword{try}...\keyword{finally}' statement provides
67a convenient way to do this.
Fred Drakef6669171998-05-06 19:52:49 +000068
69Some objects contain references to other objects; these are called
70\emph{containers}. Examples of containers are tuples, lists and
71dictionaries. The references are part of a container's value. In
72most cases, when we talk about the value of a container, we imply the
73values, not the identities of the contained objects; however, when we
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000074talk about the mutability of a container, only the identities of
75the immediately contained objects are implied. So, if an immutable
76container (like a tuple)
77contains a reference to a mutable object, its value changes
78if that mutable object is changed.
Fred Drakef6669171998-05-06 19:52:49 +000079\index{container}
80
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000081Types affect almost all aspects of object behavior. Even the importance
Fred Drakef6669171998-05-06 19:52:49 +000082of object identity is affected in some sense: for immutable types,
83operations that compute new values may actually return a reference to
84any existing object with the same type and value, while for mutable
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000085objects this is not allowed. E.g., after
Fred Drake82385871998-10-01 20:40:43 +000086\samp{a = 1; b = 1},
Fred Drakef6669171998-05-06 19:52:49 +000087\code{a} and \code{b} may or may not refer to the same object with the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000088value one, depending on the implementation, but after
Fred Drake82385871998-10-01 20:40:43 +000089\samp{c = []; d = []}, \code{c} and \code{d}
Fred Drakef6669171998-05-06 19:52:49 +000090are guaranteed to refer to two different, unique, newly created empty
91lists.
Fred Drake82385871998-10-01 20:40:43 +000092(Note that \samp{c = d = []} assigns the same object to both
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000093\code{c} and \code{d}.)
Fred Drakef6669171998-05-06 19:52:49 +000094
Fred Drake61c77281998-07-28 19:34:22 +000095\section{The standard type hierarchy\label{types}}
Fred Drakef6669171998-05-06 19:52:49 +000096
97Below is a list of the types that are built into Python. Extension
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000098modules written in \C{} can define additional types. Future versions of
99Python may add types to the type hierarchy (e.g., rational
Fred Drakef6669171998-05-06 19:52:49 +0000100numbers, efficiently stored arrays of integers, etc.).
101\index{type}
102\indexii{data}{type}
103\indexii{type}{hierarchy}
104\indexii{extension}{module}
105\indexii{C}{language}
106
107Some of the type descriptions below contain a paragraph listing
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000108`special attributes.' These are attributes that provide access to the
Fred Drakef6669171998-05-06 19:52:49 +0000109implementation and are not intended for general use. Their definition
110may change in the future. There are also some `generic' special
111attributes, not listed with the individual objects: \member{__methods__}
112is a list of the method names of a built-in object, if it has any;
113\member{__members__} is a list of the data attribute names of a built-in
114object, if it has any.
115\index{attribute}
116\indexii{special}{attribute}
117\indexiii{generic}{special}{attribute}
Fred Drake4856d011999-01-12 04:15:20 +0000118\withsubitem{(built-in object attribute)}{
Fred Drake1e42d8a1998-11-25 17:58:50 +0000119 \ttindex{__methods__}
120 \ttindex{__members__}}
Fred Drakef6669171998-05-06 19:52:49 +0000121
122\begin{description}
123
124\item[None]
125This type has a single value. There is a single object with this value.
126This object is accessed through the built-in name \code{None}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000127It is used to signify the absence of a value in many situations, e.g.,
128it is returned from functions that don't explicitly return anything.
129Its truth value is false.
Fred Drakef6669171998-05-06 19:52:49 +0000130\ttindex{None}
Fred Drake78eebfd1998-11-25 19:09:24 +0000131\obindex{None@{\texttt{None}}}
Fred Drakef6669171998-05-06 19:52:49 +0000132
Neil Schemenauer48c2eb92001-01-04 01:25:50 +0000133\item[NotImplemented]
134This type has a single value. There is a single object with this value.
135This object is accessed through the built-in name \code{NotImplemented}.
136Binary number methods may return this value if they do not implement the
137operation for the types of operands provided. The interpreter will then
138try the reverse operation. Its truth value is true.
139\ttindex{NotImplemented}
140\obindex{NotImplemented@{\texttt{NotImplemented}}}
141
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000142\item[Ellipsis]
143This type has a single value. There is a single object with this value.
144This object is accessed through the built-in name \code{Ellipsis}.
Fred Drake82385871998-10-01 20:40:43 +0000145It is used to indicate the presence of the \samp{...} syntax in a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000146slice. Its truth value is true.
147\ttindex{Ellipsis}
Fred Drake78eebfd1998-11-25 19:09:24 +0000148\obindex{Ellipsis@{\texttt{Ellipsis}}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000149
Fred Drakef6669171998-05-06 19:52:49 +0000150\item[Numbers]
151These are created by numeric literals and returned as results by
152arithmetic operators and arithmetic built-in functions. Numeric
153objects are immutable; once created their value never changes. Python
154numbers are of course strongly related to mathematical numbers, but
155subject to the limitations of numerical representation in computers.
Fred Drakef6669171998-05-06 19:52:49 +0000156\obindex{numeric}
157
158Python distinguishes between integers and floating point numbers:
159
160\begin{description}
161\item[Integers]
162These represent elements from the mathematical set of whole numbers.
163\obindex{integer}
164
165There are two types of integers:
166
167\begin{description}
168
169\item[Plain integers]
170These represent numbers in the range -2147483648 through 2147483647.
171(The range may be larger on machines with a larger natural word
172size, but not smaller.)
Fred Drakee15956b2000-04-03 04:51:13 +0000173When the result of an operation would fall outside this range, the
Fred Drakef6669171998-05-06 19:52:49 +0000174exception \exception{OverflowError} is raised.
175For the purpose of shift and mask operations, integers are assumed to
176have a binary, 2's complement notation using 32 or more bits, and
177hiding no bits from the user (i.e., all 4294967296 different bit
178patterns correspond to different values).
179\obindex{plain integer}
180\withsubitem{(built-in exception)}{\ttindex{OverflowError}}
181
182\item[Long integers]
183These represent numbers in an unlimited range, subject to available
184(virtual) memory only. For the purpose of shift and mask operations,
185a binary representation is assumed, and negative numbers are
186represented in a variant of 2's complement which gives the illusion of
187an infinite string of sign bits extending to the left.
188\obindex{long integer}
189
190\end{description} % Integers
191
192The rules for integer representation are intended to give the most
193meaningful interpretation of shift and mask operations involving
194negative integers and the least surprises when switching between the
195plain and long integer domains. For any operation except left shift,
196if it yields a result in the plain integer domain without causing
197overflow, it will yield the same result in the long integer domain or
198when using mixed operands.
199\indexii{integer}{representation}
200
201\item[Floating point numbers]
202These represent machine-level double precision floating point numbers.
203You are at the mercy of the underlying machine architecture and
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000204\C{} implementation for the accepted range and handling of overflow.
205Python does not support single-precision floating point numbers; the
206savings in CPU and memory usage that are usually the reason for using
207these is dwarfed by the overhead of using objects in Python, so there
208is no reason to complicate the language with two kinds of floating
209point numbers.
Fred Drakef6669171998-05-06 19:52:49 +0000210\obindex{floating point}
211\indexii{floating point}{number}
212\indexii{C}{language}
213
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000214\item[Complex numbers]
215These represent complex numbers as a pair of machine-level double
216precision floating point numbers. The same caveats apply as for
217floating point numbers. The real and imaginary value of a complex
218number \code{z} can be retrieved through the attributes \code{z.real}
219and \code{z.imag}.
220\obindex{complex}
221\indexii{complex}{number}
222
Fred Drakef6669171998-05-06 19:52:49 +0000223\end{description} % Numbers
224
225\item[Sequences]
226These represent finite ordered sets indexed by natural numbers.
227The built-in function \function{len()}\bifuncindex{len} returns the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000228number of items of a sequence.
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000229When the length of a sequence is \var{n}, the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000230index set contains the numbers 0, 1, \ldots, \var{n}-1. Item
Fred Drakef6669171998-05-06 19:52:49 +0000231\var{i} of sequence \var{a} is selected by \code{\var{a}[\var{i}]}.
Fred Drakee15956b2000-04-03 04:51:13 +0000232\obindex{sequence}
Fred Drakef6669171998-05-06 19:52:49 +0000233\index{index operation}
234\index{item selection}
235\index{subscription}
236
237Sequences also support slicing: \code{\var{a}[\var{i}:\var{j}]}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000238selects all items with index \var{k} such that \var{i} \code{<=}
Fred Drakef6669171998-05-06 19:52:49 +0000239\var{k} \code{<} \var{j}. When used as an expression, a slice is a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000240sequence of the same type. This implies that the index set is
241renumbered so that it starts at 0.
Fred Drakef6669171998-05-06 19:52:49 +0000242\index{slicing}
243
244Sequences are distinguished according to their mutability:
245
246\begin{description}
Fred Drake4856d011999-01-12 04:15:20 +0000247
Fred Drakef6669171998-05-06 19:52:49 +0000248\item[Immutable sequences]
249An object of an immutable sequence type cannot change once it is
250created. (If the object contains references to other objects,
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000251these other objects may be mutable and may be changed; however,
Fred Drakef6669171998-05-06 19:52:49 +0000252the collection of objects directly referenced by an immutable object
253cannot change.)
254\obindex{immutable sequence}
255\obindex{immutable}
256
257The following types are immutable sequences:
258
259\begin{description}
260
261\item[Strings]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000262The items of a string are characters. There is no separate
263character type; a character is represented by a string of one item.
Fred Drakef6669171998-05-06 19:52:49 +0000264Characters represent (at least) 8-bit bytes. The built-in
265functions \function{chr()}\bifuncindex{chr} and
266\function{ord()}\bifuncindex{ord} convert between characters and
267nonnegative integers representing the byte values. Bytes with the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000268values 0-127 usually represent the corresponding \ASCII{} values, but
269the interpretation of values is up to the program. The string
270data type is also used to represent arrays of bytes, e.g., to hold data
Fred Drakef6669171998-05-06 19:52:49 +0000271read from a file.
272\obindex{string}
273\index{character}
274\index{byte}
Fred Drake5c07d9b1998-05-14 19:37:06 +0000275\index{ASCII@\ASCII{}}
Fred Drakef6669171998-05-06 19:52:49 +0000276
277(On systems whose native character set is not \ASCII{}, strings may use
278EBCDIC in their internal representation, provided the functions
279\function{chr()} and \function{ord()} implement a mapping between \ASCII{} and
280EBCDIC, and string comparison preserves the \ASCII{} order.
281Or perhaps someone can propose a better rule?)
Fred Drake5c07d9b1998-05-14 19:37:06 +0000282\index{ASCII@\ASCII{}}
Fred Drakef6669171998-05-06 19:52:49 +0000283\index{EBCDIC}
284\index{character set}
285\indexii{string}{comparison}
286\bifuncindex{chr}
287\bifuncindex{ord}
288
Fred Drakef0aff8e2000-04-06 13:57:21 +0000289\item[Unicode]
290The items of a Unicode object are Unicode characters. A Unicode
291character is represented by a Unicode object of one item and can hold
292a 16-bit value representing a Unicode ordinal. The built-in functions
293\function{unichr()}\bifuncindex{unichr} and
294\function{ord()}\bifuncindex{ord} convert between characters and
295nonnegative integers representing the Unicode ordinals as defined in
296the Unicode Standard 3.0. Conversion from and to other encodings are
297possible through the Unicode method \method{encode} and the built-in
298function \function{unicode()}\bifuncindex{unicode}.
299\obindex{unicode}
300\index{character}
301\index{integer}
Fred Drake8b3ce9e2000-04-06 14:00:14 +0000302\index{Unicode}
Fred Drakef0aff8e2000-04-06 13:57:21 +0000303
Fred Drakef6669171998-05-06 19:52:49 +0000304\item[Tuples]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000305The items of a tuple are arbitrary Python objects.
306Tuples of two or more items are formed by comma-separated lists
307of expressions. A tuple of one item (a `singleton') can be formed
Fred Drakef6669171998-05-06 19:52:49 +0000308by affixing a comma to an expression (an expression by itself does
309not create a tuple, since parentheses must be usable for grouping of
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000310expressions). An empty tuple can be formed by an empty pair of
Fred Drakef6669171998-05-06 19:52:49 +0000311parentheses.
312\obindex{tuple}
313\indexii{singleton}{tuple}
314\indexii{empty}{tuple}
315
316\end{description} % Immutable sequences
317
318\item[Mutable sequences]
319Mutable sequences can be changed after they are created. The
320subscription and slicing notations can be used as the target of
321assignment and \keyword{del} (delete) statements.
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000322\obindex{mutable sequence}
Fred Drakef6669171998-05-06 19:52:49 +0000323\obindex{mutable}
324\indexii{assignment}{statement}
325\index{delete}
326\stindex{del}
327\index{subscription}
328\index{slicing}
329
330There is currently a single mutable sequence type:
331
332\begin{description}
333
334\item[Lists]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000335The items of a list are arbitrary Python objects. Lists are formed
Fred Drakef6669171998-05-06 19:52:49 +0000336by placing a comma-separated list of expressions in square brackets.
337(Note that there are no special cases needed to form lists of length 0
338or 1.)
339\obindex{list}
340
341\end{description} % Mutable sequences
342
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000343The extension module \module{array}\refstmodindex{array} provides an
344additional example of a mutable sequence type.
345
346
Fred Drakef6669171998-05-06 19:52:49 +0000347\end{description} % Sequences
348
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000349\item[Mappings]
Fred Drakef6669171998-05-06 19:52:49 +0000350These represent finite sets of objects indexed by arbitrary index sets.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000351The subscript notation \code{a[k]} selects the item indexed
Fred Drakef6669171998-05-06 19:52:49 +0000352by \code{k} from the mapping \code{a}; this can be used in
353expressions and as the target of assignments or \keyword{del} statements.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000354The built-in function \function{len()} returns the number of items
Fred Drakef6669171998-05-06 19:52:49 +0000355in a mapping.
356\bifuncindex{len}
357\index{subscription}
358\obindex{mapping}
359
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000360There is currently a single intrinsic mapping type:
Fred Drakef6669171998-05-06 19:52:49 +0000361
362\begin{description}
363
364\item[Dictionaries]
Fred Drake8cdee961999-02-23 18:50:38 +0000365These\obindex{dictionary} represent finite sets of objects indexed by
366nearly arbitrary values. The only types of values not acceptable as
367keys are values containing lists or dictionaries or other mutable
368types that are compared by value rather than by object identity, the
369reason being that the efficient implementation of dictionaries
370requires a key's hash value to remain constant.
Fred Drakef6669171998-05-06 19:52:49 +0000371Numeric types used for keys obey the normal rules for numeric
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000372comparison: if two numbers compare equal (e.g., \code{1} and
Fred Drakef6669171998-05-06 19:52:49 +0000373\code{1.0}) then they can be used interchangeably to index the same
374dictionary entry.
375
Fred Drake8cdee961999-02-23 18:50:38 +0000376Dictionaries are \obindex{mutable}mutable; they are created by the
377\code{\{...\}} notation (see section \ref{dict}, ``Dictionary
378Displays'').
Fred Drakef6669171998-05-06 19:52:49 +0000379
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000380The extension modules \module{dbm}\refstmodindex{dbm},
381\module{gdbm}\refstmodindex{gdbm}, \module{bsddb}\refstmodindex{bsddb}
382provide additional examples of mapping types.
383
Fred Drakef6669171998-05-06 19:52:49 +0000384\end{description} % Mapping types
385
386\item[Callable types]
Fred Drake8cdee961999-02-23 18:50:38 +0000387These\obindex{callable} are the types to which the function call
388operation (see section \ref{calls}, ``Calls'') can be applied:
Fred Drakef6669171998-05-06 19:52:49 +0000389\indexii{function}{call}
390\index{invocation}
391\indexii{function}{argument}
Fred Drakef6669171998-05-06 19:52:49 +0000392
393\begin{description}
394
395\item[User-defined functions]
396A user-defined function object is created by a function definition
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000397(see section \ref{function}, ``Function definitions''). It should be
398called with an argument
Fred Drakef6669171998-05-06 19:52:49 +0000399list containing the same number of items as the function's formal
400parameter list.
401\indexii{user-defined}{function}
402\obindex{function}
403\obindex{user-defined function}
404
Guido van Rossum264bd591999-02-23 16:40:55 +0000405Special attributes: \member{func_doc} or \member{__doc__} is the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000406function's documentation string, or None if unavailable;
Fred Drake82385871998-10-01 20:40:43 +0000407\member{func_name} or \member{__name__} is the function's name;
408\member{func_defaults} is a tuple containing default argument values for
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000409those arguments that have defaults, or \code{None} if no arguments
Fred Drake82385871998-10-01 20:40:43 +0000410have a default value; \member{func_code} is the code object representing
411the compiled function body; \member{func_globals} is (a reference to)
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000412the dictionary that holds the function's global variables --- it
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000413defines the global namespace of the module in which the function was
Guido van Rossum264bd591999-02-23 16:40:55 +0000414defined.
415Of these, \member{func_code}, \member{func_defaults} and
416\member{func_doc} (and this \member{__doc__}) may be writable; the
417others can never be changed.
418Additional information about a function's definition can be
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000419retrieved from its code object; see the description of internal types
420below.
Fred Drake4856d011999-01-12 04:15:20 +0000421\withsubitem{(function attribute)}{
422 \ttindex{func_doc}
423 \ttindex{__doc__}
424 \ttindex{__name__}
425 \ttindex{func_defaults}
426 \ttindex{func_code}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000427 \ttindex{func_globals}}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000428\indexii{global}{namespace}
Fred Drakef6669171998-05-06 19:52:49 +0000429
430\item[User-defined methods]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000431A user-defined method object combines a class, a class instance (or
432\code{None}) and a user-defined function.
Fred Drakef6669171998-05-06 19:52:49 +0000433\obindex{method}
434\obindex{user-defined method}
435\indexii{user-defined}{method}
Fred Drakef6669171998-05-06 19:52:49 +0000436
437Special read-only attributes: \member{im_self} is the class instance
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000438object, \member{im_func} is the function object;
Fred Drake82385871998-10-01 20:40:43 +0000439\member{im_class} is the class that defined the method (which may be a
440base class of the class of which \member{im_self} is an instance);
441\member{__doc__} is the method's documentation (same as
442\code{im_func.__doc__}); \member{__name__} is the method name (same as
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000443\code{im_func.__name__}).
Fred Drake4856d011999-01-12 04:15:20 +0000444\withsubitem{(method attribute)}{
445 \ttindex{im_func}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000446 \ttindex{im_self}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000447
448User-defined method objects are created in two ways: when getting an
449attribute of a class that is a user-defined function object, or when
Fred Drake35c09f22000-06-28 20:15:47 +0000450getting an attribute of a class instance that is a user-defined
451function object defined by the class of the instance. In the former
452case (class attribute), the \member{im_self} attribute is \code{None},
453and the method object is said to be unbound; in the latter case
454(instance attribute), \method{im_self} is the instance, and the method
455object is said to be bound. For
Fred Drake82385871998-10-01 20:40:43 +0000456instance, when \class{C} is a class which contains a definition for a
457function \method{f()}, \code{C.f} does not yield the function object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000458\code{f}; rather, it yields an unbound method object \code{m} where
Fred Drake82385871998-10-01 20:40:43 +0000459\code{m.im_class} is \class{C}, \code{m.im_func} is \method{f()}, and
460\code{m.im_self} is \code{None}. When \code{x} is a \class{C}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000461instance, \code{x.f} yields a bound method object \code{m} where
Fred Drake82385871998-10-01 20:40:43 +0000462\code{m.im_class} is \code{C}, \code{m.im_func} is \method{f()}, and
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000463\code{m.im_self} is \code{x}.
Fred Drake4856d011999-01-12 04:15:20 +0000464\withsubitem{(method attribute)}{
Fred Drake35c09f22000-06-28 20:15:47 +0000465 \ttindex{im_class}\ttindex{im_func}\ttindex{im_self}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000466
467When an unbound user-defined method object is called, the underlying
Fred Drake82385871998-10-01 20:40:43 +0000468function (\member{im_func}) is called, with the restriction that the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000469first argument must be an instance of the proper class
Fred Drake82385871998-10-01 20:40:43 +0000470(\member{im_class}) or of a derived class thereof.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000471
472When a bound user-defined method object is called, the underlying
Fred Drake82385871998-10-01 20:40:43 +0000473function (\member{im_func}) is called, inserting the class instance
474(\member{im_self}) in front of the argument list. For instance, when
475\class{C} is a class which contains a definition for a function
476\method{f()}, and \code{x} is an instance of \class{C}, calling
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000477\code{x.f(1)} is equivalent to calling \code{C.f(x, 1)}.
478
479Note that the transformation from function object to (unbound or
480bound) method object happens each time the attribute is retrieved from
481the class or instance. In some cases, a fruitful optimization is to
482assign the attribute to a local variable and call that local variable.
483Also notice that this transformation only happens for user-defined
484functions; other callable objects (and all non-callable objects) are
Fred Drake35c09f22000-06-28 20:15:47 +0000485retrieved without transformation. It is also important to note that
486user-defined functions which are attributes of a class instance are
487not converted to bound methods; this \emph{only} happens when the
488function is an attribute of the class.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000489
Fred Drakef6669171998-05-06 19:52:49 +0000490\item[Built-in functions]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000491A built-in function object is a wrapper around a \C{} function. Examples
492of built-in functions are \function{len()} and \function{math.sin()}
493(\module{math} is a standard built-in module).
494The number and type of the arguments are
Fred Drakef6669171998-05-06 19:52:49 +0000495determined by the C function.
Fred Drake82385871998-10-01 20:40:43 +0000496Special read-only attributes: \member{__doc__} is the function's
497documentation string, or \code{None} if unavailable; \member{__name__}
498is the function's name; \member{__self__} is set to \code{None} (but see
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000499the next item).
Fred Drakef6669171998-05-06 19:52:49 +0000500\obindex{built-in function}
501\obindex{function}
502\indexii{C}{language}
503
504\item[Built-in methods]
505This is really a different disguise of a built-in function, this time
506containing an object passed to the \C{} function as an implicit extra
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000507argument. An example of a built-in method is
508\code{\var{list}.append()}, assuming
Fred Drakef6669171998-05-06 19:52:49 +0000509\var{list} is a list object.
Fred Drake82385871998-10-01 20:40:43 +0000510In this case, the special read-only attribute \member{__self__} is set
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000511to the object denoted by \code{list}.
Fred Drakef6669171998-05-06 19:52:49 +0000512\obindex{built-in method}
513\obindex{method}
514\indexii{built-in}{method}
515
516\item[Classes]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000517Class objects are described below. When a class object is called,
518a new class instance (also described below) is created and
Fred Drakef6669171998-05-06 19:52:49 +0000519returned. This implies a call to the class's \method{__init__()} method
520if it has one. Any arguments are passed on to the \method{__init__()}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000521method. If there is no \method{__init__()} method, the class must be called
Fred Drakef6669171998-05-06 19:52:49 +0000522without arguments.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000523\withsubitem{(object method)}{\ttindex{__init__()}}
Fred Drakef6669171998-05-06 19:52:49 +0000524\obindex{class}
525\obindex{class instance}
526\obindex{instance}
527\indexii{class object}{call}
528
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000529\item[Class instances]
530Class instances are described below. Class instances are callable
Fred Drake82385871998-10-01 20:40:43 +0000531only when the class has a \method{__call__()} method; \code{x(arguments)}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000532is a shorthand for \code{x.__call__(arguments)}.
533
Fred Drakef6669171998-05-06 19:52:49 +0000534\end{description}
535
536\item[Modules]
537Modules are imported by the \keyword{import} statement (see section
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000538\ref{import}, ``The \keyword{import} statement'').
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000539A module object has a namespace implemented by a dictionary object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000540(this is the dictionary referenced by the func_globals attribute of
541functions defined in the module). Attribute references are translated
542to lookups in this dictionary, e.g., \code{m.x} is equivalent to
543\code{m.__dict__["x"]}.
544A module object does not contain the code object used to
Fred Drakef6669171998-05-06 19:52:49 +0000545initialize the module (since it isn't needed once the initialization
546is done).
547\stindex{import}
548\obindex{module}
549
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000550Attribute assignment updates the module's namespace dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000551e.g., \samp{m.x = 1} is equivalent to \samp{m.__dict__["x"] = 1}.
Fred Drakef6669171998-05-06 19:52:49 +0000552
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000553Special read-only attribute: \member{__dict__} is the module's
554namespace as a dictionary object.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000555\withsubitem{(module attribute)}{\ttindex{__dict__}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000556
557Predefined (writable) attributes: \member{__name__}
558is the module's name; \member{__doc__} is the
559module's documentation string, or
Fred Drake82385871998-10-01 20:40:43 +0000560\code{None} if unavailable; \member{__file__} is the pathname of the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000561file from which the module was loaded, if it was loaded from a file.
Fred Drake82385871998-10-01 20:40:43 +0000562The \member{__file__} attribute is not present for C{} modules that are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000563statically linked into the interpreter; for extension modules loaded
564dynamically from a shared library, it is the pathname of the shared
565library file.
Fred Drake4856d011999-01-12 04:15:20 +0000566\withsubitem{(module attribute)}{
567 \ttindex{__name__}
568 \ttindex{__doc__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000569 \ttindex{__file__}}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000570\indexii{module}{namespace}
Fred Drakef6669171998-05-06 19:52:49 +0000571
572\item[Classes]
573Class objects are created by class definitions (see section
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000574\ref{class}, ``Class definitions'').
575A class has a namespace implemented by a dictionary object.
576Class attribute references are translated to
577lookups in this dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000578e.g., \samp{C.x} is translated to \samp{C.__dict__["x"]}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000579When the attribute name is not found
Fred Drakef6669171998-05-06 19:52:49 +0000580there, the attribute search continues in the base classes. The search
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000581is depth-first, left-to-right in the order of occurrence in the
Fred Drakef6669171998-05-06 19:52:49 +0000582base class list.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000583When a class attribute reference would yield a user-defined function
584object, it is transformed into an unbound user-defined method object
Fred Drake82385871998-10-01 20:40:43 +0000585(see above). The \member{im_class} attribute of this method object is the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000586class in which the function object was found, not necessarily the
587class for which the attribute reference was initiated.
Fred Drakef6669171998-05-06 19:52:49 +0000588\obindex{class}
589\obindex{class instance}
590\obindex{instance}
591\indexii{class object}{call}
592\index{container}
593\obindex{dictionary}
594\indexii{class}{attribute}
595
596Class attribute assignments update the class's dictionary, never the
597dictionary of a base class.
598\indexiii{class}{attribute}{assignment}
599
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000600A class object can be called (see above) to yield a class instance (see
601below).
Fred Drakef6669171998-05-06 19:52:49 +0000602\indexii{class object}{call}
603
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000604Special attributes: \member{__name__} is the class name;
605\member{__module__} is the module name in which the class was defined;
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000606\member{__dict__} is the dictionary containing the class's namespace;
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000607\member{__bases__} is a tuple (possibly empty or a singleton)
608containing the base classes, in the order of their occurrence in the
Fred Drake82385871998-10-01 20:40:43 +0000609base class list; \member{__doc__} is the class's documentation string,
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000610or None if undefined.
Fred Drake4856d011999-01-12 04:15:20 +0000611\withsubitem{(class attribute)}{
612 \ttindex{__name__}
613 \ttindex{__module__}
614 \ttindex{__dict__}
615 \ttindex{__bases__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000616 \ttindex{__doc__}}
Fred Drakef6669171998-05-06 19:52:49 +0000617
618\item[Class instances]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000619A class instance is created by calling a class object (see above).
620A class instance has a namespace implemented as a dictionary which
621is the first place in which
Fred Drakef6669171998-05-06 19:52:49 +0000622attribute references are searched. When an attribute is not found
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000623there, and the instance's class has an attribute by that name,
624the search continues with the class attributes. If a class attribute
625is found that is a user-defined function object (and in no other
626case), it is transformed into an unbound user-defined method object
Fred Drake82385871998-10-01 20:40:43 +0000627(see above). The \member{im_class} attribute of this method object is
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000628the class in which the function object was found, not necessarily the
629class of the instance for which the attribute reference was initiated.
630If no class attribute is found, and the object's class has a
Fred Drake82385871998-10-01 20:40:43 +0000631\method{__getattr__()} method, that is called to satisfy the lookup.
Fred Drakef6669171998-05-06 19:52:49 +0000632\obindex{class instance}
633\obindex{instance}
634\indexii{class}{instance}
635\indexii{class instance}{attribute}
636
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000637Attribute assignments and deletions update the instance's dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000638never a class's dictionary. If the class has a \method{__setattr__()} or
639\method{__delattr__()} method, this is called instead of updating the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000640instance dictionary directly.
Fred Drakef6669171998-05-06 19:52:49 +0000641\indexiii{class instance}{attribute}{assignment}
642
643Class instances can pretend to be numbers, sequences, or mappings if
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000644they have methods with certain special names. See
645section \ref{specialnames}, ``Special method names.''
Fred Drakee15956b2000-04-03 04:51:13 +0000646\obindex{numeric}
Fred Drakef6669171998-05-06 19:52:49 +0000647\obindex{sequence}
648\obindex{mapping}
649
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000650Special attributes: \member{__dict__} is the attribute
651dictionary; \member{__class__} is the instance's class.
Fred Drake4856d011999-01-12 04:15:20 +0000652\withsubitem{(instance attribute)}{
653 \ttindex{__dict__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000654 \ttindex{__class__}}
Fred Drakef6669171998-05-06 19:52:49 +0000655
656\item[Files]
Fred Drakee15eb351999-11-10 16:13:25 +0000657A file\obindex{file} object represents an open file. File objects are
658created by the \function{open()}\bifuncindex{open} built-in function,
659and also by
660\withsubitem{(in module os)}{\ttindex{popen()}}\function{os.popen()},
661\function{os.fdopen()}, and the
662\method{makefile()}\withsubitem{(socket method)}{\ttindex{makefile()}}
663method of socket objects (and perhaps by other functions or methods
664provided by extension modules). The objects
665\ttindex{sys.stdin}\code{sys.stdin},
666\ttindex{sys.stdout}\code{sys.stdout} and
667\ttindex{sys.stderr}\code{sys.stderr} are initialized to file objects
668corresponding to the interpreter's standard\index{stdio} input, output
669and error streams. See the \citetitle[../lib/lib.html]{Python Library
670Reference} for complete documentation of file objects.
Fred Drake4856d011999-01-12 04:15:20 +0000671\withsubitem{(in module sys)}{
672 \ttindex{stdin}
673 \ttindex{stdout}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000674 \ttindex{stderr}}
Fred Drakee15eb351999-11-10 16:13:25 +0000675
Fred Drakef6669171998-05-06 19:52:49 +0000676
677\item[Internal types]
678A few types used internally by the interpreter are exposed to the user.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000679Their definitions may change with future versions of the interpreter,
Fred Drakef6669171998-05-06 19:52:49 +0000680but they are mentioned here for completeness.
681\index{internal type}
682\index{types, internal}
683
684\begin{description}
685
686\item[Code objects]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000687Code objects represent \emph{byte-compiled} executable Python code, or
688\emph{bytecode}.
Fred Drakef6669171998-05-06 19:52:49 +0000689The difference between a code
690object and a function object is that the function object contains an
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000691explicit reference to the function's globals (the module in which it
692was defined), while a code object contains no context;
693also the default argument values are stored in the function object,
694not in the code object (because they represent values calculated at
695run-time). Unlike function objects, code objects are immutable and
696contain no references (directly or indirectly) to mutable objects.
697\index{bytecode}
Fred Drakef6669171998-05-06 19:52:49 +0000698\obindex{code}
699
Fred Drake1e42d8a1998-11-25 17:58:50 +0000700Special read-only attributes: \member{co_name} gives the function
701name; \member{co_argcount} is the number of positional arguments
702(including arguments with default values); \member{co_nlocals} is the
703number of local variables used by the function (including arguments);
704\member{co_varnames} is a tuple containing the names of the local
705variables (starting with the argument names); \member{co_code} is a
706string representing the sequence of bytecode instructions;
707\member{co_consts} is a tuple containing the literals used by the
708bytecode; \member{co_names} is a tuple containing the names used by
709the bytecode; \member{co_filename} is the filename from which the code
710was compiled; \member{co_firstlineno} is the first line number of the
711function; \member{co_lnotab} is a string encoding the mapping from
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000712byte code offsets to line numbers (for details see the source code of
Fred Drake1e42d8a1998-11-25 17:58:50 +0000713the interpreter); \member{co_stacksize} is the required stack size
714(including local variables); \member{co_flags} is an integer encoding
715a number of flags for the interpreter.
Fred Drake4856d011999-01-12 04:15:20 +0000716\withsubitem{(code object attribute)}{
717 \ttindex{co_argcount}
718 \ttindex{co_code}
719 \ttindex{co_consts}
720 \ttindex{co_filename}
721 \ttindex{co_firstlineno}
722 \ttindex{co_flags}
723 \ttindex{co_lnotab}
724 \ttindex{co_name}
725 \ttindex{co_names}
726 \ttindex{co_nlocals}
727 \ttindex{co_stacksize}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000728 \ttindex{co_varnames}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000729
Fred Drakee15956b2000-04-03 04:51:13 +0000730The following flag bits are defined for \member{co_flags}: bit
731\code{0x04} is set if the function uses the \samp{*arguments} syntax
732to accept an arbitrary number of positional arguments; bit
733\code{0x08} is set if the function uses the \samp{**keywords} syntax
734to accept arbitrary keyword arguments; other bits are used internally
735or reserved for future use. If\index{documentation string} a code
736object represents a function, the first item in \member{co_consts} is
737the documentation string of the function, or \code{None} if undefined.
Fred Drakef6669171998-05-06 19:52:49 +0000738
739\item[Frame objects]
740Frame objects represent execution frames. They may occur in traceback
741objects (see below).
742\obindex{frame}
743
744Special read-only attributes: \member{f_back} is to the previous
745stack frame (towards the caller), or \code{None} if this is the bottom
746stack frame; \member{f_code} is the code object being executed in this
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000747frame; \member{f_locals} is the dictionary used to look up local
748variables; \member{f_globals} is used for global variables;
Fred Drake82385871998-10-01 20:40:43 +0000749\member{f_builtins} is used for built-in (intrinsic) names;
750\member{f_restricted} is a flag indicating whether the function is
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000751executing in restricted execution mode;
Fred Drakef6669171998-05-06 19:52:49 +0000752\member{f_lineno} gives the line number and \member{f_lasti} gives the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000753precise instruction (this is an index into the bytecode string of
Fred Drakef6669171998-05-06 19:52:49 +0000754the code object).
Fred Drake4856d011999-01-12 04:15:20 +0000755\withsubitem{(frame attribute)}{
756 \ttindex{f_back}
757 \ttindex{f_code}
758 \ttindex{f_globals}
759 \ttindex{f_locals}
760 \ttindex{f_lineno}
761 \ttindex{f_lasti}
762 \ttindex{f_builtins}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000763 \ttindex{f_restricted}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000764
Fred Drake82385871998-10-01 20:40:43 +0000765Special writable attributes: \member{f_trace}, if not \code{None}, is a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000766function called at the start of each source code line (this is used by
Fred Drake82385871998-10-01 20:40:43 +0000767the debugger); \member{f_exc_type}, \member{f_exc_value},
768\member{f_exc_traceback} represent the most recent exception caught in
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000769this frame.
Fred Drake4856d011999-01-12 04:15:20 +0000770\withsubitem{(frame attribute)}{
771 \ttindex{f_trace}
772 \ttindex{f_exc_type}
773 \ttindex{f_exc_value}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000774 \ttindex{f_exc_traceback}}
Fred Drakef6669171998-05-06 19:52:49 +0000775
776\item[Traceback objects] \label{traceback}
777Traceback objects represent a stack trace of an exception. A
778traceback object is created when an exception occurs. When the search
779for an exception handler unwinds the execution stack, at each unwound
780level a traceback object is inserted in front of the current
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000781traceback. When an exception handler is entered, the stack trace is
782made available to the program.
783(See section \ref{try}, ``The \code{try} statement.'')
784It is accessible as \code{sys.exc_traceback}, and also as the third
785item of the tuple returned by \code{sys.exc_info()}. The latter is
786the preferred interface, since it works correctly when the program is
787using multiple threads.
788When the program contains no suitable handler, the stack trace is written
Fred Drakef6669171998-05-06 19:52:49 +0000789(nicely formatted) to the standard error stream; if the interpreter is
790interactive, it is also made available to the user as
791\code{sys.last_traceback}.
792\obindex{traceback}
793\indexii{stack}{trace}
794\indexii{exception}{handler}
795\indexii{execution}{stack}
Fred Drake4856d011999-01-12 04:15:20 +0000796\withsubitem{(in module sys)}{
797 \ttindex{exc_info}
798 \ttindex{exc_traceback}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000799 \ttindex{last_traceback}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000800\ttindex{sys.exc_info}
Fred Drakef6669171998-05-06 19:52:49 +0000801\ttindex{sys.exc_traceback}
802\ttindex{sys.last_traceback}
803
804Special read-only attributes: \member{tb_next} is the next level in the
805stack trace (towards the frame where the exception occurred), or
806\code{None} if there is no next level; \member{tb_frame} points to the
807execution frame of the current level; \member{tb_lineno} gives the line
808number where the exception occurred; \member{tb_lasti} indicates the
809precise instruction. The line number and last instruction in the
810traceback may differ from the line number of its frame object if the
811exception occurred in a \keyword{try} statement with no matching
812except clause or with a finally clause.
Fred Drake4856d011999-01-12 04:15:20 +0000813\withsubitem{(traceback attribute)}{
814 \ttindex{tb_next}
815 \ttindex{tb_frame}
816 \ttindex{tb_lineno}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000817 \ttindex{tb_lasti}}
Fred Drakef6669171998-05-06 19:52:49 +0000818\stindex{try}
819
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000820\item[Slice objects]
821Slice objects are used to represent slices when \emph{extended slice
822syntax} is used. This is a slice using two colons, or multiple slices
823or ellipses separated by commas, e.g., \code{a[i:j:step]}, \code{a[i:j,
824k:l]}, or \code{a[..., i:j])}. They are also created by the built-in
Fred Drake1e42d8a1998-11-25 17:58:50 +0000825\function{slice()}\bifuncindex{slice} function.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000826
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000827Special read-only attributes: \member{start} is the lower bound;
828\member{stop} is the upper bound; \member{step} is the step value; each is
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000829\code{None} if omitted. These attributes can have any type.
Fred Drake4856d011999-01-12 04:15:20 +0000830\withsubitem{(slice object attribute)}{
831 \ttindex{start}
832 \ttindex{stop}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000833 \ttindex{step}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000834
Fred Drakef6669171998-05-06 19:52:49 +0000835\end{description} % Internal types
836
837\end{description} % Types
838
839
Fred Drake61c77281998-07-28 19:34:22 +0000840\section{Special method names\label{specialnames}}
Fred Drakef6669171998-05-06 19:52:49 +0000841
842A class can implement certain operations that are invoked by special
Fred Draked82575d1998-08-28 20:03:12 +0000843syntax (such as arithmetic operations or subscripting and slicing) by
844defining methods with special names. For instance, if a class defines
845a method named \method{__getitem__()}, and \code{x} is an instance of
846this class, then \code{x[i]} is equivalent to
847\code{x.__getitem__(i)}. (The reverse is not true --- if \code{x} is
848a list object, \code{x.__getitem__(i)} is not equivalent to
849\code{x[i]}.) Except where mentioned, attempts to execute an
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000850operation raise an exception when no appropriate method is defined.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000851\withsubitem{(mapping object method)}{\ttindex{__getitem__()}}
Fred Drakef6669171998-05-06 19:52:49 +0000852
Fred Drake0c475592000-12-07 04:49:34 +0000853When implementing a class that emulates any built-in type, it is
854important that the emulation only be implemented to the degree that it
855makes sense for the object being modelled. For example, some
856sequences may work well with retrieval of individual elements, but
857extracting a slice may not make sense. (One example of this is the
858\class{NodeList} interface in the W3C's Document Object Model.)
859
Fred Drakef6669171998-05-06 19:52:49 +0000860
Fred Drake61c77281998-07-28 19:34:22 +0000861\subsection{Basic customization\label{customization}}
Fred Drakef6669171998-05-06 19:52:49 +0000862
Fred Drake1e42d8a1998-11-25 17:58:50 +0000863\begin{methoddesc}[object]{__init__}{self\optional{, args...}}
Fred Drakef6669171998-05-06 19:52:49 +0000864Called when the instance is created. The arguments are those passed
865to the class constructor expression. If a base class has an
Fred Drake82385871998-10-01 20:40:43 +0000866\method{__init__()} method the derived class's \method{__init__()} method must
Fred Drakef6669171998-05-06 19:52:49 +0000867explicitly call it to ensure proper initialization of the base class
Fred Draked82575d1998-08-28 20:03:12 +0000868part of the instance, e.g., \samp{BaseClass.__init__(\var{self},
869[\var{args}...])}.
Fred Drakef6669171998-05-06 19:52:49 +0000870\indexii{class}{constructor}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000871\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000872
873
Fred Drake1e42d8a1998-11-25 17:58:50 +0000874\begin{methoddesc}[object]{__del__}{self}
Guido van Rossum7c0240f1998-07-24 15:36:43 +0000875Called when the instance is about to be destroyed. This is also
876called a destructor\index{destructor}. If a base class
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000877has a \method{__del__()} method, the derived class's \method{__del__()} method
Fred Drakef6669171998-05-06 19:52:49 +0000878must explicitly call it to ensure proper deletion of the base class
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000879part of the instance. Note that it is possible (though not recommended!)
880for the \method{__del__()}
Fred Drakef6669171998-05-06 19:52:49 +0000881method to postpone destruction of the instance by creating a new
882reference to it. It may then be called at a later time when this new
883reference is deleted. It is not guaranteed that
884\method{__del__()} methods are called for objects that still exist when
885the interpreter exits.
Fred Drakef6669171998-05-06 19:52:49 +0000886\stindex{del}
887
Fred Drake82385871998-10-01 20:40:43 +0000888\strong{Programmer's note:} \samp{del x} doesn't directly call
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000889\code{x.__del__()} --- the former decrements the reference count for
890\code{x} by one, and the latter is only called when its reference
891count reaches zero. Some common situations that may prevent the
892reference count of an object to go to zero include: circular
893references between objects (e.g., a doubly-linked list or a tree data
894structure with parent and child pointers); a reference to the object
895on the stack frame of a function that caught an exception (the
896traceback stored in \code{sys.exc_traceback} keeps the stack frame
897alive); or a reference to the object on the stack frame that raised an
898unhandled exception in interactive mode (the traceback stored in
899\code{sys.last_traceback} keeps the stack frame alive). The first
900situation can only be remedied by explicitly breaking the cycles; the
901latter two situations can be resolved by storing None in
902\code{sys.exc_traceback} or \code{sys.last_traceback}.
Fred Drakef6669171998-05-06 19:52:49 +0000903
904\strong{Warning:} due to the precarious circumstances under which
Fred Draked82575d1998-08-28 20:03:12 +0000905\method{__del__()} methods are invoked, exceptions that occur during their
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000906execution are ignored, and a warning is printed to \code{sys.stderr}
Fred Draked82575d1998-08-28 20:03:12 +0000907instead. Also, when \method{__del__()} is invoked is response to a module
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000908being deleted (e.g., when execution of the program is done), other
Fred Draked82575d1998-08-28 20:03:12 +0000909globals referenced by the \method{__del__()} method may already have been
910deleted. For this reason, \method{__del__()} methods should do the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000911absolute minimum needed to maintain external invariants. Python 1.5
912guarantees that globals whose name begins with a single underscore are
913deleted from their module before other globals are deleted; if no
914other references to such globals exist, this may help in assuring that
915imported modules are still available at the time when the
Fred Draked82575d1998-08-28 20:03:12 +0000916\method{__del__()} method is called.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000917\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000918
Fred Drake1e42d8a1998-11-25 17:58:50 +0000919\begin{methoddesc}[object]{__repr__}{self}
Fred Drake82385871998-10-01 20:40:43 +0000920Called by the \function{repr()}\bifuncindex{repr} built-in function
921and by string conversions (reverse quotes) to compute the ``official''
Andrew M. Kuchling68abe832000-12-19 14:09:21 +0000922string representation of an object. If at all possible, this should
Guido van Rossum035f7e82000-12-19 04:18:13 +0000923look like a valid Python expression that could be used to recreate an
924object with the same value (given an appropriate environment). If
925this is not possible, a string of the form \samp{<\var{...some useful
926description...}>} should be returned. The return value must be a
927string object.
928
929This is typically used for debugging, so it is important that the
930representation is information-rich and unambiguous.
Fred Drakef6669171998-05-06 19:52:49 +0000931\indexii{string}{conversion}
932\indexii{reverse}{quotes}
933\indexii{backward}{quotes}
934\index{back-quotes}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000935\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000936
Fred Drake1e42d8a1998-11-25 17:58:50 +0000937\begin{methoddesc}[object]{__str__}{self}
Fred Draked82575d1998-08-28 20:03:12 +0000938Called by the \function{str()}\bifuncindex{str} built-in function and
939by the \keyword{print}\stindex{print} statement to compute the
Fred Drake82385871998-10-01 20:40:43 +0000940``informal'' string representation of an object. This differs from
941\method{__repr__()} in that it does not have to be a valid Python
942expression: a more convenient or concise representation may be used
Guido van Rossum035f7e82000-12-19 04:18:13 +0000943instead. The return value must be a string object.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000944\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000945
Fred Drake1e42d8a1998-11-25 17:58:50 +0000946\begin{methoddesc}[object]{__cmp__}{self, other}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000947Called by all comparison operations. Should return a negative integer if
948\code{self < other}, zero if \code{self == other}, a positive integer if
Fred Drakef6669171998-05-06 19:52:49 +0000949\code{self > other}. If no \method{__cmp__()} operation is defined, class
950instances are compared by object identity (``address'').
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000951(Note: the restriction that exceptions are not propagated by
Fred Drake82385871998-10-01 20:40:43 +0000952\method{__cmp__()} has been removed in Python 1.5.)
Fred Drakef6669171998-05-06 19:52:49 +0000953\bifuncindex{cmp}
954\index{comparisons}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000955\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000956
Fred Drakee57a1142000-06-15 20:07:25 +0000957\begin{methoddesc}[object]{__rcmp__}{self, other}
Fred Drake445f8322001-01-04 15:11:48 +0000958 \versionchanged[No longer supported]{2.1}
Fred Drakee57a1142000-06-15 20:07:25 +0000959\end{methoddesc}
960
Fred Drake1e42d8a1998-11-25 17:58:50 +0000961\begin{methoddesc}[object]{__hash__}{self}
Fred Draked82575d1998-08-28 20:03:12 +0000962Called for the key object for dictionary\obindex{dictionary}
963operations, and by the built-in function
Fred Drakef6669171998-05-06 19:52:49 +0000964\function{hash()}\bifuncindex{hash}. Should return a 32-bit integer
965usable as a hash value
966for dictionary operations. The only required property is that objects
967which compare equal have the same hash value; it is advised to somehow
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000968mix together (e.g., using exclusive or) the hash values for the
Fred Drakef6669171998-05-06 19:52:49 +0000969components of the object that also play a part in comparison of
970objects. If a class does not define a \method{__cmp__()} method it should
971not define a \method{__hash__()} operation either; if it defines
972\method{__cmp__()} but not \method{__hash__()} its instances will not be
973usable as dictionary keys. If a class defines mutable objects and
974implements a \method{__cmp__()} method it should not implement
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000975\method{__hash__()}, since the dictionary implementation requires that
976a key's hash value is immutable (if the object's hash value changes, it
977will be in the wrong hash bucket).
Fred Drake1e42d8a1998-11-25 17:58:50 +0000978\withsubitem{(object method)}{\ttindex{__cmp__()}}
979\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000980
Fred Drake1e42d8a1998-11-25 17:58:50 +0000981\begin{methoddesc}[object]{__nonzero__}{self}
Fred Draked82575d1998-08-28 20:03:12 +0000982Called to implement truth value testing; should return \code{0} or
983\code{1}. When this method is not defined, \method{__len__()} is
984called, if it is defined (see below). If a class defines neither
985\method{__len__()} nor \method{__nonzero__()}, all its instances are
986considered true.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000987\withsubitem{(mapping object method)}{\ttindex{__len__()}}
988\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000989
990
Fred Drake61c77281998-07-28 19:34:22 +0000991\subsection{Customizing attribute access\label{attribute-access}}
Fred Drakef6669171998-05-06 19:52:49 +0000992
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000993The following methods can be defined to customize the meaning of
994attribute access (use of, assignment to, or deletion of \code{x.name})
995for class instances.
996For performance reasons, these methods are cached in the class object
997at class definition time; therefore, they cannot be changed after the
998class definition is executed.
Fred Drakef6669171998-05-06 19:52:49 +0000999
Fred Drake1e42d8a1998-11-25 17:58:50 +00001000\begin{methoddesc}[object]{__getattr__}{self, name}
Fred Drakef6669171998-05-06 19:52:49 +00001001Called when an attribute lookup has not found the attribute in the
1002usual places (i.e. it is not an instance attribute nor is it found in
1003the class tree for \code{self}). \code{name} is the attribute name.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001004This method should return the (computed) attribute value or raise an
Fred Draked82575d1998-08-28 20:03:12 +00001005\exception{AttributeError} exception.
Fred Drakef6669171998-05-06 19:52:49 +00001006
1007Note that if the attribute is found through the normal mechanism,
Fred Draked82575d1998-08-28 20:03:12 +00001008\method{__getattr__()} is not called. (This is an intentional
1009asymmetry between \method{__getattr__()} and \method{__setattr__()}.)
Fred Drakef6669171998-05-06 19:52:49 +00001010This is done both for efficiency reasons and because otherwise
Fred Draked82575d1998-08-28 20:03:12 +00001011\method{__setattr__()} would have no way to access other attributes of
1012the instance.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001013Note that at least for instance variables, you can fake
1014total control by not inserting any values in the instance
1015attribute dictionary (but instead inserting them in another object).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001016\withsubitem{(object method)}{\ttindex{__setattr__()}}
1017\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001018
Fred Drake1e42d8a1998-11-25 17:58:50 +00001019\begin{methoddesc}[object]{__setattr__}{self, name, value}
Fred Drakef6669171998-05-06 19:52:49 +00001020Called when an attribute assignment is attempted. This is called
Fred Draked82575d1998-08-28 20:03:12 +00001021instead of the normal mechanism (i.e.\ store the value in the instance
1022dictionary). \var{name} is the attribute name, \var{value} is the
Fred Drakef6669171998-05-06 19:52:49 +00001023value to be assigned to it.
Fred Drakef6669171998-05-06 19:52:49 +00001024
Fred Draked82575d1998-08-28 20:03:12 +00001025If \method{__setattr__()} wants to assign to an instance attribute, it
1026should not simply execute \samp{self.\var{name} = value} --- this
1027would cause a recursive call to itself. Instead, it should insert the
1028value in the dictionary of instance attributes, e.g.,
1029\samp{self.__dict__[\var{name}] = value}.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001030\withsubitem{(instance attribute)}{\ttindex{__dict__}}
1031\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001032
Fred Drake1e42d8a1998-11-25 17:58:50 +00001033\begin{methoddesc}[object]{__delattr__}{self, name}
Fred Draked82575d1998-08-28 20:03:12 +00001034Like \method{__setattr__()} but for attribute deletion instead of
Fred Drake1e42d8a1998-11-25 17:58:50 +00001035assignment. This should only be implemented if \samp{del
1036obj.\var{name}} is meaningful for the object.
1037\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001038
1039
Fred Drake61c77281998-07-28 19:34:22 +00001040\subsection{Emulating callable objects\label{callable-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001041
Fred Drake1e42d8a1998-11-25 17:58:50 +00001042\begin{methoddesc}[object]{__call__}{self\optional{, args...}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001043Called when the instance is ``called'' as a function; if this method
Fred Draked82575d1998-08-28 20:03:12 +00001044is defined, \code{\var{x}(arg1, arg2, ...)} is a shorthand for
1045\code{\var{x}.__call__(arg1, arg2, ...)}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001046\indexii{call}{instance}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001047\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001048
1049
Fred Drake61c77281998-07-28 19:34:22 +00001050\subsection{Emulating sequence and mapping types\label{sequence-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001051
1052The following methods can be defined to emulate sequence or mapping
1053objects. The first set of methods is used either to emulate a
1054sequence or to emulate a mapping; the difference is that for a
1055sequence, the allowable keys should be the integers \var{k} for which
1056\code{0 <= \var{k} < \var{N}} where \var{N} is the length of the
Thomas Wouters1d75a792000-08-17 22:37:32 +00001057sequence, or slice objects, which define a range of items. (For backwards
1058compatibility, the method \method{__getslice__()} (see below) can also be
1059defined to handle simple, but not extended slices.) It is also recommended
Fred Drakea0073822000-08-18 02:42:14 +00001060that mappings provide the methods \method{keys()}, \method{values()},
Thomas Wouters1d75a792000-08-17 22:37:32 +00001061\method{items()}, \method{has_key()}, \method{get()}, \method{clear()},
1062\method{copy()}, and \method{update()} behaving similar to those for
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001063Python's standard dictionary objects; mutable sequences should provide
1064methods \method{append()}, \method{count()}, \method{index()},
1065\method{insert()}, \method{pop()}, \method{remove()}, \method{reverse()}
1066and \method{sort()}, like Python standard list objects. Finally,
1067sequence types should implement addition (meaning concatenation) and
1068multiplication (meaning repetition) by defining the methods
Thomas Wouters12bba852000-08-24 20:06:04 +00001069\method{__add__()}, \method{__radd__()}, \method{__iadd__()},
1070\method{__mul__()}, \method{__rmul__()} and \method{__imul__()} described
1071below; they should not define \method{__coerce__()} or other numerical
1072operators.
Fred Drake4856d011999-01-12 04:15:20 +00001073\withsubitem{(mapping object method)}{
1074 \ttindex{keys()}
1075 \ttindex{values()}
1076 \ttindex{items()}
1077 \ttindex{has_key()}
1078 \ttindex{get()}
1079 \ttindex{clear()}
1080 \ttindex{copy()}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001081 \ttindex{update()}}
Fred Drake4856d011999-01-12 04:15:20 +00001082\withsubitem{(sequence object method)}{
1083 \ttindex{append()}
1084 \ttindex{count()}
1085 \ttindex{index()}
1086 \ttindex{insert()}
1087 \ttindex{pop()}
1088 \ttindex{remove()}
1089 \ttindex{reverse()}
1090 \ttindex{sort()}
1091 \ttindex{__add__()}
1092 \ttindex{__radd__()}
Thomas Wouters12bba852000-08-24 20:06:04 +00001093 \ttindex{__iadd__()}
Fred Drake4856d011999-01-12 04:15:20 +00001094 \ttindex{__mul__()}
Thomas Wouters12bba852000-08-24 20:06:04 +00001095 \ttindex{__rmul__()}
1096 \ttindex{__imul__()}}
Fred Drakeae3e5741999-01-28 23:21:49 +00001097\withsubitem{(numeric object method)}{\ttindex{__coerce__()}}
Fred Drakef6669171998-05-06 19:52:49 +00001098
Fred Drake1e42d8a1998-11-25 17:58:50 +00001099\begin{methoddesc}[mapping object]{__len__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001100Called to implement the built-in function
1101\function{len()}\bifuncindex{len}. Should return the length of the
1102object, an integer \code{>=} 0. Also, an object that doesn't define a
1103\method{__nonzero__()} method and whose \method{__len__()} method
1104returns zero is considered to be false in a Boolean context.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001105\withsubitem{(object method)}{\ttindex{__nonzero__()}}
1106\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001107
Fred Drake1e42d8a1998-11-25 17:58:50 +00001108\begin{methoddesc}[mapping object]{__getitem__}{self, key}
Fred Draked82575d1998-08-28 20:03:12 +00001109Called to implement evaluation of \code{\var{self}[\var{key}]}.
Fred Drake31575ce2000-09-21 05:28:26 +00001110For sequence types, the accepted keys should be integers and slice
1111objects.\obindex{slice} Note that
1112the special interpretation of negative indexes (if the class wishes to
Fred Drakef6669171998-05-06 19:52:49 +00001113emulate a sequence type) is up to the \method{__getitem__()} method.
Fred Drake91826ed2000-07-13 04:57:58 +00001114If \var{key} is of an inappropriate type, \exception{TypeError} may be
1115raised; if of a value outside the set of indexes for the sequence
1116(after any special interpretation of negative values),
1117\exception{IndexError} should be raised.
1118\strong{Note:} \keyword{for} loops expect that an
1119\exception{IndexError} will be raised for illegal indexes to allow
1120proper detection of the end of the sequence.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001121\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001122
Fred Drake1e42d8a1998-11-25 17:58:50 +00001123\begin{methoddesc}[mapping object]{__setitem__}{self, key, value}
Fred Draked82575d1998-08-28 20:03:12 +00001124Called to implement assignment to \code{\var{self}[\var{key}]}. Same
Fred Drake1e42d8a1998-11-25 17:58:50 +00001125note as for \method{__getitem__()}. This should only be implemented
1126for mappings if the objects support changes to the values for keys, or
1127if new keys can be added, or for sequences if elements can be
Fred Drake91826ed2000-07-13 04:57:58 +00001128replaced. The same exceptions should be raised for improper
1129\var{key} values as for the \method{__getitem__()} method.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001130\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001131
Fred Drake1e42d8a1998-11-25 17:58:50 +00001132\begin{methoddesc}[mapping object]{__delitem__}{self, key}
Fred Draked82575d1998-08-28 20:03:12 +00001133Called to implement deletion of \code{\var{self}[\var{key}]}. Same
Fred Drake1e42d8a1998-11-25 17:58:50 +00001134note as for \method{__getitem__()}. This should only be implemented
1135for mappings if the objects support removal of keys, or for sequences
Fred Drake91826ed2000-07-13 04:57:58 +00001136if elements can be removed from the sequence. The same exceptions
1137should be raised for improper \var{key} values as for the
1138\method{__getitem__()} method.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001139\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001140
1141
Fred Drake3041b071998-10-21 00:25:32 +00001142\subsection{Additional methods for emulation of sequence types
Fred Drake61c77281998-07-28 19:34:22 +00001143 \label{sequence-methods}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001144
1145The following methods can be defined to further emulate sequence
1146objects. Immutable sequences methods should only define
1147\method{__getslice__()}; mutable sequences, should define all three
1148three methods.
Fred Drakef6669171998-05-06 19:52:49 +00001149
Fred Drake1e42d8a1998-11-25 17:58:50 +00001150\begin{methoddesc}[sequence object]{__getslice__}{self, i, j}
Fred Drakea0073822000-08-18 02:42:14 +00001151\deprecated{2.0}{Support slice objects as parameters to the
1152\method{__getitem__()} method.}
Fred Draked82575d1998-08-28 20:03:12 +00001153Called to implement evaluation of \code{\var{self}[\var{i}:\var{j}]}.
1154The returned object should be of the same type as \var{self}. Note
1155that missing \var{i} or \var{j} in the slice expression are replaced
Fred Drakee15956b2000-04-03 04:51:13 +00001156by zero or \code{sys.maxint}, respectively. If negative indexes are
1157used in the slice, the length of the sequence is added to that index.
1158If the instance does not implement the \method{__len__()} method, an
1159\exception{AttributeError} is raised.
1160No guarantee is made that indexes adjusted this way are not still
1161negative. Indexes which are greater than the length of the sequence
1162are not modified.
Fred Drakea0073822000-08-18 02:42:14 +00001163If no \method{__getslice__()} is found, a slice
Thomas Wouters1d75a792000-08-17 22:37:32 +00001164object is created instead, and passed to \method{__getitem__()} instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001165\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001166
Fred Drake1e42d8a1998-11-25 17:58:50 +00001167\begin{methoddesc}[sequence object]{__setslice__}{self, i, j, sequence}
Fred Draked82575d1998-08-28 20:03:12 +00001168Called to implement assignment to \code{\var{self}[\var{i}:\var{j}]}.
1169Same notes for \var{i} and \var{j} as for \method{__getslice__()}.
Thomas Wouters1d75a792000-08-17 22:37:32 +00001170
1171This method is deprecated. If no \method{__setslice__()} is found, a slice
1172object is created instead, and passed to \method{__setitem__()} instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001173\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001174
Fred Drake1e42d8a1998-11-25 17:58:50 +00001175\begin{methoddesc}[sequence object]{__delslice__}{self, i, j}
Fred Draked82575d1998-08-28 20:03:12 +00001176Called to implement deletion of \code{\var{self}[\var{i}:\var{j}]}.
1177Same notes for \var{i} and \var{j} as for \method{__getslice__()}.
Thomas Wouters1d75a792000-08-17 22:37:32 +00001178This method is deprecated. If no \method{__delslice__()} is found, a slice
1179object is created instead, and passed to \method{__delitem__()} instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001180\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001181
Thomas Wouters1d75a792000-08-17 22:37:32 +00001182Notice that these methods are only invoked when a single slice with a single
1183colon is used, and the slice method is available. For slice operations
1184involving extended slice notation, or in absence of the slice methods,
1185\method{__getitem__()}, \method{__setitem__()} or \method{__delitem__()} is
1186called with a slice object as argument.
Fred Drakef6669171998-05-06 19:52:49 +00001187
Fred Drakef89259782000-09-21 22:27:16 +00001188The following example demonstrate how to make your program or module
1189compatible with earlier versions of Python (assuming that methods
1190\method{__getitem__()}, \method{__setitem__()} and \method{__delitem__()}
1191support slice objects as arguments):
1192
1193\begin{verbatim}
1194class MyClass:
1195 ...
1196 def __getitem__(self, index):
1197 ...
1198 def __setitem__(self, index, value):
1199 ...
1200 def __delitem__(self, index):
1201 ...
1202
1203 if sys.version_info < (2, 0):
1204 # They won't be defined if version is at least 2.0 final
1205
1206 def __getslice__(self, i, j):
1207 return self[max(0, i):max(0, j):]
1208 def __setslice__(self, i, j, seq):
1209 self[max(0, i):max(0, j):] = seq
1210 def __delslice__(self, i, j):
1211 del self[max(0, i):max(0, j):]
1212 ...
1213\end{verbatim}
1214
1215Note the calls to \function{max()}; these are actually necessary due
1216to the handling of negative indices before the
1217\method{__*slice__()} methods are called. When negative indexes are
1218used, the \method{__*item__()} methods receive them as provided, but
1219the \method{__*slice__()} methods get a ``cooked'' form of the index
1220values. For each negative index value, the length of the sequence is
1221added to the index before calling the method (which may still result
1222in a negative index); this is the customary handling of negative
1223indexes by the built-in sequence types, and the \method{__*item__()}
1224methods are expected to do this as well. However, since they should
1225already be doing that, negative indexes cannot be passed in; they must
1226be be constrained to the bounds of the sequence before being passed to
1227the \method{__*item__()} methods.
1228Calling \code{max(0, i)} conveniently returns the proper value.
1229
Fred Drake8d27f892000-09-19 18:21:25 +00001230The membership test operators (\keyword{in} and \keyword{not in}) are
1231normally implemented as iteration loop through the sequence. However,
1232sequence objects can supply the following special method with a more
1233efficient implementation:
1234
1235\begin{methoddesc}[sequence object]{__contains__}{self, item}
1236Called to implement membership test operators. Should return true if
1237\var{item} is in \var{self}, false otherwise.
1238\end{methoddesc}
1239
Fred Drake15988fd1999-02-12 18:14:57 +00001240
Fred Drake61c77281998-07-28 19:34:22 +00001241\subsection{Emulating numeric types\label{numeric-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001242
1243The following methods can be defined to emulate numeric objects.
1244Methods corresponding to operations that are not supported by the
1245particular kind of number implemented (e.g., bitwise operations for
1246non-integral numbers) should be left undefined.
Fred Drakef6669171998-05-06 19:52:49 +00001247
Fred Drakeb8943701999-05-10 13:43:22 +00001248\begin{methoddesc}[numeric object]{__add__}{self, other}
1249\methodline[numeric object]{__sub__}{self, other}
1250\methodline[numeric object]{__mul__}{self, other}
1251\methodline[numeric object]{__div__}{self, other}
1252\methodline[numeric object]{__mod__}{self, other}
1253\methodline[numeric object]{__divmod__}{self, other}
1254\methodline[numeric object]{__pow__}{self, other\optional{, modulo}}
1255\methodline[numeric object]{__lshift__}{self, other}
1256\methodline[numeric object]{__rshift__}{self, other}
1257\methodline[numeric object]{__and__}{self, other}
1258\methodline[numeric object]{__xor__}{self, other}
1259\methodline[numeric object]{__or__}{self, other}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001260These functions are
1261called to implement the binary arithmetic operations (\code{+},
Fred Draked82575d1998-08-28 20:03:12 +00001262\code{-}, \code{*}, \code{/}, \code{\%},
1263\function{divmod()}\bifuncindex{divmod},
1264\function{pow()}\bifuncindex{pow}, \code{**}, \code{<<}, \code{>>},
1265\code{\&}, \code{\^}, \code{|}). For instance, to evaluate the
1266expression \var{x}\code{+}\var{y}, where \var{x} is an instance of a
1267class that has an \method{__add__()} method,
1268\code{\var{x}.__add__(\var{y})} is called. Note that
1269\method{__pow__()} should be defined to accept an optional third
1270argument if the ternary version of the built-in
1271\function{pow()}\bifuncindex{pow} function is to be supported.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001272\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001273
Fred Drakeb8943701999-05-10 13:43:22 +00001274\begin{methoddesc}[numeric object]{__radd__}{self, other}
1275\methodline[numeric object]{__rsub__}{self, other}
1276\methodline[numeric object]{__rmul__}{self, other}
1277\methodline[numeric object]{__rdiv__}{self, other}
1278\methodline[numeric object]{__rmod__}{self, other}
1279\methodline[numeric object]{__rdivmod__}{self, other}
1280\methodline[numeric object]{__rpow__}{self, other}
1281\methodline[numeric object]{__rlshift__}{self, other}
1282\methodline[numeric object]{__rrshift__}{self, other}
1283\methodline[numeric object]{__rand__}{self, other}
1284\methodline[numeric object]{__rxor__}{self, other}
1285\methodline[numeric object]{__ror__}{self, other}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001286These functions are
1287called to implement the binary arithmetic operations (\code{+},
Fred Draked82575d1998-08-28 20:03:12 +00001288\code{-}, \code{*}, \code{/}, \code{\%},
1289\function{divmod()}\bifuncindex{divmod},
1290\function{pow()}\bifuncindex{pow}, \code{**}, \code{<<}, \code{>>},
1291\code{\&}, \code{\^}, \code{|}) with reversed operands. These
1292functions are only called if the left operand does not support the
1293corresponding operation. For instance, to evaluate the expression
1294\var{x}\code{-}\var{y}, where \var{y} is an instance of a class that
1295has an \method{__rsub__()} method, \code{\var{y}.__rsub__(\var{x})} is
1296called. Note that ternary \function{pow()}\bifuncindex{pow} will not
1297try calling \method{__rpow__()} (the coercion rules would become too
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001298complicated).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001299\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001300
Thomas Woutersdc90cc22000-12-11 23:11:51 +00001301\begin{methoddesc}[numeric object]{__iadd__}{self, other}
1302\methodline[numeric object]{__isub__}{self, other}
1303\methodline[numeric object]{__imul__}{self, other}
1304\methodline[numeric object]{__idiv__}{self, other}
1305\methodline[numeric object]{__imod__}{self, other}
1306\methodline[numeric object]{__ipow__}{self, other\optional{, modulo}}
1307\methodline[numeric object]{__ilshift__}{self, other}
1308\methodline[numeric object]{__irshift__}{self, other}
1309\methodline[numeric object]{__iand__}{self, other}
1310\methodline[numeric object]{__ixor__}{self, other}
1311\methodline[numeric object]{__ior__}{self, other}
1312These methods are called to implement the augmented arithmetic operations
1313(\code{+=}, \code{-=}, \code{*=}, \code{/=}, \code{\%=}, \code{**=},
1314\code{<<=}, \code{>>=}, \code{\&=}, \code{\^=}, \code{|=}). These methods
1315should attempt to do the operation in-place (modifying \var{self}) and
1316return the result (which could be, but does not have to be, \var{self}). If
1317a specific method is not defined, the augmented operation falls back to the
1318normal methods. For instance, to evaluate the expression
1319\var{x}\code{+=}\var{y}, where \var{x} is an instance of a class that has an
1320\method{__iadd__()} method, \code{\var{x}.__iadd__(\var{y})} is called. If
1321\var{x} is an instance of a class that does not define a \method{__iadd()}
1322method, \code{\var{x}.__add__(\var{y})} and \code{\var{y}.__radd__(\var{x})}
1323are considered, as with the evaluation of \var{x}\code{+}\var{y}.
1324
1325\end{methoddesc}
1326
Fred Drakeb8943701999-05-10 13:43:22 +00001327\begin{methoddesc}[numeric object]{__neg__}{self}
1328\methodline[numeric object]{__pos__}{self}
1329\methodline[numeric object]{__abs__}{self}
1330\methodline[numeric object]{__invert__}{self}
Fred Drakef6669171998-05-06 19:52:49 +00001331Called to implement the unary arithmetic operations (\code{-}, \code{+},
Fred Drakee57a1142000-06-15 20:07:25 +00001332\function{abs()}\bifuncindex{abs} and \code{\~{}}).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001333\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001334
Fred Drakeb8943701999-05-10 13:43:22 +00001335\begin{methoddesc}[numeric object]{__complex__}{self}
1336\methodline[numeric object]{__int__}{self}
1337\methodline[numeric object]{__long__}{self}
1338\methodline[numeric object]{__float__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001339Called to implement the built-in functions
Fred Drake15988fd1999-02-12 18:14:57 +00001340\function{complex()}\bifuncindex{complex},
1341\function{int()}\bifuncindex{int}, \function{long()}\bifuncindex{long},
Fred Draked82575d1998-08-28 20:03:12 +00001342and \function{float()}\bifuncindex{float}. Should return a value of
1343the appropriate type.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001344\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001345
Fred Drakeb8943701999-05-10 13:43:22 +00001346\begin{methoddesc}[numeric object]{__oct__}{self}
1347\methodline[numeric object]{__hex__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001348Called to implement the built-in functions
1349\function{oct()}\bifuncindex{oct} and
1350\function{hex()}\bifuncindex{hex}. Should return a string value.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001351\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001352
Fred Drakeb8943701999-05-10 13:43:22 +00001353\begin{methoddesc}[numeric object]{__coerce__}{self, other}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001354Called to implement ``mixed-mode'' numeric arithmetic. Should either
Fred Draked82575d1998-08-28 20:03:12 +00001355return a 2-tuple containing \var{self} and \var{other} converted to
Fred Drakeb8943701999-05-10 13:43:22 +00001356a common numeric type, or \code{None} if conversion is impossible. When
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001357the common type would be the type of \code{other}, it is sufficient to
1358return \code{None}, since the interpreter will also ask the other
1359object to attempt a coercion (but sometimes, if the implementation of
1360the other type cannot be changed, it is useful to do the conversion to
1361the other type here).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001362\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001363
1364\strong{Coercion rules}: to evaluate \var{x} \var{op} \var{y}, the
1365following steps are taken (where \method{__op__()} and
1366\method{__rop__()} are the method names corresponding to \var{op},
Guido van Rossum7c0240f1998-07-24 15:36:43 +00001367e.g., if var{op} is `\code{+}', \method{__add__()} and
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001368\method{__radd__()} are used). If an exception occurs at any point,
1369the evaluation is abandoned and exception handling takes over.
1370
1371\begin{itemize}
1372
1373\item[0.] If \var{x} is a string object and op is the modulo operator (\%),
1374the string formatting operation is invoked and the remaining steps are
1375skipped.
1376
1377\item[1.] If \var{x} is a class instance:
1378
1379 \begin{itemize}
1380
1381 \item[1a.] If \var{x} has a \method{__coerce__()} method:
1382 replace \var{x} and \var{y} with the 2-tuple returned by
1383 \code{\var{x}.__coerce__(\var{y})}; skip to step 2 if the
1384 coercion returns \code{None}.
1385
1386 \item[1b.] If neither \var{x} nor \var{y} is a class instance
1387 after coercion, go to step 3.
1388
1389 \item[1c.] If \var{x} has a method \method{__op__()}, return
1390 \code{\var{x}.__op__(\var{y})}; otherwise, restore \var{x} and
1391 \var{y} to their value before step 1a.
1392
1393 \end{itemize}
1394
1395\item[2.] If \var{y} is a class instance:
1396
1397 \begin{itemize}
1398
1399 \item[2a.] If \var{y} has a \method{__coerce__()} method:
1400 replace \var{y} and \var{x} with the 2-tuple returned by
1401 \code{\var{y}.__coerce__(\var{x})}; skip to step 3 if the
1402 coercion returns \code{None}.
1403
1404 \item[2b.] If neither \var{x} nor \var{y} is a class instance
1405 after coercion, go to step 3.
1406
1407 \item[2b.] If \var{y} has a method \method{__rop__()}, return
1408 \code{\var{y}.__rop__(\var{x})}; otherwise, restore \var{x}
1409 and \var{y} to their value before step 2a.
1410
1411 \end{itemize}
1412
1413\item[3.] We only get here if neither \var{x} nor \var{y} is a class
1414instance.
1415
1416 \begin{itemize}
1417
1418 \item[3a.] If op is `\code{+}' and \var{x} is a sequence,
1419 sequence concatenation is invoked.
1420
1421 \item[3b.] If op is `\code{*}' and one operand is a sequence
1422 and the other an integer, sequence repetition is invoked.
1423
1424 \item[3c.] Otherwise, both operands must be numbers; they are
1425 coerced to a common type if possible, and the numeric
1426 operation is invoked for that type.
1427
1428 \end{itemize}
1429
1430\end{itemize}