blob: 31d8fbb92d2e4404df3ba5cf0f0be556bbbff387 [file] [log] [blame]
Fred Drake61c77281998-07-28 19:34:22 +00001\chapter{Data model\label{datamodel}}
Fred Drakef6669171998-05-06 19:52:49 +00002
Fred Drake61c77281998-07-28 19:34:22 +00003\section{Objects, values and types\label{objects}}
Fred Drakef6669171998-05-06 19:52:49 +00004
5\dfn{Objects} are Python's abstraction for data. All data in a Python
6program is represented by objects or by relations between objects.
7(In a sense, and in conformance to Von Neumann's model of a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00008``stored program computer,'' code is also represented by objects.)
Fred Drakef6669171998-05-06 19:52:49 +00009\index{object}
10\index{data}
11
12Every object has an identity, a type and a value. An object's
13\emph{identity} never changes once it has been created; you may think
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000014of it as the object's address in memory. The `\code{is}' operator
Fred Drake82385871998-10-01 20:40:43 +000015compares the identity of two objects; the
16\function{id()}\bifuncindex{id} function returns an integer
17representing its identity (currently implemented as its address).
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000018An object's \dfn{type} is
Fred Drakef6669171998-05-06 19:52:49 +000019also unchangeable. It determines the operations that an object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000020supports (e.g., ``does it have a length?'') and also defines the
Fred Drake82385871998-10-01 20:40:43 +000021possible values for objects of that type. The
22\function{type()}\bifuncindex{type} function returns an object's type
23(which is an object itself). The \emph{value} of some
Fred Drakef6669171998-05-06 19:52:49 +000024objects can change. Objects whose value can change are said to be
25\emph{mutable}; objects whose value is unchangeable once they are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000026created are called \emph{immutable}.
Guido van Rossum264bd591999-02-23 16:40:55 +000027(The value of an immutable container object that contains a reference
28to a mutable object can change when the latter's value is changed;
29however the container is still considered immutable, because the
30collection of objects it contains cannot be changed. So, immutability
31is not strictly the same as having an unchangeable value, it is more
32subtle.)
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000033An object's mutability is determined by its type; for instance,
34numbers, strings and tuples are immutable, while dictionaries and
35lists are mutable.
Fred Drakef6669171998-05-06 19:52:49 +000036\index{identity of an object}
37\index{value of an object}
38\index{type of an object}
39\index{mutable object}
40\index{immutable object}
41
42Objects are never explicitly destroyed; however, when they become
43unreachable they may be garbage-collected. An implementation is
Barry Warsaw92a6ed91998-08-07 16:33:51 +000044allowed to postpone garbage collection or omit it altogether --- it is
45a matter of implementation quality how garbage collection is
Fred Drakef6669171998-05-06 19:52:49 +000046implemented, as long as no objects are collected that are still
47reachable. (Implementation note: the current implementation uses a
Fred Drakec8e82812001-01-22 17:46:18 +000048reference-counting scheme with (optional) delayed detection of
49cyclicly linked garbage, which collects most objects as soon as they
50become unreachable, but is not guaranteed to collect garbage
51containing circular references. See the
52\citetitle[../lib/module-gc.html]{Python Library Reference} for
53information on controlling the collection of cyclic garbage.)
Fred Drakef6669171998-05-06 19:52:49 +000054\index{garbage collection}
55\index{reference counting}
56\index{unreachable object}
57
58Note that the use of the implementation's tracing or debugging
59facilities may keep objects alive that would normally be collectable.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000060Also note that catching an exception with a
Fred Drake4856d011999-01-12 04:15:20 +000061`\keyword{try}...\keyword{except}' statement may keep objects alive.
Fred Drakef6669171998-05-06 19:52:49 +000062
63Some objects contain references to ``external'' resources such as open
64files or windows. It is understood that these resources are freed
65when the object is garbage-collected, but since garbage collection is
66not guaranteed to happen, such objects also provide an explicit way to
67release the external resource, usually a \method{close()} method.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000068Programs are strongly recommended to explicitly close such
Fred Drake4856d011999-01-12 04:15:20 +000069objects. The `\keyword{try}...\keyword{finally}' statement provides
70a convenient way to do this.
Fred Drakef6669171998-05-06 19:52:49 +000071
72Some objects contain references to other objects; these are called
73\emph{containers}. Examples of containers are tuples, lists and
74dictionaries. The references are part of a container's value. In
75most cases, when we talk about the value of a container, we imply the
76values, not the identities of the contained objects; however, when we
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000077talk about the mutability of a container, only the identities of
78the immediately contained objects are implied. So, if an immutable
79container (like a tuple)
80contains a reference to a mutable object, its value changes
81if that mutable object is changed.
Fred Drakef6669171998-05-06 19:52:49 +000082\index{container}
83
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000084Types affect almost all aspects of object behavior. Even the importance
Fred Drakef6669171998-05-06 19:52:49 +000085of object identity is affected in some sense: for immutable types,
86operations that compute new values may actually return a reference to
87any existing object with the same type and value, while for mutable
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000088objects this is not allowed. E.g., after
Fred Drake82385871998-10-01 20:40:43 +000089\samp{a = 1; b = 1},
Fred Drakef6669171998-05-06 19:52:49 +000090\code{a} and \code{b} may or may not refer to the same object with the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000091value one, depending on the implementation, but after
Fred Drake82385871998-10-01 20:40:43 +000092\samp{c = []; d = []}, \code{c} and \code{d}
Fred Drakef6669171998-05-06 19:52:49 +000093are guaranteed to refer to two different, unique, newly created empty
94lists.
Fred Drake82385871998-10-01 20:40:43 +000095(Note that \samp{c = d = []} assigns the same object to both
Guido van Rossum83b2f8a1998-07-23 17:12:46 +000096\code{c} and \code{d}.)
Fred Drakef6669171998-05-06 19:52:49 +000097
Fred Drake61c77281998-07-28 19:34:22 +000098\section{The standard type hierarchy\label{types}}
Fred Drakef6669171998-05-06 19:52:49 +000099
100Below is a list of the types that are built into Python. Extension
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000101modules written in \C{} can define additional types. Future versions of
102Python may add types to the type hierarchy (e.g., rational
Fred Drakef6669171998-05-06 19:52:49 +0000103numbers, efficiently stored arrays of integers, etc.).
104\index{type}
105\indexii{data}{type}
106\indexii{type}{hierarchy}
107\indexii{extension}{module}
108\indexii{C}{language}
109
110Some of the type descriptions below contain a paragraph listing
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000111`special attributes.' These are attributes that provide access to the
Fred Drakef6669171998-05-06 19:52:49 +0000112implementation and are not intended for general use. Their definition
113may change in the future. There are also some `generic' special
114attributes, not listed with the individual objects: \member{__methods__}
115is a list of the method names of a built-in object, if it has any;
116\member{__members__} is a list of the data attribute names of a built-in
117object, if it has any.
118\index{attribute}
119\indexii{special}{attribute}
120\indexiii{generic}{special}{attribute}
Fred Drake4856d011999-01-12 04:15:20 +0000121\withsubitem{(built-in object attribute)}{
Fred Drake1e42d8a1998-11-25 17:58:50 +0000122 \ttindex{__methods__}
123 \ttindex{__members__}}
Fred Drakef6669171998-05-06 19:52:49 +0000124
125\begin{description}
126
127\item[None]
128This type has a single value. There is a single object with this value.
129This object is accessed through the built-in name \code{None}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000130It is used to signify the absence of a value in many situations, e.g.,
131it is returned from functions that don't explicitly return anything.
132Its truth value is false.
Fred Drakef6669171998-05-06 19:52:49 +0000133\ttindex{None}
Fred Drake78eebfd1998-11-25 19:09:24 +0000134\obindex{None@{\texttt{None}}}
Fred Drakef6669171998-05-06 19:52:49 +0000135
Neil Schemenauer48c2eb92001-01-04 01:25:50 +0000136\item[NotImplemented]
137This type has a single value. There is a single object with this value.
138This object is accessed through the built-in name \code{NotImplemented}.
Guido van Rossumab782dd2001-01-18 15:17:06 +0000139Numeric methods and rich comparison methods may return this value if
140they do not implement the operation for the operands provided. (The
141interpreter will then try the reflected operation, or some other
142fallback, depending on the operator.) Its truth value is true.
Neil Schemenauer48c2eb92001-01-04 01:25:50 +0000143\ttindex{NotImplemented}
144\obindex{NotImplemented@{\texttt{NotImplemented}}}
145
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000146\item[Ellipsis]
147This type has a single value. There is a single object with this value.
148This object is accessed through the built-in name \code{Ellipsis}.
Fred Drake82385871998-10-01 20:40:43 +0000149It is used to indicate the presence of the \samp{...} syntax in a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000150slice. Its truth value is true.
151\ttindex{Ellipsis}
Fred Drake78eebfd1998-11-25 19:09:24 +0000152\obindex{Ellipsis@{\texttt{Ellipsis}}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000153
Fred Drakef6669171998-05-06 19:52:49 +0000154\item[Numbers]
155These are created by numeric literals and returned as results by
156arithmetic operators and arithmetic built-in functions. Numeric
157objects are immutable; once created their value never changes. Python
158numbers are of course strongly related to mathematical numbers, but
159subject to the limitations of numerical representation in computers.
Fred Drakef6669171998-05-06 19:52:49 +0000160\obindex{numeric}
161
162Python distinguishes between integers and floating point numbers:
163
164\begin{description}
165\item[Integers]
166These represent elements from the mathematical set of whole numbers.
167\obindex{integer}
168
169There are two types of integers:
170
171\begin{description}
172
173\item[Plain integers]
174These represent numbers in the range -2147483648 through 2147483647.
175(The range may be larger on machines with a larger natural word
176size, but not smaller.)
Fred Drakee15956b2000-04-03 04:51:13 +0000177When the result of an operation would fall outside this range, the
Fred Drakef6669171998-05-06 19:52:49 +0000178exception \exception{OverflowError} is raised.
179For the purpose of shift and mask operations, integers are assumed to
180have a binary, 2's complement notation using 32 or more bits, and
181hiding no bits from the user (i.e., all 4294967296 different bit
182patterns correspond to different values).
183\obindex{plain integer}
184\withsubitem{(built-in exception)}{\ttindex{OverflowError}}
185
186\item[Long integers]
187These represent numbers in an unlimited range, subject to available
188(virtual) memory only. For the purpose of shift and mask operations,
189a binary representation is assumed, and negative numbers are
190represented in a variant of 2's complement which gives the illusion of
191an infinite string of sign bits extending to the left.
192\obindex{long integer}
193
194\end{description} % Integers
195
196The rules for integer representation are intended to give the most
197meaningful interpretation of shift and mask operations involving
198negative integers and the least surprises when switching between the
199plain and long integer domains. For any operation except left shift,
200if it yields a result in the plain integer domain without causing
201overflow, it will yield the same result in the long integer domain or
202when using mixed operands.
203\indexii{integer}{representation}
204
205\item[Floating point numbers]
206These represent machine-level double precision floating point numbers.
207You are at the mercy of the underlying machine architecture and
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000208\C{} implementation for the accepted range and handling of overflow.
209Python does not support single-precision floating point numbers; the
210savings in CPU and memory usage that are usually the reason for using
211these is dwarfed by the overhead of using objects in Python, so there
212is no reason to complicate the language with two kinds of floating
213point numbers.
Fred Drakef6669171998-05-06 19:52:49 +0000214\obindex{floating point}
215\indexii{floating point}{number}
216\indexii{C}{language}
217
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000218\item[Complex numbers]
219These represent complex numbers as a pair of machine-level double
220precision floating point numbers. The same caveats apply as for
221floating point numbers. The real and imaginary value of a complex
222number \code{z} can be retrieved through the attributes \code{z.real}
223and \code{z.imag}.
224\obindex{complex}
225\indexii{complex}{number}
226
Fred Drakef6669171998-05-06 19:52:49 +0000227\end{description} % Numbers
228
229\item[Sequences]
230These represent finite ordered sets indexed by natural numbers.
231The built-in function \function{len()}\bifuncindex{len} returns the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000232number of items of a sequence.
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000233When the length of a sequence is \var{n}, the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000234index set contains the numbers 0, 1, \ldots, \var{n}-1. Item
Fred Drakef6669171998-05-06 19:52:49 +0000235\var{i} of sequence \var{a} is selected by \code{\var{a}[\var{i}]}.
Fred Drakee15956b2000-04-03 04:51:13 +0000236\obindex{sequence}
Fred Drakef6669171998-05-06 19:52:49 +0000237\index{index operation}
238\index{item selection}
239\index{subscription}
240
241Sequences also support slicing: \code{\var{a}[\var{i}:\var{j}]}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000242selects all items with index \var{k} such that \var{i} \code{<=}
Fred Drakef6669171998-05-06 19:52:49 +0000243\var{k} \code{<} \var{j}. When used as an expression, a slice is a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000244sequence of the same type. This implies that the index set is
245renumbered so that it starts at 0.
Fred Drakef6669171998-05-06 19:52:49 +0000246\index{slicing}
247
248Sequences are distinguished according to their mutability:
249
250\begin{description}
Fred Drake4856d011999-01-12 04:15:20 +0000251
Fred Drakef6669171998-05-06 19:52:49 +0000252\item[Immutable sequences]
253An object of an immutable sequence type cannot change once it is
254created. (If the object contains references to other objects,
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000255these other objects may be mutable and may be changed; however,
Fred Drakef6669171998-05-06 19:52:49 +0000256the collection of objects directly referenced by an immutable object
257cannot change.)
258\obindex{immutable sequence}
259\obindex{immutable}
260
261The following types are immutable sequences:
262
263\begin{description}
264
265\item[Strings]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000266The items of a string are characters. There is no separate
267character type; a character is represented by a string of one item.
Fred Drakef6669171998-05-06 19:52:49 +0000268Characters represent (at least) 8-bit bytes. The built-in
269functions \function{chr()}\bifuncindex{chr} and
270\function{ord()}\bifuncindex{ord} convert between characters and
271nonnegative integers representing the byte values. Bytes with the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000272values 0-127 usually represent the corresponding \ASCII{} values, but
273the interpretation of values is up to the program. The string
274data type is also used to represent arrays of bytes, e.g., to hold data
Fred Drakef6669171998-05-06 19:52:49 +0000275read from a file.
276\obindex{string}
277\index{character}
278\index{byte}
Fred Drake5c07d9b1998-05-14 19:37:06 +0000279\index{ASCII@\ASCII{}}
Fred Drakef6669171998-05-06 19:52:49 +0000280
281(On systems whose native character set is not \ASCII{}, strings may use
282EBCDIC in their internal representation, provided the functions
283\function{chr()} and \function{ord()} implement a mapping between \ASCII{} and
284EBCDIC, and string comparison preserves the \ASCII{} order.
285Or perhaps someone can propose a better rule?)
Fred Drake5c07d9b1998-05-14 19:37:06 +0000286\index{ASCII@\ASCII{}}
Fred Drakef6669171998-05-06 19:52:49 +0000287\index{EBCDIC}
288\index{character set}
289\indexii{string}{comparison}
290\bifuncindex{chr}
291\bifuncindex{ord}
292
Fred Drakef0aff8e2000-04-06 13:57:21 +0000293\item[Unicode]
294The items of a Unicode object are Unicode characters. A Unicode
295character is represented by a Unicode object of one item and can hold
296a 16-bit value representing a Unicode ordinal. The built-in functions
297\function{unichr()}\bifuncindex{unichr} and
298\function{ord()}\bifuncindex{ord} convert between characters and
299nonnegative integers representing the Unicode ordinals as defined in
300the Unicode Standard 3.0. Conversion from and to other encodings are
301possible through the Unicode method \method{encode} and the built-in
302function \function{unicode()}\bifuncindex{unicode}.
303\obindex{unicode}
304\index{character}
305\index{integer}
Fred Drake8b3ce9e2000-04-06 14:00:14 +0000306\index{Unicode}
Fred Drakef0aff8e2000-04-06 13:57:21 +0000307
Fred Drakef6669171998-05-06 19:52:49 +0000308\item[Tuples]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000309The items of a tuple are arbitrary Python objects.
310Tuples of two or more items are formed by comma-separated lists
311of expressions. A tuple of one item (a `singleton') can be formed
Fred Drakef6669171998-05-06 19:52:49 +0000312by affixing a comma to an expression (an expression by itself does
313not create a tuple, since parentheses must be usable for grouping of
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000314expressions). An empty tuple can be formed by an empty pair of
Fred Drakef6669171998-05-06 19:52:49 +0000315parentheses.
316\obindex{tuple}
317\indexii{singleton}{tuple}
318\indexii{empty}{tuple}
319
320\end{description} % Immutable sequences
321
322\item[Mutable sequences]
323Mutable sequences can be changed after they are created. The
324subscription and slicing notations can be used as the target of
325assignment and \keyword{del} (delete) statements.
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000326\obindex{mutable sequence}
Fred Drakef6669171998-05-06 19:52:49 +0000327\obindex{mutable}
328\indexii{assignment}{statement}
329\index{delete}
330\stindex{del}
331\index{subscription}
332\index{slicing}
333
334There is currently a single mutable sequence type:
335
336\begin{description}
337
338\item[Lists]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000339The items of a list are arbitrary Python objects. Lists are formed
Fred Drakef6669171998-05-06 19:52:49 +0000340by placing a comma-separated list of expressions in square brackets.
341(Note that there are no special cases needed to form lists of length 0
342or 1.)
343\obindex{list}
344
345\end{description} % Mutable sequences
346
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000347The extension module \module{array}\refstmodindex{array} provides an
348additional example of a mutable sequence type.
349
350
Fred Drakef6669171998-05-06 19:52:49 +0000351\end{description} % Sequences
352
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000353\item[Mappings]
Fred Drakef6669171998-05-06 19:52:49 +0000354These represent finite sets of objects indexed by arbitrary index sets.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000355The subscript notation \code{a[k]} selects the item indexed
Fred Drakef6669171998-05-06 19:52:49 +0000356by \code{k} from the mapping \code{a}; this can be used in
357expressions and as the target of assignments or \keyword{del} statements.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000358The built-in function \function{len()} returns the number of items
Fred Drakef6669171998-05-06 19:52:49 +0000359in a mapping.
360\bifuncindex{len}
361\index{subscription}
362\obindex{mapping}
363
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000364There is currently a single intrinsic mapping type:
Fred Drakef6669171998-05-06 19:52:49 +0000365
366\begin{description}
367
368\item[Dictionaries]
Fred Drake8cdee961999-02-23 18:50:38 +0000369These\obindex{dictionary} represent finite sets of objects indexed by
370nearly arbitrary values. The only types of values not acceptable as
371keys are values containing lists or dictionaries or other mutable
372types that are compared by value rather than by object identity, the
373reason being that the efficient implementation of dictionaries
374requires a key's hash value to remain constant.
Fred Drakef6669171998-05-06 19:52:49 +0000375Numeric types used for keys obey the normal rules for numeric
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000376comparison: if two numbers compare equal (e.g., \code{1} and
Fred Drakef6669171998-05-06 19:52:49 +0000377\code{1.0}) then they can be used interchangeably to index the same
378dictionary entry.
379
Fred Drake8cdee961999-02-23 18:50:38 +0000380Dictionaries are \obindex{mutable}mutable; they are created by the
381\code{\{...\}} notation (see section \ref{dict}, ``Dictionary
382Displays'').
Fred Drakef6669171998-05-06 19:52:49 +0000383
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000384The extension modules \module{dbm}\refstmodindex{dbm},
385\module{gdbm}\refstmodindex{gdbm}, \module{bsddb}\refstmodindex{bsddb}
386provide additional examples of mapping types.
387
Fred Drakef6669171998-05-06 19:52:49 +0000388\end{description} % Mapping types
389
390\item[Callable types]
Fred Drake8cdee961999-02-23 18:50:38 +0000391These\obindex{callable} are the types to which the function call
392operation (see section \ref{calls}, ``Calls'') can be applied:
Fred Drakef6669171998-05-06 19:52:49 +0000393\indexii{function}{call}
394\index{invocation}
395\indexii{function}{argument}
Fred Drakef6669171998-05-06 19:52:49 +0000396
397\begin{description}
398
399\item[User-defined functions]
400A user-defined function object is created by a function definition
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000401(see section \ref{function}, ``Function definitions''). It should be
402called with an argument
Fred Drakef6669171998-05-06 19:52:49 +0000403list containing the same number of items as the function's formal
404parameter list.
405\indexii{user-defined}{function}
406\obindex{function}
407\obindex{user-defined function}
408
Guido van Rossum264bd591999-02-23 16:40:55 +0000409Special attributes: \member{func_doc} or \member{__doc__} is the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000410function's documentation string, or None if unavailable;
Fred Drake82385871998-10-01 20:40:43 +0000411\member{func_name} or \member{__name__} is the function's name;
412\member{func_defaults} is a tuple containing default argument values for
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000413those arguments that have defaults, or \code{None} if no arguments
Fred Drake82385871998-10-01 20:40:43 +0000414have a default value; \member{func_code} is the code object representing
415the compiled function body; \member{func_globals} is (a reference to)
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000416the dictionary that holds the function's global variables --- it
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000417defines the global namespace of the module in which the function was
Guido van Rossum264bd591999-02-23 16:40:55 +0000418defined.
419Of these, \member{func_code}, \member{func_defaults} and
420\member{func_doc} (and this \member{__doc__}) may be writable; the
421others can never be changed.
422Additional information about a function's definition can be
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000423retrieved from its code object; see the description of internal types
424below.
Fred Drake4856d011999-01-12 04:15:20 +0000425\withsubitem{(function attribute)}{
426 \ttindex{func_doc}
427 \ttindex{__doc__}
428 \ttindex{__name__}
429 \ttindex{func_defaults}
430 \ttindex{func_code}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000431 \ttindex{func_globals}}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000432\indexii{global}{namespace}
Fred Drakef6669171998-05-06 19:52:49 +0000433
434\item[User-defined methods]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000435A user-defined method object combines a class, a class instance (or
436\code{None}) and a user-defined function.
Fred Drakef6669171998-05-06 19:52:49 +0000437\obindex{method}
438\obindex{user-defined method}
439\indexii{user-defined}{method}
Fred Drakef6669171998-05-06 19:52:49 +0000440
441Special read-only attributes: \member{im_self} is the class instance
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000442object, \member{im_func} is the function object;
Fred Drake82385871998-10-01 20:40:43 +0000443\member{im_class} is the class that defined the method (which may be a
444base class of the class of which \member{im_self} is an instance);
445\member{__doc__} is the method's documentation (same as
446\code{im_func.__doc__}); \member{__name__} is the method name (same as
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000447\code{im_func.__name__}).
Fred Drake4856d011999-01-12 04:15:20 +0000448\withsubitem{(method attribute)}{
449 \ttindex{im_func}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000450 \ttindex{im_self}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000451
452User-defined method objects are created in two ways: when getting an
453attribute of a class that is a user-defined function object, or when
Fred Drake35c09f22000-06-28 20:15:47 +0000454getting an attribute of a class instance that is a user-defined
455function object defined by the class of the instance. In the former
456case (class attribute), the \member{im_self} attribute is \code{None},
457and the method object is said to be unbound; in the latter case
458(instance attribute), \method{im_self} is the instance, and the method
459object is said to be bound. For
Fred Drake82385871998-10-01 20:40:43 +0000460instance, when \class{C} is a class which contains a definition for a
461function \method{f()}, \code{C.f} does not yield the function object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000462\code{f}; rather, it yields an unbound method object \code{m} where
Fred Drake82385871998-10-01 20:40:43 +0000463\code{m.im_class} is \class{C}, \code{m.im_func} is \method{f()}, and
464\code{m.im_self} is \code{None}. When \code{x} is a \class{C}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000465instance, \code{x.f} yields a bound method object \code{m} where
Fred Drake82385871998-10-01 20:40:43 +0000466\code{m.im_class} is \code{C}, \code{m.im_func} is \method{f()}, and
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000467\code{m.im_self} is \code{x}.
Fred Drake4856d011999-01-12 04:15:20 +0000468\withsubitem{(method attribute)}{
Fred Drake35c09f22000-06-28 20:15:47 +0000469 \ttindex{im_class}\ttindex{im_func}\ttindex{im_self}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000470
471When an unbound user-defined method object is called, the underlying
Fred Drake82385871998-10-01 20:40:43 +0000472function (\member{im_func}) is called, with the restriction that the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000473first argument must be an instance of the proper class
Fred Drake82385871998-10-01 20:40:43 +0000474(\member{im_class}) or of a derived class thereof.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000475
476When a bound user-defined method object is called, the underlying
Fred Drake82385871998-10-01 20:40:43 +0000477function (\member{im_func}) is called, inserting the class instance
478(\member{im_self}) in front of the argument list. For instance, when
479\class{C} is a class which contains a definition for a function
480\method{f()}, and \code{x} is an instance of \class{C}, calling
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000481\code{x.f(1)} is equivalent to calling \code{C.f(x, 1)}.
482
483Note that the transformation from function object to (unbound or
484bound) method object happens each time the attribute is retrieved from
485the class or instance. In some cases, a fruitful optimization is to
486assign the attribute to a local variable and call that local variable.
487Also notice that this transformation only happens for user-defined
488functions; other callable objects (and all non-callable objects) are
Fred Drake35c09f22000-06-28 20:15:47 +0000489retrieved without transformation. It is also important to note that
490user-defined functions which are attributes of a class instance are
491not converted to bound methods; this \emph{only} happens when the
492function is an attribute of the class.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000493
Fred Drakef6669171998-05-06 19:52:49 +0000494\item[Built-in functions]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000495A built-in function object is a wrapper around a \C{} function. Examples
496of built-in functions are \function{len()} and \function{math.sin()}
497(\module{math} is a standard built-in module).
498The number and type of the arguments are
Fred Drakef6669171998-05-06 19:52:49 +0000499determined by the C function.
Fred Drake82385871998-10-01 20:40:43 +0000500Special read-only attributes: \member{__doc__} is the function's
501documentation string, or \code{None} if unavailable; \member{__name__}
502is the function's name; \member{__self__} is set to \code{None} (but see
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000503the next item).
Fred Drakef6669171998-05-06 19:52:49 +0000504\obindex{built-in function}
505\obindex{function}
506\indexii{C}{language}
507
508\item[Built-in methods]
509This is really a different disguise of a built-in function, this time
510containing an object passed to the \C{} function as an implicit extra
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000511argument. An example of a built-in method is
512\code{\var{list}.append()}, assuming
Fred Drakef6669171998-05-06 19:52:49 +0000513\var{list} is a list object.
Fred Drake82385871998-10-01 20:40:43 +0000514In this case, the special read-only attribute \member{__self__} is set
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000515to the object denoted by \code{list}.
Fred Drakef6669171998-05-06 19:52:49 +0000516\obindex{built-in method}
517\obindex{method}
518\indexii{built-in}{method}
519
520\item[Classes]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000521Class objects are described below. When a class object is called,
522a new class instance (also described below) is created and
Fred Drakef6669171998-05-06 19:52:49 +0000523returned. This implies a call to the class's \method{__init__()} method
524if it has one. Any arguments are passed on to the \method{__init__()}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000525method. If there is no \method{__init__()} method, the class must be called
Fred Drakef6669171998-05-06 19:52:49 +0000526without arguments.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000527\withsubitem{(object method)}{\ttindex{__init__()}}
Fred Drakef6669171998-05-06 19:52:49 +0000528\obindex{class}
529\obindex{class instance}
530\obindex{instance}
531\indexii{class object}{call}
532
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000533\item[Class instances]
534Class instances are described below. Class instances are callable
Fred Drake82385871998-10-01 20:40:43 +0000535only when the class has a \method{__call__()} method; \code{x(arguments)}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000536is a shorthand for \code{x.__call__(arguments)}.
537
Fred Drakef6669171998-05-06 19:52:49 +0000538\end{description}
539
540\item[Modules]
541Modules are imported by the \keyword{import} statement (see section
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000542\ref{import}, ``The \keyword{import} statement'').
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000543A module object has a namespace implemented by a dictionary object
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000544(this is the dictionary referenced by the func_globals attribute of
545functions defined in the module). Attribute references are translated
546to lookups in this dictionary, e.g., \code{m.x} is equivalent to
547\code{m.__dict__["x"]}.
548A module object does not contain the code object used to
Fred Drakef6669171998-05-06 19:52:49 +0000549initialize the module (since it isn't needed once the initialization
550is done).
551\stindex{import}
552\obindex{module}
553
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000554Attribute assignment updates the module's namespace dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000555e.g., \samp{m.x = 1} is equivalent to \samp{m.__dict__["x"] = 1}.
Fred Drakef6669171998-05-06 19:52:49 +0000556
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000557Special read-only attribute: \member{__dict__} is the module's
558namespace as a dictionary object.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000559\withsubitem{(module attribute)}{\ttindex{__dict__}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000560
561Predefined (writable) attributes: \member{__name__}
562is the module's name; \member{__doc__} is the
563module's documentation string, or
Fred Drake82385871998-10-01 20:40:43 +0000564\code{None} if unavailable; \member{__file__} is the pathname of the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000565file from which the module was loaded, if it was loaded from a file.
Fred Drake82385871998-10-01 20:40:43 +0000566The \member{__file__} attribute is not present for C{} modules that are
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000567statically linked into the interpreter; for extension modules loaded
568dynamically from a shared library, it is the pathname of the shared
569library file.
Fred Drake4856d011999-01-12 04:15:20 +0000570\withsubitem{(module attribute)}{
571 \ttindex{__name__}
572 \ttindex{__doc__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000573 \ttindex{__file__}}
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000574\indexii{module}{namespace}
Fred Drakef6669171998-05-06 19:52:49 +0000575
576\item[Classes]
577Class objects are created by class definitions (see section
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000578\ref{class}, ``Class definitions'').
579A class has a namespace implemented by a dictionary object.
580Class attribute references are translated to
581lookups in this dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000582e.g., \samp{C.x} is translated to \samp{C.__dict__["x"]}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000583When the attribute name is not found
Fred Drakef6669171998-05-06 19:52:49 +0000584there, the attribute search continues in the base classes. The search
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000585is depth-first, left-to-right in the order of occurrence in the
Fred Drakef6669171998-05-06 19:52:49 +0000586base class list.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000587When a class attribute reference would yield a user-defined function
588object, it is transformed into an unbound user-defined method object
Fred Drake82385871998-10-01 20:40:43 +0000589(see above). The \member{im_class} attribute of this method object is the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000590class in which the function object was found, not necessarily the
591class for which the attribute reference was initiated.
Fred Drakef6669171998-05-06 19:52:49 +0000592\obindex{class}
593\obindex{class instance}
594\obindex{instance}
595\indexii{class object}{call}
596\index{container}
597\obindex{dictionary}
598\indexii{class}{attribute}
599
600Class attribute assignments update the class's dictionary, never the
601dictionary of a base class.
602\indexiii{class}{attribute}{assignment}
603
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000604A class object can be called (see above) to yield a class instance (see
605below).
Fred Drakef6669171998-05-06 19:52:49 +0000606\indexii{class object}{call}
607
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000608Special attributes: \member{__name__} is the class name;
609\member{__module__} is the module name in which the class was defined;
Guido van Rossumdfb658c1998-07-23 17:54:36 +0000610\member{__dict__} is the dictionary containing the class's namespace;
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000611\member{__bases__} is a tuple (possibly empty or a singleton)
612containing the base classes, in the order of their occurrence in the
Fred Drake82385871998-10-01 20:40:43 +0000613base class list; \member{__doc__} is the class's documentation string,
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000614or None if undefined.
Fred Drake4856d011999-01-12 04:15:20 +0000615\withsubitem{(class attribute)}{
616 \ttindex{__name__}
617 \ttindex{__module__}
618 \ttindex{__dict__}
619 \ttindex{__bases__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000620 \ttindex{__doc__}}
Fred Drakef6669171998-05-06 19:52:49 +0000621
622\item[Class instances]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000623A class instance is created by calling a class object (see above).
624A class instance has a namespace implemented as a dictionary which
625is the first place in which
Fred Drakef6669171998-05-06 19:52:49 +0000626attribute references are searched. When an attribute is not found
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000627there, and the instance's class has an attribute by that name,
628the search continues with the class attributes. If a class attribute
629is found that is a user-defined function object (and in no other
630case), it is transformed into an unbound user-defined method object
Fred Drake82385871998-10-01 20:40:43 +0000631(see above). The \member{im_class} attribute of this method object is
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000632the class in which the function object was found, not necessarily the
633class of the instance for which the attribute reference was initiated.
634If no class attribute is found, and the object's class has a
Fred Drake82385871998-10-01 20:40:43 +0000635\method{__getattr__()} method, that is called to satisfy the lookup.
Fred Drakef6669171998-05-06 19:52:49 +0000636\obindex{class instance}
637\obindex{instance}
638\indexii{class}{instance}
639\indexii{class instance}{attribute}
640
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000641Attribute assignments and deletions update the instance's dictionary,
Fred Drake82385871998-10-01 20:40:43 +0000642never a class's dictionary. If the class has a \method{__setattr__()} or
643\method{__delattr__()} method, this is called instead of updating the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000644instance dictionary directly.
Fred Drakef6669171998-05-06 19:52:49 +0000645\indexiii{class instance}{attribute}{assignment}
646
647Class instances can pretend to be numbers, sequences, or mappings if
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000648they have methods with certain special names. See
649section \ref{specialnames}, ``Special method names.''
Fred Drakee15956b2000-04-03 04:51:13 +0000650\obindex{numeric}
Fred Drakef6669171998-05-06 19:52:49 +0000651\obindex{sequence}
652\obindex{mapping}
653
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000654Special attributes: \member{__dict__} is the attribute
655dictionary; \member{__class__} is the instance's class.
Fred Drake4856d011999-01-12 04:15:20 +0000656\withsubitem{(instance attribute)}{
657 \ttindex{__dict__}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000658 \ttindex{__class__}}
Fred Drakef6669171998-05-06 19:52:49 +0000659
660\item[Files]
Fred Drakee15eb351999-11-10 16:13:25 +0000661A file\obindex{file} object represents an open file. File objects are
662created by the \function{open()}\bifuncindex{open} built-in function,
663and also by
664\withsubitem{(in module os)}{\ttindex{popen()}}\function{os.popen()},
665\function{os.fdopen()}, and the
666\method{makefile()}\withsubitem{(socket method)}{\ttindex{makefile()}}
667method of socket objects (and perhaps by other functions or methods
668provided by extension modules). The objects
669\ttindex{sys.stdin}\code{sys.stdin},
670\ttindex{sys.stdout}\code{sys.stdout} and
671\ttindex{sys.stderr}\code{sys.stderr} are initialized to file objects
672corresponding to the interpreter's standard\index{stdio} input, output
673and error streams. See the \citetitle[../lib/lib.html]{Python Library
674Reference} for complete documentation of file objects.
Fred Drake4856d011999-01-12 04:15:20 +0000675\withsubitem{(in module sys)}{
676 \ttindex{stdin}
677 \ttindex{stdout}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000678 \ttindex{stderr}}
Fred Drakee15eb351999-11-10 16:13:25 +0000679
Fred Drakef6669171998-05-06 19:52:49 +0000680
681\item[Internal types]
682A few types used internally by the interpreter are exposed to the user.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000683Their definitions may change with future versions of the interpreter,
Fred Drakef6669171998-05-06 19:52:49 +0000684but they are mentioned here for completeness.
685\index{internal type}
686\index{types, internal}
687
688\begin{description}
689
690\item[Code objects]
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000691Code objects represent \emph{byte-compiled} executable Python code, or
692\emph{bytecode}.
Fred Drakef6669171998-05-06 19:52:49 +0000693The difference between a code
694object and a function object is that the function object contains an
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000695explicit reference to the function's globals (the module in which it
696was defined), while a code object contains no context;
697also the default argument values are stored in the function object,
698not in the code object (because they represent values calculated at
699run-time). Unlike function objects, code objects are immutable and
700contain no references (directly or indirectly) to mutable objects.
701\index{bytecode}
Fred Drakef6669171998-05-06 19:52:49 +0000702\obindex{code}
703
Fred Drake1e42d8a1998-11-25 17:58:50 +0000704Special read-only attributes: \member{co_name} gives the function
705name; \member{co_argcount} is the number of positional arguments
706(including arguments with default values); \member{co_nlocals} is the
707number of local variables used by the function (including arguments);
708\member{co_varnames} is a tuple containing the names of the local
709variables (starting with the argument names); \member{co_code} is a
710string representing the sequence of bytecode instructions;
711\member{co_consts} is a tuple containing the literals used by the
712bytecode; \member{co_names} is a tuple containing the names used by
713the bytecode; \member{co_filename} is the filename from which the code
714was compiled; \member{co_firstlineno} is the first line number of the
715function; \member{co_lnotab} is a string encoding the mapping from
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000716byte code offsets to line numbers (for details see the source code of
Fred Drake1e42d8a1998-11-25 17:58:50 +0000717the interpreter); \member{co_stacksize} is the required stack size
718(including local variables); \member{co_flags} is an integer encoding
719a number of flags for the interpreter.
Fred Drake4856d011999-01-12 04:15:20 +0000720\withsubitem{(code object attribute)}{
721 \ttindex{co_argcount}
722 \ttindex{co_code}
723 \ttindex{co_consts}
724 \ttindex{co_filename}
725 \ttindex{co_firstlineno}
726 \ttindex{co_flags}
727 \ttindex{co_lnotab}
728 \ttindex{co_name}
729 \ttindex{co_names}
730 \ttindex{co_nlocals}
731 \ttindex{co_stacksize}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000732 \ttindex{co_varnames}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000733
Fred Drakee15956b2000-04-03 04:51:13 +0000734The following flag bits are defined for \member{co_flags}: bit
735\code{0x04} is set if the function uses the \samp{*arguments} syntax
736to accept an arbitrary number of positional arguments; bit
737\code{0x08} is set if the function uses the \samp{**keywords} syntax
738to accept arbitrary keyword arguments; other bits are used internally
739or reserved for future use. If\index{documentation string} a code
740object represents a function, the first item in \member{co_consts} is
741the documentation string of the function, or \code{None} if undefined.
Fred Drakef6669171998-05-06 19:52:49 +0000742
743\item[Frame objects]
744Frame objects represent execution frames. They may occur in traceback
745objects (see below).
746\obindex{frame}
747
748Special read-only attributes: \member{f_back} is to the previous
749stack frame (towards the caller), or \code{None} if this is the bottom
750stack frame; \member{f_code} is the code object being executed in this
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000751frame; \member{f_locals} is the dictionary used to look up local
752variables; \member{f_globals} is used for global variables;
Fred Drake82385871998-10-01 20:40:43 +0000753\member{f_builtins} is used for built-in (intrinsic) names;
754\member{f_restricted} is a flag indicating whether the function is
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000755executing in restricted execution mode;
Fred Drakef6669171998-05-06 19:52:49 +0000756\member{f_lineno} gives the line number and \member{f_lasti} gives the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000757precise instruction (this is an index into the bytecode string of
Fred Drakef6669171998-05-06 19:52:49 +0000758the code object).
Fred Drake4856d011999-01-12 04:15:20 +0000759\withsubitem{(frame attribute)}{
760 \ttindex{f_back}
761 \ttindex{f_code}
762 \ttindex{f_globals}
763 \ttindex{f_locals}
764 \ttindex{f_lineno}
765 \ttindex{f_lasti}
766 \ttindex{f_builtins}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000767 \ttindex{f_restricted}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000768
Fred Drake82385871998-10-01 20:40:43 +0000769Special writable attributes: \member{f_trace}, if not \code{None}, is a
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000770function called at the start of each source code line (this is used by
Fred Drake82385871998-10-01 20:40:43 +0000771the debugger); \member{f_exc_type}, \member{f_exc_value},
772\member{f_exc_traceback} represent the most recent exception caught in
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000773this frame.
Fred Drake4856d011999-01-12 04:15:20 +0000774\withsubitem{(frame attribute)}{
775 \ttindex{f_trace}
776 \ttindex{f_exc_type}
777 \ttindex{f_exc_value}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000778 \ttindex{f_exc_traceback}}
Fred Drakef6669171998-05-06 19:52:49 +0000779
780\item[Traceback objects] \label{traceback}
781Traceback objects represent a stack trace of an exception. A
782traceback object is created when an exception occurs. When the search
783for an exception handler unwinds the execution stack, at each unwound
784level a traceback object is inserted in front of the current
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000785traceback. When an exception handler is entered, the stack trace is
786made available to the program.
787(See section \ref{try}, ``The \code{try} statement.'')
788It is accessible as \code{sys.exc_traceback}, and also as the third
789item of the tuple returned by \code{sys.exc_info()}. The latter is
790the preferred interface, since it works correctly when the program is
791using multiple threads.
792When the program contains no suitable handler, the stack trace is written
Fred Drakef6669171998-05-06 19:52:49 +0000793(nicely formatted) to the standard error stream; if the interpreter is
794interactive, it is also made available to the user as
795\code{sys.last_traceback}.
796\obindex{traceback}
797\indexii{stack}{trace}
798\indexii{exception}{handler}
799\indexii{execution}{stack}
Fred Drake4856d011999-01-12 04:15:20 +0000800\withsubitem{(in module sys)}{
801 \ttindex{exc_info}
802 \ttindex{exc_traceback}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000803 \ttindex{last_traceback}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000804\ttindex{sys.exc_info}
Fred Drakef6669171998-05-06 19:52:49 +0000805\ttindex{sys.exc_traceback}
806\ttindex{sys.last_traceback}
807
808Special read-only attributes: \member{tb_next} is the next level in the
809stack trace (towards the frame where the exception occurred), or
810\code{None} if there is no next level; \member{tb_frame} points to the
811execution frame of the current level; \member{tb_lineno} gives the line
812number where the exception occurred; \member{tb_lasti} indicates the
813precise instruction. The line number and last instruction in the
814traceback may differ from the line number of its frame object if the
815exception occurred in a \keyword{try} statement with no matching
816except clause or with a finally clause.
Fred Drake4856d011999-01-12 04:15:20 +0000817\withsubitem{(traceback attribute)}{
818 \ttindex{tb_next}
819 \ttindex{tb_frame}
820 \ttindex{tb_lineno}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000821 \ttindex{tb_lasti}}
Fred Drakef6669171998-05-06 19:52:49 +0000822\stindex{try}
823
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000824\item[Slice objects]
825Slice objects are used to represent slices when \emph{extended slice
826syntax} is used. This is a slice using two colons, or multiple slices
827or ellipses separated by commas, e.g., \code{a[i:j:step]}, \code{a[i:j,
828k:l]}, or \code{a[..., i:j])}. They are also created by the built-in
Fred Drake1e42d8a1998-11-25 17:58:50 +0000829\function{slice()}\bifuncindex{slice} function.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000830
Thomas Woutersf9b526d2000-07-16 19:05:38 +0000831Special read-only attributes: \member{start} is the lower bound;
832\member{stop} is the upper bound; \member{step} is the step value; each is
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000833\code{None} if omitted. These attributes can have any type.
Fred Drake4856d011999-01-12 04:15:20 +0000834\withsubitem{(slice object attribute)}{
835 \ttindex{start}
836 \ttindex{stop}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000837 \ttindex{step}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000838
Fred Drakef6669171998-05-06 19:52:49 +0000839\end{description} % Internal types
840
841\end{description} % Types
842
843
Fred Drake61c77281998-07-28 19:34:22 +0000844\section{Special method names\label{specialnames}}
Fred Drakef6669171998-05-06 19:52:49 +0000845
846A class can implement certain operations that are invoked by special
Fred Draked82575d1998-08-28 20:03:12 +0000847syntax (such as arithmetic operations or subscripting and slicing) by
848defining methods with special names. For instance, if a class defines
849a method named \method{__getitem__()}, and \code{x} is an instance of
850this class, then \code{x[i]} is equivalent to
851\code{x.__getitem__(i)}. (The reverse is not true --- if \code{x} is
852a list object, \code{x.__getitem__(i)} is not equivalent to
853\code{x[i]}.) Except where mentioned, attempts to execute an
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000854operation raise an exception when no appropriate method is defined.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000855\withsubitem{(mapping object method)}{\ttindex{__getitem__()}}
Fred Drakef6669171998-05-06 19:52:49 +0000856
Fred Drake0c475592000-12-07 04:49:34 +0000857When implementing a class that emulates any built-in type, it is
858important that the emulation only be implemented to the degree that it
859makes sense for the object being modelled. For example, some
860sequences may work well with retrieval of individual elements, but
861extracting a slice may not make sense. (One example of this is the
862\class{NodeList} interface in the W3C's Document Object Model.)
863
Fred Drakef6669171998-05-06 19:52:49 +0000864
Fred Drake61c77281998-07-28 19:34:22 +0000865\subsection{Basic customization\label{customization}}
Fred Drakef6669171998-05-06 19:52:49 +0000866
Fred Drake1e42d8a1998-11-25 17:58:50 +0000867\begin{methoddesc}[object]{__init__}{self\optional{, args...}}
Fred Drakef6669171998-05-06 19:52:49 +0000868Called when the instance is created. The arguments are those passed
869to the class constructor expression. If a base class has an
Fred Drake82385871998-10-01 20:40:43 +0000870\method{__init__()} method the derived class's \method{__init__()} method must
Fred Drakef6669171998-05-06 19:52:49 +0000871explicitly call it to ensure proper initialization of the base class
Fred Draked82575d1998-08-28 20:03:12 +0000872part of the instance, e.g., \samp{BaseClass.__init__(\var{self},
873[\var{args}...])}.
Fred Drakef6669171998-05-06 19:52:49 +0000874\indexii{class}{constructor}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000875\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000876
877
Fred Drake1e42d8a1998-11-25 17:58:50 +0000878\begin{methoddesc}[object]{__del__}{self}
Guido van Rossum7c0240f1998-07-24 15:36:43 +0000879Called when the instance is about to be destroyed. This is also
880called a destructor\index{destructor}. If a base class
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000881has a \method{__del__()} method, the derived class's \method{__del__()} method
Fred Drakef6669171998-05-06 19:52:49 +0000882must explicitly call it to ensure proper deletion of the base class
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000883part of the instance. Note that it is possible (though not recommended!)
884for the \method{__del__()}
Fred Drakef6669171998-05-06 19:52:49 +0000885method to postpone destruction of the instance by creating a new
886reference to it. It may then be called at a later time when this new
887reference is deleted. It is not guaranteed that
888\method{__del__()} methods are called for objects that still exist when
889the interpreter exits.
Fred Drakef6669171998-05-06 19:52:49 +0000890\stindex{del}
891
Fred Drake82385871998-10-01 20:40:43 +0000892\strong{Programmer's note:} \samp{del x} doesn't directly call
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000893\code{x.__del__()} --- the former decrements the reference count for
894\code{x} by one, and the latter is only called when its reference
895count reaches zero. Some common situations that may prevent the
896reference count of an object to go to zero include: circular
897references between objects (e.g., a doubly-linked list or a tree data
898structure with parent and child pointers); a reference to the object
899on the stack frame of a function that caught an exception (the
900traceback stored in \code{sys.exc_traceback} keeps the stack frame
901alive); or a reference to the object on the stack frame that raised an
902unhandled exception in interactive mode (the traceback stored in
903\code{sys.last_traceback} keeps the stack frame alive). The first
904situation can only be remedied by explicitly breaking the cycles; the
905latter two situations can be resolved by storing None in
906\code{sys.exc_traceback} or \code{sys.last_traceback}.
Fred Drakef6669171998-05-06 19:52:49 +0000907
908\strong{Warning:} due to the precarious circumstances under which
Fred Draked82575d1998-08-28 20:03:12 +0000909\method{__del__()} methods are invoked, exceptions that occur during their
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000910execution are ignored, and a warning is printed to \code{sys.stderr}
Fred Draked82575d1998-08-28 20:03:12 +0000911instead. Also, when \method{__del__()} is invoked is response to a module
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000912being deleted (e.g., when execution of the program is done), other
Fred Draked82575d1998-08-28 20:03:12 +0000913globals referenced by the \method{__del__()} method may already have been
914deleted. For this reason, \method{__del__()} methods should do the
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000915absolute minimum needed to maintain external invariants. Python 1.5
916guarantees that globals whose name begins with a single underscore are
917deleted from their module before other globals are deleted; if no
918other references to such globals exist, this may help in assuring that
919imported modules are still available at the time when the
Fred Draked82575d1998-08-28 20:03:12 +0000920\method{__del__()} method is called.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000921\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000922
Fred Drake1e42d8a1998-11-25 17:58:50 +0000923\begin{methoddesc}[object]{__repr__}{self}
Fred Drake82385871998-10-01 20:40:43 +0000924Called by the \function{repr()}\bifuncindex{repr} built-in function
925and by string conversions (reverse quotes) to compute the ``official''
Andrew M. Kuchling68abe832000-12-19 14:09:21 +0000926string representation of an object. If at all possible, this should
Guido van Rossum035f7e82000-12-19 04:18:13 +0000927look like a valid Python expression that could be used to recreate an
928object with the same value (given an appropriate environment). If
929this is not possible, a string of the form \samp{<\var{...some useful
930description...}>} should be returned. The return value must be a
931string object.
932
933This is typically used for debugging, so it is important that the
934representation is information-rich and unambiguous.
Fred Drakef6669171998-05-06 19:52:49 +0000935\indexii{string}{conversion}
936\indexii{reverse}{quotes}
937\indexii{backward}{quotes}
938\index{back-quotes}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000939\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000940
Fred Drake1e42d8a1998-11-25 17:58:50 +0000941\begin{methoddesc}[object]{__str__}{self}
Fred Draked82575d1998-08-28 20:03:12 +0000942Called by the \function{str()}\bifuncindex{str} built-in function and
943by the \keyword{print}\stindex{print} statement to compute the
Fred Drake82385871998-10-01 20:40:43 +0000944``informal'' string representation of an object. This differs from
945\method{__repr__()} in that it does not have to be a valid Python
946expression: a more convenient or concise representation may be used
Guido van Rossum035f7e82000-12-19 04:18:13 +0000947instead. The return value must be a string object.
Fred Drake1e42d8a1998-11-25 17:58:50 +0000948\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000949
Guido van Rossumab782dd2001-01-18 15:17:06 +0000950\begin{methoddesc}[object]{__lt__}{self, other}
951\methodline[object]{__le__}{self, other}
952\methodline[object]{__eq__}{self, other}
953\methodline[object]{__ne__}{self, other}
954\methodline[object]{__gt__}{self, other}
955\methodline[object]{__ge__}{self, other}
956\versionadded{2.1}
957These are the so-called ``rich comparison'' methods, and are called
958for comparison operators in preference to \method{__cmp__()} below.
959The correspondence between operator symbols and method names is as
960follows:
961\code{\var{x}<\var{y}} calls \code{\var{x}.__lt__(\var{y})},
962\code{\var{x}<=\var{y}} calls \code{\var{x}.__le__(\var{y})},
963\code{\var{x}==\var{y}} calls \code{\var{x}.__eq__(\var{y})},
964\code{\var{x}!=\var{y}} and \code{\var{x}<>\var{y}} call
965\code{\var{x}.__ne__(\var{y})},
966\code{\var{x}>\var{y}} calls \code{\var{x}.__gt__(\var{y})}, and
967\code{\var{x}>=\var{y}} calls \code{\var{x}.__ge__(\var{y})}.
968These methods can return any value, but if the comparison operator is
969used in a Boolean context, the return value should be interpretable as
970a Boolean value, else a \exception{TypeError} will be raised.
971By convention, \code{0} is used for false and \code{1} for true.
972
973There are no reflected (swapped-argument) versions of these methods
974(to be used when the left argument does not support the operation but
975the right argument does); rather, \method{__lt__()} and
976\method{__gt__()} are each other's reflection, \method{__le__()} and
977\method{__ge__()} are each other's reflection, and \method{__eq__()}
978and \method{__ne__()} are their own reflection.
979
980Arguments to rich comparison methods are never coerced. A rich
981comparison method may return \code{NotImplemented} if it does not
982implement the operation for a given pair of arguments.
983\end{methoddesc}
984
Fred Drake1e42d8a1998-11-25 17:58:50 +0000985\begin{methoddesc}[object]{__cmp__}{self, other}
Guido van Rossumab782dd2001-01-18 15:17:06 +0000986Called by comparison operations if rich comparison (see above) is not
987defined. Should return a negative integer if
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000988\code{self < other}, zero if \code{self == other}, a positive integer if
Fred Drakef6669171998-05-06 19:52:49 +0000989\code{self > other}. If no \method{__cmp__()} operation is defined, class
990instances are compared by object identity (``address'').
Guido van Rossum83b2f8a1998-07-23 17:12:46 +0000991(Note: the restriction that exceptions are not propagated by
Fred Drake82385871998-10-01 20:40:43 +0000992\method{__cmp__()} has been removed in Python 1.5.)
Fred Drakef6669171998-05-06 19:52:49 +0000993\bifuncindex{cmp}
994\index{comparisons}
Fred Drake1e42d8a1998-11-25 17:58:50 +0000995\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +0000996
Fred Drakee57a1142000-06-15 20:07:25 +0000997\begin{methoddesc}[object]{__rcmp__}{self, other}
Fred Drake445f8322001-01-04 15:11:48 +0000998 \versionchanged[No longer supported]{2.1}
Fred Drakee57a1142000-06-15 20:07:25 +0000999\end{methoddesc}
1000
Fred Drake1e42d8a1998-11-25 17:58:50 +00001001\begin{methoddesc}[object]{__hash__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001002Called for the key object for dictionary\obindex{dictionary}
1003operations, and by the built-in function
Fred Drakef6669171998-05-06 19:52:49 +00001004\function{hash()}\bifuncindex{hash}. Should return a 32-bit integer
1005usable as a hash value
1006for dictionary operations. The only required property is that objects
1007which compare equal have the same hash value; it is advised to somehow
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001008mix together (e.g., using exclusive or) the hash values for the
Fred Drakef6669171998-05-06 19:52:49 +00001009components of the object that also play a part in comparison of
1010objects. If a class does not define a \method{__cmp__()} method it should
1011not define a \method{__hash__()} operation either; if it defines
1012\method{__cmp__()} but not \method{__hash__()} its instances will not be
1013usable as dictionary keys. If a class defines mutable objects and
1014implements a \method{__cmp__()} method it should not implement
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001015\method{__hash__()}, since the dictionary implementation requires that
1016a key's hash value is immutable (if the object's hash value changes, it
1017will be in the wrong hash bucket).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001018\withsubitem{(object method)}{\ttindex{__cmp__()}}
1019\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001020
Fred Drake1e42d8a1998-11-25 17:58:50 +00001021\begin{methoddesc}[object]{__nonzero__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001022Called to implement truth value testing; should return \code{0} or
1023\code{1}. When this method is not defined, \method{__len__()} is
1024called, if it is defined (see below). If a class defines neither
1025\method{__len__()} nor \method{__nonzero__()}, all its instances are
1026considered true.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001027\withsubitem{(mapping object method)}{\ttindex{__len__()}}
1028\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001029
1030
Fred Drake61c77281998-07-28 19:34:22 +00001031\subsection{Customizing attribute access\label{attribute-access}}
Fred Drakef6669171998-05-06 19:52:49 +00001032
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001033The following methods can be defined to customize the meaning of
1034attribute access (use of, assignment to, or deletion of \code{x.name})
1035for class instances.
1036For performance reasons, these methods are cached in the class object
1037at class definition time; therefore, they cannot be changed after the
1038class definition is executed.
Fred Drakef6669171998-05-06 19:52:49 +00001039
Fred Drake1e42d8a1998-11-25 17:58:50 +00001040\begin{methoddesc}[object]{__getattr__}{self, name}
Fred Drakef6669171998-05-06 19:52:49 +00001041Called when an attribute lookup has not found the attribute in the
1042usual places (i.e. it is not an instance attribute nor is it found in
1043the class tree for \code{self}). \code{name} is the attribute name.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001044This method should return the (computed) attribute value or raise an
Fred Draked82575d1998-08-28 20:03:12 +00001045\exception{AttributeError} exception.
Fred Drakef6669171998-05-06 19:52:49 +00001046
1047Note that if the attribute is found through the normal mechanism,
Fred Draked82575d1998-08-28 20:03:12 +00001048\method{__getattr__()} is not called. (This is an intentional
1049asymmetry between \method{__getattr__()} and \method{__setattr__()}.)
Fred Drakef6669171998-05-06 19:52:49 +00001050This is done both for efficiency reasons and because otherwise
Fred Draked82575d1998-08-28 20:03:12 +00001051\method{__setattr__()} would have no way to access other attributes of
1052the instance.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001053Note that at least for instance variables, you can fake
1054total control by not inserting any values in the instance
1055attribute dictionary (but instead inserting them in another object).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001056\withsubitem{(object method)}{\ttindex{__setattr__()}}
1057\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001058
Fred Drake1e42d8a1998-11-25 17:58:50 +00001059\begin{methoddesc}[object]{__setattr__}{self, name, value}
Fred Drakef6669171998-05-06 19:52:49 +00001060Called when an attribute assignment is attempted. This is called
Fred Draked82575d1998-08-28 20:03:12 +00001061instead of the normal mechanism (i.e.\ store the value in the instance
1062dictionary). \var{name} is the attribute name, \var{value} is the
Fred Drakef6669171998-05-06 19:52:49 +00001063value to be assigned to it.
Fred Drakef6669171998-05-06 19:52:49 +00001064
Fred Draked82575d1998-08-28 20:03:12 +00001065If \method{__setattr__()} wants to assign to an instance attribute, it
1066should not simply execute \samp{self.\var{name} = value} --- this
1067would cause a recursive call to itself. Instead, it should insert the
1068value in the dictionary of instance attributes, e.g.,
1069\samp{self.__dict__[\var{name}] = value}.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001070\withsubitem{(instance attribute)}{\ttindex{__dict__}}
1071\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001072
Fred Drake1e42d8a1998-11-25 17:58:50 +00001073\begin{methoddesc}[object]{__delattr__}{self, name}
Fred Draked82575d1998-08-28 20:03:12 +00001074Like \method{__setattr__()} but for attribute deletion instead of
Fred Drake1e42d8a1998-11-25 17:58:50 +00001075assignment. This should only be implemented if \samp{del
1076obj.\var{name}} is meaningful for the object.
1077\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001078
1079
Fred Drake61c77281998-07-28 19:34:22 +00001080\subsection{Emulating callable objects\label{callable-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001081
Fred Drake1e42d8a1998-11-25 17:58:50 +00001082\begin{methoddesc}[object]{__call__}{self\optional{, args...}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001083Called when the instance is ``called'' as a function; if this method
Fred Draked82575d1998-08-28 20:03:12 +00001084is defined, \code{\var{x}(arg1, arg2, ...)} is a shorthand for
1085\code{\var{x}.__call__(arg1, arg2, ...)}.
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001086\indexii{call}{instance}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001087\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001088
1089
Fred Drake61c77281998-07-28 19:34:22 +00001090\subsection{Emulating sequence and mapping types\label{sequence-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001091
1092The following methods can be defined to emulate sequence or mapping
1093objects. The first set of methods is used either to emulate a
1094sequence or to emulate a mapping; the difference is that for a
1095sequence, the allowable keys should be the integers \var{k} for which
1096\code{0 <= \var{k} < \var{N}} where \var{N} is the length of the
Thomas Wouters1d75a792000-08-17 22:37:32 +00001097sequence, or slice objects, which define a range of items. (For backwards
1098compatibility, the method \method{__getslice__()} (see below) can also be
1099defined to handle simple, but not extended slices.) It is also recommended
Fred Drakea0073822000-08-18 02:42:14 +00001100that mappings provide the methods \method{keys()}, \method{values()},
Thomas Wouters1d75a792000-08-17 22:37:32 +00001101\method{items()}, \method{has_key()}, \method{get()}, \method{clear()},
1102\method{copy()}, and \method{update()} behaving similar to those for
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001103Python's standard dictionary objects; mutable sequences should provide
1104methods \method{append()}, \method{count()}, \method{index()},
1105\method{insert()}, \method{pop()}, \method{remove()}, \method{reverse()}
1106and \method{sort()}, like Python standard list objects. Finally,
1107sequence types should implement addition (meaning concatenation) and
1108multiplication (meaning repetition) by defining the methods
Thomas Wouters12bba852000-08-24 20:06:04 +00001109\method{__add__()}, \method{__radd__()}, \method{__iadd__()},
1110\method{__mul__()}, \method{__rmul__()} and \method{__imul__()} described
1111below; they should not define \method{__coerce__()} or other numerical
1112operators.
Fred Drake4856d011999-01-12 04:15:20 +00001113\withsubitem{(mapping object method)}{
1114 \ttindex{keys()}
1115 \ttindex{values()}
1116 \ttindex{items()}
1117 \ttindex{has_key()}
1118 \ttindex{get()}
1119 \ttindex{clear()}
1120 \ttindex{copy()}
Fred Drake1e42d8a1998-11-25 17:58:50 +00001121 \ttindex{update()}}
Fred Drake4856d011999-01-12 04:15:20 +00001122\withsubitem{(sequence object method)}{
1123 \ttindex{append()}
1124 \ttindex{count()}
1125 \ttindex{index()}
1126 \ttindex{insert()}
1127 \ttindex{pop()}
1128 \ttindex{remove()}
1129 \ttindex{reverse()}
1130 \ttindex{sort()}
1131 \ttindex{__add__()}
1132 \ttindex{__radd__()}
Thomas Wouters12bba852000-08-24 20:06:04 +00001133 \ttindex{__iadd__()}
Fred Drake4856d011999-01-12 04:15:20 +00001134 \ttindex{__mul__()}
Thomas Wouters12bba852000-08-24 20:06:04 +00001135 \ttindex{__rmul__()}
1136 \ttindex{__imul__()}}
Fred Drakeae3e5741999-01-28 23:21:49 +00001137\withsubitem{(numeric object method)}{\ttindex{__coerce__()}}
Fred Drakef6669171998-05-06 19:52:49 +00001138
Fred Drake1e42d8a1998-11-25 17:58:50 +00001139\begin{methoddesc}[mapping object]{__len__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001140Called to implement the built-in function
1141\function{len()}\bifuncindex{len}. Should return the length of the
1142object, an integer \code{>=} 0. Also, an object that doesn't define a
1143\method{__nonzero__()} method and whose \method{__len__()} method
1144returns zero is considered to be false in a Boolean context.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001145\withsubitem{(object method)}{\ttindex{__nonzero__()}}
1146\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001147
Fred Drake1e42d8a1998-11-25 17:58:50 +00001148\begin{methoddesc}[mapping object]{__getitem__}{self, key}
Fred Draked82575d1998-08-28 20:03:12 +00001149Called to implement evaluation of \code{\var{self}[\var{key}]}.
Fred Drake31575ce2000-09-21 05:28:26 +00001150For sequence types, the accepted keys should be integers and slice
1151objects.\obindex{slice} Note that
1152the special interpretation of negative indexes (if the class wishes to
Fred Drakef6669171998-05-06 19:52:49 +00001153emulate a sequence type) is up to the \method{__getitem__()} method.
Fred Drake91826ed2000-07-13 04:57:58 +00001154If \var{key} is of an inappropriate type, \exception{TypeError} may be
1155raised; if of a value outside the set of indexes for the sequence
1156(after any special interpretation of negative values),
1157\exception{IndexError} should be raised.
1158\strong{Note:} \keyword{for} loops expect that an
1159\exception{IndexError} will be raised for illegal indexes to allow
1160proper detection of the end of the sequence.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001161\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001162
Fred Drake1e42d8a1998-11-25 17:58:50 +00001163\begin{methoddesc}[mapping object]{__setitem__}{self, key, value}
Fred Draked82575d1998-08-28 20:03:12 +00001164Called to implement assignment to \code{\var{self}[\var{key}]}. Same
Fred Drake1e42d8a1998-11-25 17:58:50 +00001165note as for \method{__getitem__()}. This should only be implemented
1166for mappings if the objects support changes to the values for keys, or
1167if new keys can be added, or for sequences if elements can be
Fred Drake91826ed2000-07-13 04:57:58 +00001168replaced. The same exceptions should be raised for improper
1169\var{key} values as for the \method{__getitem__()} method.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001170\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001171
Fred Drake1e42d8a1998-11-25 17:58:50 +00001172\begin{methoddesc}[mapping object]{__delitem__}{self, key}
Fred Draked82575d1998-08-28 20:03:12 +00001173Called to implement deletion of \code{\var{self}[\var{key}]}. Same
Fred Drake1e42d8a1998-11-25 17:58:50 +00001174note as for \method{__getitem__()}. This should only be implemented
1175for mappings if the objects support removal of keys, or for sequences
Fred Drake91826ed2000-07-13 04:57:58 +00001176if elements can be removed from the sequence. The same exceptions
1177should be raised for improper \var{key} values as for the
1178\method{__getitem__()} method.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001179\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001180
1181
Fred Drake3041b071998-10-21 00:25:32 +00001182\subsection{Additional methods for emulation of sequence types
Fred Drake61c77281998-07-28 19:34:22 +00001183 \label{sequence-methods}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001184
1185The following methods can be defined to further emulate sequence
1186objects. Immutable sequences methods should only define
1187\method{__getslice__()}; mutable sequences, should define all three
1188three methods.
Fred Drakef6669171998-05-06 19:52:49 +00001189
Fred Drake1e42d8a1998-11-25 17:58:50 +00001190\begin{methoddesc}[sequence object]{__getslice__}{self, i, j}
Fred Drakea0073822000-08-18 02:42:14 +00001191\deprecated{2.0}{Support slice objects as parameters to the
1192\method{__getitem__()} method.}
Fred Draked82575d1998-08-28 20:03:12 +00001193Called to implement evaluation of \code{\var{self}[\var{i}:\var{j}]}.
1194The returned object should be of the same type as \var{self}. Note
1195that missing \var{i} or \var{j} in the slice expression are replaced
Fred Drakee15956b2000-04-03 04:51:13 +00001196by zero or \code{sys.maxint}, respectively. If negative indexes are
1197used in the slice, the length of the sequence is added to that index.
1198If the instance does not implement the \method{__len__()} method, an
1199\exception{AttributeError} is raised.
1200No guarantee is made that indexes adjusted this way are not still
1201negative. Indexes which are greater than the length of the sequence
1202are not modified.
Fred Drakea0073822000-08-18 02:42:14 +00001203If no \method{__getslice__()} is found, a slice
Thomas Wouters1d75a792000-08-17 22:37:32 +00001204object is created instead, and passed to \method{__getitem__()} instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001205\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001206
Fred Drake1e42d8a1998-11-25 17:58:50 +00001207\begin{methoddesc}[sequence object]{__setslice__}{self, i, j, sequence}
Fred Draked82575d1998-08-28 20:03:12 +00001208Called to implement assignment to \code{\var{self}[\var{i}:\var{j}]}.
1209Same notes for \var{i} and \var{j} as for \method{__getslice__()}.
Thomas Wouters1d75a792000-08-17 22:37:32 +00001210
1211This method is deprecated. If no \method{__setslice__()} is found, a slice
1212object is created instead, and passed to \method{__setitem__()} instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001213\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001214
Fred Drake1e42d8a1998-11-25 17:58:50 +00001215\begin{methoddesc}[sequence object]{__delslice__}{self, i, j}
Fred Draked82575d1998-08-28 20:03:12 +00001216Called to implement deletion of \code{\var{self}[\var{i}:\var{j}]}.
1217Same notes for \var{i} and \var{j} as for \method{__getslice__()}.
Thomas Wouters1d75a792000-08-17 22:37:32 +00001218This method is deprecated. If no \method{__delslice__()} is found, a slice
1219object is created instead, and passed to \method{__delitem__()} instead.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001220\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001221
Thomas Wouters1d75a792000-08-17 22:37:32 +00001222Notice that these methods are only invoked when a single slice with a single
1223colon is used, and the slice method is available. For slice operations
1224involving extended slice notation, or in absence of the slice methods,
1225\method{__getitem__()}, \method{__setitem__()} or \method{__delitem__()} is
1226called with a slice object as argument.
Fred Drakef6669171998-05-06 19:52:49 +00001227
Fred Drakef89259782000-09-21 22:27:16 +00001228The following example demonstrate how to make your program or module
1229compatible with earlier versions of Python (assuming that methods
1230\method{__getitem__()}, \method{__setitem__()} and \method{__delitem__()}
1231support slice objects as arguments):
1232
1233\begin{verbatim}
1234class MyClass:
1235 ...
1236 def __getitem__(self, index):
1237 ...
1238 def __setitem__(self, index, value):
1239 ...
1240 def __delitem__(self, index):
1241 ...
1242
1243 if sys.version_info < (2, 0):
1244 # They won't be defined if version is at least 2.0 final
1245
1246 def __getslice__(self, i, j):
1247 return self[max(0, i):max(0, j):]
1248 def __setslice__(self, i, j, seq):
1249 self[max(0, i):max(0, j):] = seq
1250 def __delslice__(self, i, j):
1251 del self[max(0, i):max(0, j):]
1252 ...
1253\end{verbatim}
1254
1255Note the calls to \function{max()}; these are actually necessary due
1256to the handling of negative indices before the
1257\method{__*slice__()} methods are called. When negative indexes are
1258used, the \method{__*item__()} methods receive them as provided, but
1259the \method{__*slice__()} methods get a ``cooked'' form of the index
1260values. For each negative index value, the length of the sequence is
1261added to the index before calling the method (which may still result
1262in a negative index); this is the customary handling of negative
1263indexes by the built-in sequence types, and the \method{__*item__()}
1264methods are expected to do this as well. However, since they should
1265already be doing that, negative indexes cannot be passed in; they must
1266be be constrained to the bounds of the sequence before being passed to
1267the \method{__*item__()} methods.
1268Calling \code{max(0, i)} conveniently returns the proper value.
1269
Fred Drake8d27f892000-09-19 18:21:25 +00001270The membership test operators (\keyword{in} and \keyword{not in}) are
1271normally implemented as iteration loop through the sequence. However,
1272sequence objects can supply the following special method with a more
1273efficient implementation:
1274
1275\begin{methoddesc}[sequence object]{__contains__}{self, item}
1276Called to implement membership test operators. Should return true if
1277\var{item} is in \var{self}, false otherwise.
1278\end{methoddesc}
1279
Fred Drake15988fd1999-02-12 18:14:57 +00001280
Fred Drake61c77281998-07-28 19:34:22 +00001281\subsection{Emulating numeric types\label{numeric-types}}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001282
1283The following methods can be defined to emulate numeric objects.
1284Methods corresponding to operations that are not supported by the
1285particular kind of number implemented (e.g., bitwise operations for
1286non-integral numbers) should be left undefined.
Fred Drakef6669171998-05-06 19:52:49 +00001287
Fred Drakeb8943701999-05-10 13:43:22 +00001288\begin{methoddesc}[numeric object]{__add__}{self, other}
1289\methodline[numeric object]{__sub__}{self, other}
1290\methodline[numeric object]{__mul__}{self, other}
1291\methodline[numeric object]{__div__}{self, other}
1292\methodline[numeric object]{__mod__}{self, other}
1293\methodline[numeric object]{__divmod__}{self, other}
1294\methodline[numeric object]{__pow__}{self, other\optional{, modulo}}
1295\methodline[numeric object]{__lshift__}{self, other}
1296\methodline[numeric object]{__rshift__}{self, other}
1297\methodline[numeric object]{__and__}{self, other}
1298\methodline[numeric object]{__xor__}{self, other}
1299\methodline[numeric object]{__or__}{self, other}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001300These functions are
1301called to implement the binary arithmetic operations (\code{+},
Fred Draked82575d1998-08-28 20:03:12 +00001302\code{-}, \code{*}, \code{/}, \code{\%},
1303\function{divmod()}\bifuncindex{divmod},
1304\function{pow()}\bifuncindex{pow}, \code{**}, \code{<<}, \code{>>},
1305\code{\&}, \code{\^}, \code{|}). For instance, to evaluate the
1306expression \var{x}\code{+}\var{y}, where \var{x} is an instance of a
1307class that has an \method{__add__()} method,
1308\code{\var{x}.__add__(\var{y})} is called. Note that
1309\method{__pow__()} should be defined to accept an optional third
1310argument if the ternary version of the built-in
1311\function{pow()}\bifuncindex{pow} function is to be supported.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001312\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001313
Fred Drakeb8943701999-05-10 13:43:22 +00001314\begin{methoddesc}[numeric object]{__radd__}{self, other}
1315\methodline[numeric object]{__rsub__}{self, other}
1316\methodline[numeric object]{__rmul__}{self, other}
1317\methodline[numeric object]{__rdiv__}{self, other}
1318\methodline[numeric object]{__rmod__}{self, other}
1319\methodline[numeric object]{__rdivmod__}{self, other}
1320\methodline[numeric object]{__rpow__}{self, other}
1321\methodline[numeric object]{__rlshift__}{self, other}
1322\methodline[numeric object]{__rrshift__}{self, other}
1323\methodline[numeric object]{__rand__}{self, other}
1324\methodline[numeric object]{__rxor__}{self, other}
1325\methodline[numeric object]{__ror__}{self, other}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001326These functions are
1327called to implement the binary arithmetic operations (\code{+},
Fred Draked82575d1998-08-28 20:03:12 +00001328\code{-}, \code{*}, \code{/}, \code{\%},
1329\function{divmod()}\bifuncindex{divmod},
1330\function{pow()}\bifuncindex{pow}, \code{**}, \code{<<}, \code{>>},
Guido van Rossumab782dd2001-01-18 15:17:06 +00001331\code{\&}, \code{\^}, \code{|}) with reflected (swapped) operands. These
Fred Draked82575d1998-08-28 20:03:12 +00001332functions are only called if the left operand does not support the
1333corresponding operation. For instance, to evaluate the expression
1334\var{x}\code{-}\var{y}, where \var{y} is an instance of a class that
1335has an \method{__rsub__()} method, \code{\var{y}.__rsub__(\var{x})} is
1336called. Note that ternary \function{pow()}\bifuncindex{pow} will not
1337try calling \method{__rpow__()} (the coercion rules would become too
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001338complicated).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001339\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001340
Thomas Woutersdc90cc22000-12-11 23:11:51 +00001341\begin{methoddesc}[numeric object]{__iadd__}{self, other}
1342\methodline[numeric object]{__isub__}{self, other}
1343\methodline[numeric object]{__imul__}{self, other}
1344\methodline[numeric object]{__idiv__}{self, other}
1345\methodline[numeric object]{__imod__}{self, other}
1346\methodline[numeric object]{__ipow__}{self, other\optional{, modulo}}
1347\methodline[numeric object]{__ilshift__}{self, other}
1348\methodline[numeric object]{__irshift__}{self, other}
1349\methodline[numeric object]{__iand__}{self, other}
1350\methodline[numeric object]{__ixor__}{self, other}
1351\methodline[numeric object]{__ior__}{self, other}
1352These methods are called to implement the augmented arithmetic operations
1353(\code{+=}, \code{-=}, \code{*=}, \code{/=}, \code{\%=}, \code{**=},
1354\code{<<=}, \code{>>=}, \code{\&=}, \code{\^=}, \code{|=}). These methods
1355should attempt to do the operation in-place (modifying \var{self}) and
1356return the result (which could be, but does not have to be, \var{self}). If
1357a specific method is not defined, the augmented operation falls back to the
1358normal methods. For instance, to evaluate the expression
1359\var{x}\code{+=}\var{y}, where \var{x} is an instance of a class that has an
1360\method{__iadd__()} method, \code{\var{x}.__iadd__(\var{y})} is called. If
1361\var{x} is an instance of a class that does not define a \method{__iadd()}
1362method, \code{\var{x}.__add__(\var{y})} and \code{\var{y}.__radd__(\var{x})}
1363are considered, as with the evaluation of \var{x}\code{+}\var{y}.
1364
1365\end{methoddesc}
1366
Fred Drakeb8943701999-05-10 13:43:22 +00001367\begin{methoddesc}[numeric object]{__neg__}{self}
1368\methodline[numeric object]{__pos__}{self}
1369\methodline[numeric object]{__abs__}{self}
1370\methodline[numeric object]{__invert__}{self}
Fred Drakef6669171998-05-06 19:52:49 +00001371Called to implement the unary arithmetic operations (\code{-}, \code{+},
Fred Drakee57a1142000-06-15 20:07:25 +00001372\function{abs()}\bifuncindex{abs} and \code{\~{}}).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001373\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001374
Fred Drakeb8943701999-05-10 13:43:22 +00001375\begin{methoddesc}[numeric object]{__complex__}{self}
1376\methodline[numeric object]{__int__}{self}
1377\methodline[numeric object]{__long__}{self}
1378\methodline[numeric object]{__float__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001379Called to implement the built-in functions
Fred Drake15988fd1999-02-12 18:14:57 +00001380\function{complex()}\bifuncindex{complex},
1381\function{int()}\bifuncindex{int}, \function{long()}\bifuncindex{long},
Fred Draked82575d1998-08-28 20:03:12 +00001382and \function{float()}\bifuncindex{float}. Should return a value of
1383the appropriate type.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001384\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001385
Fred Drakeb8943701999-05-10 13:43:22 +00001386\begin{methoddesc}[numeric object]{__oct__}{self}
1387\methodline[numeric object]{__hex__}{self}
Fred Draked82575d1998-08-28 20:03:12 +00001388Called to implement the built-in functions
1389\function{oct()}\bifuncindex{oct} and
1390\function{hex()}\bifuncindex{hex}. Should return a string value.
Fred Drake1e42d8a1998-11-25 17:58:50 +00001391\end{methoddesc}
Fred Drakef6669171998-05-06 19:52:49 +00001392
Fred Drakeb8943701999-05-10 13:43:22 +00001393\begin{methoddesc}[numeric object]{__coerce__}{self, other}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001394Called to implement ``mixed-mode'' numeric arithmetic. Should either
Fred Draked82575d1998-08-28 20:03:12 +00001395return a 2-tuple containing \var{self} and \var{other} converted to
Fred Drakeb8943701999-05-10 13:43:22 +00001396a common numeric type, or \code{None} if conversion is impossible. When
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001397the common type would be the type of \code{other}, it is sufficient to
1398return \code{None}, since the interpreter will also ask the other
1399object to attempt a coercion (but sometimes, if the implementation of
1400the other type cannot be changed, it is useful to do the conversion to
1401the other type here).
Fred Drake1e42d8a1998-11-25 17:58:50 +00001402\end{methoddesc}
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001403
1404\strong{Coercion rules}: to evaluate \var{x} \var{op} \var{y}, the
1405following steps are taken (where \method{__op__()} and
1406\method{__rop__()} are the method names corresponding to \var{op},
Guido van Rossum7c0240f1998-07-24 15:36:43 +00001407e.g., if var{op} is `\code{+}', \method{__add__()} and
Guido van Rossum83b2f8a1998-07-23 17:12:46 +00001408\method{__radd__()} are used). If an exception occurs at any point,
1409the evaluation is abandoned and exception handling takes over.
1410
1411\begin{itemize}
1412
1413\item[0.] If \var{x} is a string object and op is the modulo operator (\%),
1414the string formatting operation is invoked and the remaining steps are
1415skipped.
1416
1417\item[1.] If \var{x} is a class instance:
1418
1419 \begin{itemize}
1420
1421 \item[1a.] If \var{x} has a \method{__coerce__()} method:
1422 replace \var{x} and \var{y} with the 2-tuple returned by
1423 \code{\var{x}.__coerce__(\var{y})}; skip to step 2 if the
1424 coercion returns \code{None}.
1425
1426 \item[1b.] If neither \var{x} nor \var{y} is a class instance
1427 after coercion, go to step 3.
1428
1429 \item[1c.] If \var{x} has a method \method{__op__()}, return
1430 \code{\var{x}.__op__(\var{y})}; otherwise, restore \var{x} and
1431 \var{y} to their value before step 1a.
1432
1433 \end{itemize}
1434
1435\item[2.] If \var{y} is a class instance:
1436
1437 \begin{itemize}
1438
1439 \item[2a.] If \var{y} has a \method{__coerce__()} method:
1440 replace \var{y} and \var{x} with the 2-tuple returned by
1441 \code{\var{y}.__coerce__(\var{x})}; skip to step 3 if the
1442 coercion returns \code{None}.
1443
1444 \item[2b.] If neither \var{x} nor \var{y} is a class instance
1445 after coercion, go to step 3.
1446
1447 \item[2b.] If \var{y} has a method \method{__rop__()}, return
1448 \code{\var{y}.__rop__(\var{x})}; otherwise, restore \var{x}
1449 and \var{y} to their value before step 2a.
1450
1451 \end{itemize}
1452
1453\item[3.] We only get here if neither \var{x} nor \var{y} is a class
1454instance.
1455
1456 \begin{itemize}
1457
1458 \item[3a.] If op is `\code{+}' and \var{x} is a sequence,
1459 sequence concatenation is invoked.
1460
1461 \item[3b.] If op is `\code{*}' and one operand is a sequence
1462 and the other an integer, sequence repetition is invoked.
1463
1464 \item[3c.] Otherwise, both operands must be numbers; they are
1465 coerced to a common type if possible, and the numeric
1466 operation is invoked for that type.
1467
1468 \end{itemize}
1469
1470\end{itemize}